2024-05-21T14:27:18.860 INFO:root:teuthology version: 0.0.1.dev287+gb9e3da8 2024-05-21T14:27:18.860 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} --owner scheduled_pdonnell@teuthology --name pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7718553 --verbose -- /home/teuthworker/archive/pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7718553/orig.config.yaml 2024-05-21T14:27:18.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-21T14:27:19.001 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7718553 branch: wip-pdonnell-testing-20240517.203521-squid-debug description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} email: pdonnell@redhat.com first_in_suite: false job_id: '7718553' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-pdonnell-testing-20240517.203521-squid-debug ceph: cephfs: max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - Replacing daemon mds sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240517.203521-squid-debug sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 9749 sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d sleep_before_teardown: 0 subset: 272/512 suite: fs suite_branch: wip-pdonnell-testing-20240517.203521-squid-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPn9KyXoiqdlMX212cm43NZIIgumn1sh9wo3CxCVcO866TWHepU31Gvg9Nk/esqCqM10Omai7ZLghh9xiwHydAk= smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHNQEPTlbgn4/F93gLdL4h8XwEQNTjVnBYVOuZkuiDaTTTeYy4AWUJiI6DwAxHIO+zyFKyhLzChmA+m6yXkdF44= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - mds_thrash: null - workunit: clients: all: - fs/misc/trivial_sync.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a timestamp: 2024-05-21_13:18:14 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-05-21T14:27:19.002 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa; will attempt to use it 2024-05-21T14:27:19.002 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa/tasks 2024-05-21T14:27:19.003 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-21T14:27:19.004 INFO:teuthology.task.internal:Checking packages... 2024-05-21T14:27:19.025 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd2b507c724ef6c8295ee0a35d185cdab167fd61d' 2024-05-21T14:27:19.025 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-21T14:27:19.025 INFO:teuthology.packaging:ref: None 2024-05-21T14:27:19.025 INFO:teuthology.packaging:tag: None 2024-05-21T14:27:19.025 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240517.203521-squid-debug 2024-05-21T14:27:19.025 INFO:teuthology.packaging:sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-21T14:27:19.025 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-pdonnell-testing-20240517.203521-squid-debug 2024-05-21T14:27:19.164 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2744-gd2b507c7-1jammy 2024-05-21T14:27:19.165 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-21T14:27:19.173 INFO:teuthology.task.internal:no buildpackages task found 2024-05-21T14:27:19.173 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-21T14:27:19.214 INFO:teuthology.task.internal:Saving configuration 2024-05-21T14:27:19.231 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-21T14:27:19.238 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-21T14:27:19.264 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7718553', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-21 14:21:53.256600', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKHKzqB0kKvev7aMcMxgQ2GfduMV3Wj4O5ixj8KKhY4G'} 2024-05-21T14:27:19.286 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7718553', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-21 14:21:53.255182', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEavkCczocFDkaYurZ5cB6wG+iDVFuawxyxoLGlS9I9C'} 2024-05-21T14:27:19.286 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-21T14:27:19.291 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-21T14:27:19.292 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-05-21T14:27:19.292 INFO:teuthology.run_tasks:Running task console_log... 2024-05-21T14:27:19.373 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f48b1fe7ac0>, signals=[15]) 2024-05-21T14:27:19.373 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-21T14:27:19.379 INFO:teuthology.task.internal:Opening connections... 2024-05-21T14:27:19.379 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2024-05-21T14:27:19.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T14:27:19.461 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2024-05-21T14:27:19.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T14:27:19.539 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-21T14:27:19.546 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2024-05-21T14:27:19.552 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2024-05-21T14:27:19.552 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-05-21T14:27:19.597 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-21T14:27:19.597 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Ubuntu" 2024-05-21T14:27:19.597 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="22.04" 2024-05-21T14:27:19.597 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-21T14:27:19.597 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_CODENAME=jammy 2024-05-21T14:27:19.597 INFO:teuthology.orchestra.run.smithi078.stdout:ID=ubuntu 2024-05-21T14:27:19.598 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE=debian 2024-05-21T14:27:19.598 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-21T14:27:19.598 INFO:teuthology.orchestra.run.smithi078.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-21T14:27:19.598 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-21T14:27:19.598 INFO:teuthology.orchestra.run.smithi078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-21T14:27:19.598 INFO:teuthology.orchestra.run.smithi078.stdout:UBUNTU_CODENAME=jammy 2024-05-21T14:27:19.598 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-05-21T14:27:19.614 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-05-21T14:27:19.619 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-05-21T14:27:19.619 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-05-21T14:27:19.669 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-21T14:27:19.669 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Ubuntu" 2024-05-21T14:27:19.669 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="22.04" 2024-05-21T14:27:19.670 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-21T14:27:19.670 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_CODENAME=jammy 2024-05-21T14:27:19.670 INFO:teuthology.orchestra.run.smithi084.stdout:ID=ubuntu 2024-05-21T14:27:19.670 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE=debian 2024-05-21T14:27:19.670 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-21T14:27:19.670 INFO:teuthology.orchestra.run.smithi084.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-21T14:27:19.670 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-21T14:27:19.670 INFO:teuthology.orchestra.run.smithi084.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-21T14:27:19.670 INFO:teuthology.orchestra.run.smithi084.stdout:UBUNTU_CODENAME=jammy 2024-05-21T14:27:19.670 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-05-21T14:27:19.697 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-21T14:27:19.707 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-21T14:27:19.722 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-21T14:27:19.722 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2024-05-21T14:27:19.727 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2024-05-21T14:27:19.731 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-21T14:27:19.747 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-21T14:27:19.747 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2024-05-21T14:27:19.775 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2024-05-21T14:27:19.886 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-21T14:27:19.935 INFO:teuthology.run_tasks:Running task kernel... 2024-05-21T14:27:19.949 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-21T14:27:19.949 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-05-21T14:27:19.949 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-05-21T14:27:19.949 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-21T14:27:19.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T14:27:19.955 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-05-21T14:27:20.144 DEBUG:teuthology.task.kernel:sha1 for client.0 is 4fed890e8ce3966dbe380e9eb4b0a796eddb841c 2024-05-21T14:27:20.144 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4fed890e8ce3966dbe380e9eb4b0a796eddb841c"... 2024-05-21T14:27:20.144 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-05-21T14:27:20.150 INFO:teuthology.orchestra.run.smithi078.stdout:5.15.0-56-generic 2024-05-21T14:27:20.150 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 4fed890e8ce3966dbe380e9eb4b0a796eddb841c 2024-05-21T14:27:20.151 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-21T14:27:20.151 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-05-21T14:27:20.151 DEBUG:teuthology.orchestra.run.smithi078:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-05-21T14:27:20.207 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-05-21T14:27:20.364 INFO:teuthology.orchestra.run.smithi078.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-05-21T14:27:20.364 INFO:teuthology.orchestra.run.smithi078.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-05-21T14:27:20.364 INFO:teuthology.orchestra.run.smithi078.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-05-21T14:27:20.364 INFO:teuthology.orchestra.run.smithi078.stderr:hint: 2024-05-21T14:27:20.364 INFO:teuthology.orchestra.run.smithi078.stderr:hint: git config --global init.defaultBranch 2024-05-21T14:27:20.364 INFO:teuthology.orchestra.run.smithi078.stderr:hint: 2024-05-21T14:27:20.364 INFO:teuthology.orchestra.run.smithi078.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-05-21T14:27:20.364 INFO:teuthology.orchestra.run.smithi078.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-05-21T14:27:20.364 INFO:teuthology.orchestra.run.smithi078.stderr:hint: 2024-05-21T14:27:20.364 INFO:teuthology.orchestra.run.smithi078.stderr:hint: git branch -m 2024-05-21T14:27:20.365 INFO:teuthology.orchestra.run.smithi078.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-05-21T14:27:20.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-05-21T14:27:20.433 DEBUG:teuthology.orchestra.run.smithi078:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-05-21T14:27:20.490 DEBUG:teuthology.orchestra.run.smithi078:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-05-21T14:28:49.267 INFO:teuthology.orchestra.run.smithi078.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-05-21T14:28:49.268 INFO:teuthology.orchestra.run.smithi078.stderr: * [new branch] main -> origin/main 2024-05-21T14:28:49.302 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190312 -> 20190312 2024-05-21T14:28:49.302 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190416 -> 20190416 2024-05-21T14:28:49.302 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190514 -> 20190514 2024-05-21T14:28:49.302 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190618 -> 20190618 2024-05-21T14:28:49.302 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190717 -> 20190717 2024-05-21T14:28:49.302 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190815 -> 20190815 2024-05-21T14:28:49.302 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190923 -> 20190923 2024-05-21T14:28:49.302 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20191022 -> 20191022 2024-05-21T14:28:49.302 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20191215 -> 20191215 2024-05-21T14:28:49.302 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200122 -> 20200122 2024-05-21T14:28:49.303 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200316 -> 20200316 2024-05-21T14:28:49.305 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200421 -> 20200421 2024-05-21T14:28:49.305 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200519 -> 20200519 2024-05-21T14:28:49.305 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200619 -> 20200619 2024-05-21T14:28:49.305 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200721 -> 20200721 2024-05-21T14:28:49.305 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200817 -> 20200817 2024-05-21T14:28:49.305 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200918 -> 20200918 2024-05-21T14:28:49.305 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20201022 -> 20201022 2024-05-21T14:28:49.306 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20201118 -> 20201118 2024-05-21T14:28:49.306 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20201218 -> 20201218 2024-05-21T14:28:49.306 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210208 -> 20210208 2024-05-21T14:28:49.306 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210315 -> 20210315 2024-05-21T14:28:49.306 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210511 -> 20210511 2024-05-21T14:28:49.306 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210716 -> 20210716 2024-05-21T14:28:49.306 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210818 -> 20210818 2024-05-21T14:28:49.306 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210919 -> 20210919 2024-05-21T14:28:49.306 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20211027 -> 20211027 2024-05-21T14:28:49.306 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20211216 -> 20211216 2024-05-21T14:28:49.306 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220209 -> 20220209 2024-05-21T14:28:49.306 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220310 -> 20220310 2024-05-21T14:28:49.307 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220411 -> 20220411 2024-05-21T14:28:49.307 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220509 -> 20220509 2024-05-21T14:28:49.307 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220610 -> 20220610 2024-05-21T14:28:49.307 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220708 -> 20220708 2024-05-21T14:28:49.307 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220815 -> 20220815 2024-05-21T14:28:49.309 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220913 -> 20220913 2024-05-21T14:28:49.309 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20221012 -> 20221012 2024-05-21T14:28:49.309 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20221109 -> 20221109 2024-05-21T14:28:49.309 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20221214 -> 20221214 2024-05-21T14:28:49.309 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230117 -> 20230117 2024-05-21T14:28:49.309 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230210 -> 20230210 2024-05-21T14:28:49.309 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230310 -> 20230310 2024-05-21T14:28:49.309 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230404 -> 20230404 2024-05-21T14:28:49.310 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230515 -> 20230515 2024-05-21T14:28:49.310 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230625 -> 20230625 2024-05-21T14:28:49.310 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230804 -> 20230804 2024-05-21T14:28:49.310 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230919 -> 20230919 2024-05-21T14:28:49.310 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20231030 -> 20231030 2024-05-21T14:28:49.310 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20231111 -> 20231111 2024-05-21T14:28:49.310 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20231211 -> 20231211 2024-05-21T14:28:49.310 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20240115 -> 20240115 2024-05-21T14:28:49.310 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20240220 -> 20240220 2024-05-21T14:28:49.310 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20240312 -> 20240312 2024-05-21T14:28:49.310 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20240410 -> 20240410 2024-05-21T14:28:49.310 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20240513 -> 20240513 2024-05-21T14:28:53.598 INFO:teuthology.orchestra.run.smithi078.stderr:Updating files: 45% (1552/3421) Updating files: 46% (1574/3421) Updating files: 47% (1608/3421) Updating files: 48% (1643/3421) Updating files: 49% (1677/3421) Updating files: 50% (1711/3421) Updating files: 51% (1745/3421) Updating files: 52% (1779/3421) Updating files: 53% (1814/3421) Updating files: 54% (1848/3421) Updating files: 55% (1882/3421) Updating files: 56% (1916/3421) Updating files: 57% (1950/3421) Updating files: 58% (1985/3421) Updating files: 59% (2019/3421) Updating files: 59% (2044/3421) Updating files: 60% (2053/3421) Updating files: 61% (2087/3421) Updating files: 62% (2122/3421) Updating files: 63% (2156/3421) Updating files: 64% (2190/3421) Updating files: 65% (2224/3421) Updating files: 66% (2258/3421) Updating files: 67% (2293/3421) Updating files: 68% (2327/3421) Updating files: 69% (2361/3421) Updating files: 70% (2395/3421) Updating files: 70% (2402/3421) Updating files: 71% (2429/3421) Updating files: 72% (2464/3421) Updating files: 73% (2498/3421) Updating files: 74% (2532/3421) Updating files: 75% (2566/3421) Updating files: 76% (2600/3421) Updating files: 77% (2635/3421) Updating files: 78% (2669/3421) Updating files: 79% (2703/3421) Updating files: 80% (2737/3421) Updating files: 81% (2772/3421) Updating files: 82% (2806/3421) Updating files: 83% (2840/3421) Updating files: 83% (2849/3421) Updating files: 84% (2874/3421) Updating files: 85% (2908/3421) Updating files: 86% (2943/3421) Updating files: 87% (2977/3421) Updating files: 88% (3011/3421) Updating files: 89% (3045/3421) Updating files: 90% (3079/3421) Updating files: 91% (3114/3421) Updating files: 92% (3148/3421) Updating files: 93% (3182/3421) Updating files: 94% (3216/3421) Updating files: 95% (3250/3421) Updating files: 96% (3285/3421) Updating files: 97% (3319/3421) Updating files: 98% (3353/3421) Updating files: 99% (3387/3421) Updating files: 100% (3421/3421) Updating files: 100% (3421/3421), done. 2024-05-21T14:28:53.603 INFO:teuthology.orchestra.run.smithi078.stdout:HEAD is now at ec8627ef Merge branch 'amd-isp-staging' into 'main' 2024-05-21T14:28:53.624 INFO:teuthology.task.kernel:Downloading kernel 4fed890e8ce3966dbe380e9eb4b0a796eddb841c on client.0... 2024-05-21T14:28:53.625 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4fed890e8ce3966dbe380e9eb4b0a796eddb841c 2024-05-21T14:28:53.845 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/4fed890e8ce3966dbe380e9eb4b0a796eddb841c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g4fed890e8ce3/ 2024-05-21T14:28:53.846 DEBUG:teuthology.orchestra.run.smithi078:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g4fed890e8ce3_6.9.0-rc3-g4fed890e8ce3-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/4fed890e8ce3966dbe380e9eb4b0a796eddb841c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g4fed890e8ce3/ --input-file=- 2024-05-21T14:28:53.848 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi078.front.sepia.ceph.com to complete... 2024-05-21T14:28:55.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21 14:28:55 URL:https://1.chacra.ceph.com/r/kernel/testing/4fed890e8ce3966dbe380e9eb4b0a796eddb841c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g4fed890e8ce3/linux-image-6.9.0-rc3-g4fed890e8ce3_6.9.0-rc3-g4fed890e8ce3-1_amd64.deb [44803860/44803860] -> "/tmp/linux-image.deb" [1] 2024-05-21T14:28:55.744 INFO:teuthology.orchestra.run.smithi078.stderr:FINISHED --2024-05-21 14:28:55-- 2024-05-21T14:28:55.744 INFO:teuthology.orchestra.run.smithi078.stderr:Total wall clock time: 1.9s 2024-05-21T14:28:55.744 INFO:teuthology.orchestra.run.smithi078.stderr:Downloaded: 1 files, 43M in 1.7s (25.6 MB/s) 2024-05-21T14:28:55.748 INFO:teuthology.task.kernel:Installing kernel 4fed890e8ce3966dbe380e9eb4b0a796eddb841c on client.0... 2024-05-21T14:28:55.748 DEBUG:teuthology.orchestra.run.smithi078:> sudo dpkg -i /tmp/linux-image.deb 2024-05-21T14:28:56.006 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g4fed890e8ce3. 2024-05-21T14:28:58.088 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-05-21T14:28:58.092 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-05-21T14:28:58.281 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-image-6.9.0-rc3-g4fed890e8ce3 (6.9.0-rc3-g4fed890e8ce3-1) ... 2024-05-21T14:29:02.188 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-image-6.9.0-rc3-g4fed890e8ce3 (6.9.0-rc3-g4fed890e8ce3-1) ... 2024-05-21T14:29:02.296 INFO:teuthology.orchestra.run.smithi078.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g4fed890e8ce3 2024-05-21T14:29:25.390 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub' 2024-05-21T14:29:25.413 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-21T14:29:25.442 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2024-05-21T14:29:25.798 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g4fed890e8ce3 2024-05-21T14:29:25.821 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g4fed890e8ce3 2024-05-21T14:29:26.172 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-21T14:29:26.181 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-21T14:29:26.244 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-21T14:29:26.250 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-21T14:29:26.411 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-21T14:29:26.411 INFO:teuthology.orchestra.run.smithi078.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-21T14:29:26.411 INFO:teuthology.orchestra.run.smithi078.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-21T14:29:26.454 INFO:teuthology.orchestra.run.smithi078.stderr:done 2024-05-21T14:29:26.648 DEBUG:teuthology.orchestra.run.smithi078:> dpkg-deb -c /tmp/linux-image.deb 2024-05-21T14:29:26.657 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./ 2024-05-21T14:29:26.657 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./boot/ 2024-05-21T14:29:26.657 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7002012 2024-05-21 01:11 ./boot/System.map-6.9.0-rc3-g4fed890e8ce3 2024-05-21T14:29:26.675 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 172073 2024-05-21 01:11 ./boot/config-6.9.0-rc3-g4fed890e8ce3 2024-05-21T14:29:26.675 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13120512 2024-05-21 01:11 ./boot/vmlinuz-6.9.0-rc3-g4fed890e8ce3 2024-05-21T14:29:26.696 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./etc/ 2024-05-21T14:29:26.696 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./etc/kernel/ 2024-05-21T14:29:26.696 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./etc/kernel/postinst.d/ 2024-05-21T14:29:26.696 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./etc/kernel/postrm.d/ 2024-05-21T14:29:26.696 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./etc/kernel/preinst.d/ 2024-05-21T14:29:26.697 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./etc/kernel/prerm.d/ 2024-05-21T14:29:26.697 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/ 2024-05-21T14:29:26.697 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/ 2024-05-21T14:29:26.697 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/ 2024-05-21T14:29:26.697 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/ 2024-05-21T14:29:26.697 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/ 2024-05-21T14:29:26.697 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/ 2024-05-21T14:29:26.697 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/ 2024-05-21T14:29:26.697 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 507569 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/aesni-intel.ko 2024-05-21T14:29:26.701 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28361 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-21T14:29:26.701 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-21T14:29:26.701 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35009 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-21T14:29:26.701 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-21T14:29:26.701 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 109905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-21T14:29:26.701 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 155249 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-21T14:29:26.701 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15241 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-21T14:29:26.701 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16089 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-21T14:29:26.701 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87009 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-21T14:29:26.702 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-21T14:29:26.702 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50305 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-21T14:29:26.702 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50377 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-21T14:29:26.702 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-21T14:29:26.702 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44657 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-21T14:29:26.702 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-21T14:29:26.702 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-21T14:29:26.702 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53569 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-21T14:29:26.702 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34761 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-21T14:29:26.702 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14809 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-21T14:29:26.702 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/kernel/ 2024-05-21T14:29:26.702 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/kernel/cpu/ 2024-05-21T14:29:26.702 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/kernel/cpu/mce/ 2024-05-21T14:29:26.703 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49081 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-21T14:29:26.703 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/kernel/cpuid.ko 2024-05-21T14:29:26.703 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/kernel/msr.ko 2024-05-21T14:29:26.703 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/kvm/ 2024-05-21T14:29:26.703 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 444425 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-21T14:29:26.703 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1035881 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-21T14:29:26.703 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2849609 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/arch/x86/kvm/kvm.ko 2024-05-21T14:29:26.789 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/ 2024-05-21T14:29:26.789 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65025 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/af_alg.ko 2024-05-21T14:29:26.789 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/algif_hash.ko 2024-05-21T14:29:26.789 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/algif_skcipher.ko 2024-05-21T14:29:26.789 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20225 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/ansi_cprng.ko 2024-05-21T14:29:26.789 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21065 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/anubis.ko 2024-05-21T14:29:26.789 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10929 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/arc4.ko 2024-05-21T14:29:26.790 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/asymmetric_keys/ 2024-05-21T14:29:26.790 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-05-21T14:29:26.790 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/async_tx/ 2024-05-21T14:29:26.790 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/async_tx/async_memcpy.ko 2024-05-21T14:29:26.790 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22609 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/async_tx/async_pq.ko 2024-05-21T14:29:26.790 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24841 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-21T14:29:26.790 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/async_tx/async_tx.ko 2024-05-21T14:29:26.790 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20649 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/async_tx/async_xor.ko 2024-05-21T14:29:26.790 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20737 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/async_tx/raid6test.ko 2024-05-21T14:29:26.790 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25137 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/authenc.ko 2024-05-21T14:29:26.790 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/authencesn.ko 2024-05-21T14:29:26.791 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/blake2b_generic.ko 2024-05-21T14:29:26.791 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13713 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/blowfish_common.ko 2024-05-21T14:29:26.791 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/blowfish_generic.ko 2024-05-21T14:29:26.791 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40889 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/camellia_generic.ko 2024-05-21T14:29:26.791 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/cast5_generic.ko 2024-05-21T14:29:26.791 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/cast6_generic.ko 2024-05-21T14:29:26.791 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10489 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/cast_common.ko 2024-05-21T14:29:26.791 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43281 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/ccm.ko 2024-05-21T14:29:26.791 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17497 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/cmac.ko 2024-05-21T14:29:26.791 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/crc32_generic.ko 2024-05-21T14:29:26.791 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59129 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/cryptd.ko 2024-05-21T14:29:26.791 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/crypto_engine.ko 2024-05-21T14:29:26.791 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32169 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/crypto_simd.ko 2024-05-21T14:29:26.792 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30881 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/crypto_user.ko 2024-05-21T14:29:26.792 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21697 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/cts.ko 2024-05-21T14:29:26.792 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12481 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/des_generic.ko 2024-05-21T14:29:26.792 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18561 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/dh_generic.ko 2024-05-21T14:29:26.792 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/echainiv.ko 2024-05-21T14:29:26.792 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/essiv.ko 2024-05-21T14:29:26.792 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/fcrypt.ko 2024-05-21T14:29:26.792 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28201 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/khazad.ko 2024-05-21T14:29:26.792 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19089 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/lrw.ko 2024-05-21T14:29:26.792 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/lz4.ko 2024-05-21T14:29:26.792 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/lz4hc.ko 2024-05-21T14:29:26.792 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13393 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/md4.ko 2024-05-21T14:29:26.793 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11249 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/michael_mic.ko 2024-05-21T14:29:26.793 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/pcbc.ko 2024-05-21T14:29:26.793 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/pcrypt.ko 2024-05-21T14:29:26.793 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/rmd160.ko 2024-05-21T14:29:26.793 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30673 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/seed.ko 2024-05-21T14:29:26.793 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/serpent_generic.ko 2024-05-21T14:29:26.793 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 169065 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/tcrypt.ko 2024-05-21T14:29:26.793 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/tea.ko 2024-05-21T14:29:26.793 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29641 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/twofish_common.ko 2024-05-21T14:29:26.793 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/twofish_generic.ko 2024-05-21T14:29:26.793 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/vmac.ko 2024-05-21T14:29:26.793 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/wp512.ko 2024-05-21T14:29:26.793 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/xcbc.ko 2024-05-21T14:29:26.794 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/xor.ko 2024-05-21T14:29:26.794 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/xts.ko 2024-05-21T14:29:26.794 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11281 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/crypto/xxhash_generic.ko 2024-05-21T14:29:26.794 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ 2024-05-21T14:29:26.794 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/acpi/ 2024-05-21T14:29:26.794 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21121 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/acpi/acpi_extlog.ko 2024-05-21T14:29:26.794 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-21T14:29:26.794 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32281 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/acpi/acpi_pad.ko 2024-05-21T14:29:26.794 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/acpi/apei/ 2024-05-21T14:29:26.794 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/acpi/apei/einj.ko 2024-05-21T14:29:26.794 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14505 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/acpi/ec_sys.ko 2024-05-21T14:29:26.794 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/acpi/platform_profile.ko 2024-05-21T14:29:26.795 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/acpi/sbs.ko 2024-05-21T14:29:26.795 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23385 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/acpi/sbshc.ko 2024-05-21T14:29:26.795 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119033 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/acpi/video.ko 2024-05-21T14:29:26.795 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/ 2024-05-21T14:29:26.795 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24497 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/acard-ahci.ko 2024-05-21T14:29:26.795 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 96825 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/ahci.ko 2024-05-21T14:29:26.795 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/ahci_platform.ko 2024-05-21T14:29:26.795 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 107737 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/libahci.ko 2024-05-21T14:29:26.795 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42001 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/libahci_platform.ko 2024-05-21T14:29:26.795 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_acpi.ko 2024-05-21T14:29:26.795 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_ali.ko 2024-05-21T14:29:26.795 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38329 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_amd.ko 2024-05-21T14:29:26.796 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24649 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_artop.ko 2024-05-21T14:29:26.796 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23777 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_atiixp.ko 2024-05-21T14:29:26.796 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28785 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_atp867x.ko 2024-05-21T14:29:26.796 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_cmd640.ko 2024-05-21T14:29:26.796 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28929 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_cmd64x.ko 2024-05-21T14:29:26.796 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16633 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_cypress.ko 2024-05-21T14:29:26.796 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20129 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_efar.ko 2024-05-21T14:29:26.796 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_hpt366.ko 2024-05-21T14:29:26.796 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_hpt37x.ko 2024-05-21T14:29:26.796 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26969 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-21T14:29:26.796 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-21T14:29:26.796 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19201 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_it8213.ko 2024-05-21T14:29:26.796 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_it821x.ko 2024-05-21T14:29:26.797 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14097 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_jmicron.ko 2024-05-21T14:29:26.797 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_legacy.ko 2024-05-21T14:29:26.797 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_marvell.ko 2024-05-21T14:29:26.797 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18065 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_mpiix.ko 2024-05-21T14:29:26.797 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14129 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_netcell.ko 2024-05-21T14:29:26.797 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18977 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_ninja32.ko 2024-05-21T14:29:26.797 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16761 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_ns87410.ko 2024-05-21T14:29:26.797 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20321 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_ns87415.ko 2024-05-21T14:29:26.797 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18425 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_oldpiix.ko 2024-05-21T14:29:26.797 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17481 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_opti.ko 2024-05-21T14:29:26.797 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23681 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_optidma.ko 2024-05-21T14:29:26.797 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35145 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_pcmcia.ko 2024-05-21T14:29:26.798 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43009 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-21T14:29:26.798 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-21T14:29:26.798 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15609 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_piccolo.ko 2024-05-21T14:29:26.798 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_radisys.ko 2024-05-21T14:29:26.798 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22233 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_rdc.ko 2024-05-21T14:29:26.798 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17297 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_rz1000.ko 2024-05-21T14:29:26.798 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15377 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_sch.ko 2024-05-21T14:29:26.798 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26793 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_serverworks.ko 2024-05-21T14:29:26.798 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27305 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_sil680.ko 2024-05-21T14:29:26.798 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_sl82c105.ko 2024-05-21T14:29:26.798 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18041 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_triflex.ko 2024-05-21T14:29:26.799 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35025 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pata_via.ko 2024-05-21T14:29:26.799 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26337 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/pdc_adma.ko 2024-05-21T14:29:26.799 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34889 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/sata_inic162x.ko 2024-05-21T14:29:26.799 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102121 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/sata_mv.ko 2024-05-21T14:29:26.799 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/sata_nv.ko 2024-05-21T14:29:26.799 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/sata_promise.ko 2024-05-21T14:29:26.799 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26673 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/sata_qstor.ko 2024-05-21T14:29:26.799 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34025 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/sata_sil.ko 2024-05-21T14:29:26.799 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/sata_sil24.ko 2024-05-21T14:29:26.799 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/sata_sis.ko 2024-05-21T14:29:26.800 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/sata_svw.ko 2024-05-21T14:29:26.800 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/sata_sx4.ko 2024-05-21T14:29:26.800 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17273 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/sata_uli.ko 2024-05-21T14:29:26.800 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/sata_via.ko 2024-05-21T14:29:26.800 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ata/sata_vsc.ko 2024-05-21T14:29:26.800 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/auxdisplay/ 2024-05-21T14:29:26.800 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/auxdisplay/ks0108.ko 2024-05-21T14:29:26.800 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/bcma/ 2024-05-21T14:29:26.800 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 163969 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/bcma/bcma.ko 2024-05-21T14:29:26.800 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/block/ 2024-05-21T14:29:26.800 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/block/aoe/ 2024-05-21T14:29:26.800 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 140865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/block/aoe/aoe.ko 2024-05-21T14:29:26.801 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/block/drbd/ 2024-05-21T14:29:26.801 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1241657 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/block/drbd/drbd.ko 2024-05-21T14:29:26.801 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 203289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/block/floppy.ko 2024-05-21T14:29:26.801 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/block/mtip32xx/ 2024-05-21T14:29:26.801 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 115265 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-21T14:29:26.801 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 143433 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/block/nbd.ko 2024-05-21T14:29:26.801 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/block/null_blk/ 2024-05-21T14:29:26.801 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 126617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/block/null_blk/null_blk.ko 2024-05-21T14:29:26.801 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/block/pktcdvd.ko 2024-05-21T14:29:26.802 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 313217 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/block/rbd.ko 2024-05-21T14:29:26.802 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/block/xen-blkback/ 2024-05-21T14:29:26.802 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 117233 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-21T14:29:26.802 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/block/zram/ 2024-05-21T14:29:26.802 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70385 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/block/zram/zram.ko 2024-05-21T14:29:26.802 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/ 2024-05-21T14:29:26.802 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35377 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/applicom.ko 2024-05-21T14:29:26.802 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13369 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/hangcheck-timer.ko 2024-05-21T14:29:26.802 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/hw_random/ 2024-05-21T14:29:26.802 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16137 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-21T14:29:26.802 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21537 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-21T14:29:26.802 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15305 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-21T14:29:26.803 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/hw_random/via-rng.ko 2024-05-21T14:29:26.803 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19273 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-21T14:29:26.803 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/ipmi/ 2024-05-21T14:29:26.803 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-21T14:29:26.803 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 186921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-21T14:29:26.803 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32521 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-21T14:29:26.803 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 179561 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-21T14:29:26.803 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-21T14:29:26.803 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-21T14:29:26.803 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/lp.ko 2024-05-21T14:29:26.803 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/mwave/ 2024-05-21T14:29:26.803 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/mwave/mwave.ko 2024-05-21T14:29:26.804 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/nvram.ko 2024-05-21T14:29:26.804 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38977 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/ppdev.ko 2024-05-21T14:29:26.804 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59241 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/tlclk.ko 2024-05-21T14:29:26.804 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/tpm/ 2024-05-21T14:29:26.804 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18889 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-21T14:29:26.804 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-05-21T14:29:26.804 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29425 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-05-21T14:29:26.804 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39193 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-05-21T14:29:26.804 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34169 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-21T14:29:26.804 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-21T14:29:26.804 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28497 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-05-21T14:29:26.805 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/xillybus/ 2024-05-21T14:29:26.805 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19225 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/xillybus/xillybus_class.ko 2024-05-21T14:29:26.805 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62545 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/xillybus/xillybus_core.ko 2024-05-21T14:29:26.805 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13929 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-05-21T14:29:26.805 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/clk/ 2024-05-21T14:29:26.805 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14537 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/clk/clk-palmas.ko 2024-05-21T14:29:26.805 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/clk/clk-si5351.ko 2024-05-21T14:29:26.805 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13385 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/clk/clk-twl6040.ko 2024-05-21T14:29:26.805 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24129 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/clk/clk-wm831x.ko 2024-05-21T14:29:26.805 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/cpufreq/ 2024-05-21T14:29:26.806 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11593 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-21T14:29:26.806 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-21T14:29:26.806 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28633 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-21T14:29:26.806 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/crypto/ 2024-05-21T14:29:26.806 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/crypto/ccp/ 2024-05-21T14:29:26.806 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-21T14:29:26.806 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 333657 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/crypto/ccp/ccp.ko 2024-05-21T14:29:26.806 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/crypto/intel/ 2024-05-21T14:29:26.806 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/crypto/intel/qat/ 2024-05-21T14:29:26.806 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/crypto/intel/qat/qat_common/ 2024-05-21T14:29:26.806 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 751713 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-21T14:29:26.806 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-05-21T14:29:26.807 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29497 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-21T14:29:26.807 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23169 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/crypto/padlock-aes.ko 2024-05-21T14:29:26.807 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/crypto/padlock-sha.ko 2024-05-21T14:29:26.807 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/crypto/virtio/ 2024-05-21T14:29:26.807 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-21T14:29:26.807 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/dca/ 2024-05-21T14:29:26.807 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/dca/dca.ko 2024-05-21T14:29:26.807 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/dma/ 2024-05-21T14:29:26.807 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/dma/dw/ 2024-05-21T14:29:26.807 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18593 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-21T14:29:26.807 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/dma/ioat/ 2024-05-21T14:29:26.807 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 146769 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-21T14:29:26.808 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/edac/ 2024-05-21T14:29:26.808 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 96145 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/edac/amd64_edac.ko 2024-05-21T14:29:26.808 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/edac/e752x_edac.ko 2024-05-21T14:29:26.808 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/edac/edac_mce_amd.ko 2024-05-21T14:29:26.808 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/edac/i3000_edac.ko 2024-05-21T14:29:26.808 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20729 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/edac/i3200_edac.ko 2024-05-21T14:29:26.808 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26729 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/edac/i5100_edac.ko 2024-05-21T14:29:26.808 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29593 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/edac/i5400_edac.ko 2024-05-21T14:29:26.809 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28385 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/edac/i7300_edac.ko 2024-05-21T14:29:26.809 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64161 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/edac/i7core_edac.ko 2024-05-21T14:29:26.809 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/edac/i82975x_edac.ko 2024-05-21T14:29:26.809 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22369 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/edac/ie31200_edac.ko 2024-05-21T14:29:26.809 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68697 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/edac/sb_edac.ko 2024-05-21T14:29:26.809 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20241 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/edac/x38_edac.ko 2024-05-21T14:29:26.809 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/extcon/ 2024-05-21T14:29:26.809 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14593 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/extcon/extcon-gpio.ko 2024-05-21T14:29:26.809 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31369 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/extcon/extcon-max14577.ko 2024-05-21T14:29:26.809 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35601 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/extcon/extcon-max77693.ko 2024-05-21T14:29:26.809 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29273 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/extcon/extcon-max8997.ko 2024-05-21T14:29:26.810 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/extcon/extcon-palmas.ko 2024-05-21T14:29:26.810 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27201 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/extcon/extcon-rt8973a.ko 2024-05-21T14:29:26.810 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/extcon/extcon-sm5502.ko 2024-05-21T14:29:26.810 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/firmware/ 2024-05-21T14:29:26.810 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/firmware/dmi-sysfs.ko 2024-05-21T14:29:26.810 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/firmware/efi/ 2024-05-21T14:29:26.810 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/firmware/efi/efi-pstore.ko 2024-05-21T14:29:26.810 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26361 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-21T14:29:26.810 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/ 2024-05-21T14:29:26.811 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14281 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-adp5520.ko 2024-05-21T14:29:26.811 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23233 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-amd8111.ko 2024-05-21T14:29:26.811 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-arizona.ko 2024-05-21T14:29:26.811 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16745 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-da9052.ko 2024-05-21T14:29:26.811 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-da9055.ko 2024-05-21T14:29:26.811 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-dln2.ko 2024-05-21T14:29:26.811 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-f7188x.ko 2024-05-21T14:29:26.811 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40761 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-generic.ko 2024-05-21T14:29:26.811 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-ich.ko 2024-05-21T14:29:26.811 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14033 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-05-21T14:29:26.811 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16889 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-kempld.ko 2024-05-21T14:29:26.812 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14681 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-lp3943.ko 2024-05-21T14:29:26.812 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11153 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-max7300.ko 2024-05-21T14:29:26.812 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14817 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-max730x.ko 2024-05-21T14:29:26.812 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24745 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-max732x.ko 2024-05-21T14:29:26.812 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-05-21T14:29:26.812 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55505 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-pca953x.ko 2024-05-21T14:29:26.812 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31881 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-pcf857x.ko 2024-05-21T14:29:26.812 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-rdc321x.ko 2024-05-21T14:29:26.812 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-sch.ko 2024-05-21T14:29:26.812 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23145 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-sch311x.ko 2024-05-21T14:29:26.812 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14265 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-tps65912.ko 2024-05-21T14:29:26.812 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25009 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-twl4030.ko 2024-05-21T14:29:26.813 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-twl6040.ko 2024-05-21T14:29:26.813 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-21T14:29:26.813 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17897 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-vx855.ko 2024-05-21T14:29:26.813 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19129 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-wm831x.ko 2024-05-21T14:29:26.813 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-wm8350.ko 2024-05-21T14:29:26.813 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/gpio/gpio-wm8994.ko 2024-05-21T14:29:26.813 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/ 2024-05-21T14:29:26.813 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13521 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-a4tech.ko 2024-05-21T14:29:26.813 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43553 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-apple.ko 2024-05-21T14:29:26.813 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16881 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-appleir.ko 2024-05-21T14:29:26.813 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9393 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-aureal.ko 2024-05-21T14:29:26.814 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17097 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-axff.ko 2024-05-21T14:29:26.814 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12697 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-belkin.ko 2024-05-21T14:29:26.814 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11713 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-cherry.ko 2024-05-21T14:29:26.814 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19089 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-chicony.ko 2024-05-21T14:29:26.814 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74393 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-cp2112.ko 2024-05-21T14:29:26.814 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12817 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-cypress.ko 2024-05-21T14:29:26.814 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18769 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-dr.ko 2024-05-21T14:29:26.815 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-elecom.ko 2024-05-21T14:29:26.815 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20449 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-elo.ko 2024-05-21T14:29:26.815 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15137 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-emsff.ko 2024-05-21T14:29:26.815 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-ezkey.ko 2024-05-21T14:29:26.815 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16089 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-gaff.ko 2024-05-21T14:29:26.815 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10681 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-generic.ko 2024-05-21T14:29:26.815 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19793 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-gt683r.ko 2024-05-21T14:29:26.815 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-gyration.ko 2024-05-21T14:29:26.815 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12081 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-21T14:29:26.815 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-21T14:29:26.816 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16433 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-holtekff.ko 2024-05-21T14:29:26.816 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22889 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-hyperv.ko 2024-05-21T14:29:26.816 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11889 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-icade.ko 2024-05-21T14:29:26.816 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-kensington.ko 2024-05-21T14:29:26.816 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9529 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-keytouch.ko 2024-05-21T14:29:26.816 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19169 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-kye.ko 2024-05-21T14:29:26.816 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12265 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-lcpower.ko 2024-05-21T14:29:26.816 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-led.ko 2024-05-21T14:29:26.816 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54217 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-lenovo.ko 2024-05-21T14:29:26.816 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37553 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-lg-g15.ko 2024-05-21T14:29:26.817 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68081 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-21T14:29:26.817 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 121369 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-21T14:29:26.817 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-logitech.ko 2024-05-21T14:29:26.817 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-magicmouse.ko 2024-05-21T14:29:26.817 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25769 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-microsoft.ko 2024-05-21T14:29:26.817 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11825 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-monterey.ko 2024-05-21T14:29:26.817 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59001 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-multitouch.ko 2024-05-21T14:29:26.817 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39697 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-ntrig.ko 2024-05-21T14:29:26.817 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9985 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-ortek.ko 2024-05-21T14:29:26.818 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-penmount.ko 2024-05-21T14:29:26.818 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14281 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-petalynx.ko 2024-05-21T14:29:26.818 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 91241 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-picolcd.ko 2024-05-21T14:29:26.818 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15793 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-pl.ko 2024-05-21T14:29:26.818 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16817 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-plantronics.ko 2024-05-21T14:29:26.818 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-primax.ko 2024-05-21T14:29:26.818 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42889 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-rmi.ko 2024-05-21T14:29:26.819 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-21T14:29:26.819 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16321 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-roccat-common.ko 2024-05-21T14:29:26.819 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-21T14:29:26.819 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36305 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-21T14:29:26.819 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-21T14:29:26.819 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26097 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-21T14:29:26.819 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-21T14:29:26.819 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15481 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-21T14:29:26.819 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35425 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-21T14:29:26.819 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35561 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-21T14:29:26.820 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-21T14:29:26.820 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28001 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-roccat.ko 2024-05-21T14:29:26.820 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-saitek.ko 2024-05-21T14:29:26.820 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42305 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-samsung.ko 2024-05-21T14:29:26.820 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43609 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-21T14:29:26.820 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15145 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-sjoy.ko 2024-05-21T14:29:26.820 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62129 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-sony.ko 2024-05-21T14:29:26.820 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-speedlink.ko 2024-05-21T14:29:26.820 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-steelseries.ko 2024-05-21T14:29:26.821 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-sunplus.ko 2024-05-21T14:29:26.821 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-21T14:29:26.821 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-tivo.ko 2024-05-21T14:29:26.821 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16681 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-tmff.ko 2024-05-21T14:29:26.821 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16537 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-topseed.ko 2024-05-21T14:29:26.821 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19273 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-twinhan.ko 2024-05-21T14:29:26.821 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-uclogic.ko 2024-05-21T14:29:26.821 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12569 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-waltop.ko 2024-05-21T14:29:26.821 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 184745 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-wiimote.ko 2024-05-21T14:29:26.821 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-xinmo.ko 2024-05-21T14:29:26.821 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-zpff.ko 2024-05-21T14:29:26.821 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19201 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid-zydacron.ko 2024-05-21T14:29:26.822 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 319921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/hid.ko 2024-05-21T14:29:26.822 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39529 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/uhid.ko 2024-05-21T14:29:26.822 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/usbhid/ 2024-05-21T14:29:26.822 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 153633 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/usbhid/usbhid.ko 2024-05-21T14:29:26.822 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22361 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/usbhid/usbkbd.ko 2024-05-21T14:29:26.822 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/usbhid/usbmouse.ko 2024-05-21T14:29:26.822 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 261945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hid/wacom.ko 2024-05-21T14:29:26.822 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hv/ 2024-05-21T14:29:26.822 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75065 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hv/hv_balloon.ko 2024-05-21T14:29:26.822 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 110681 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hv/hv_utils.ko 2024-05-21T14:29:26.822 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 382033 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hv/hv_vmbus.ko 2024-05-21T14:29:26.823 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/ 2024-05-21T14:29:26.823 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77153 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/abituguru.ko 2024-05-21T14:29:26.823 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67009 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/abituguru3.ko 2024-05-21T14:29:26.823 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42249 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-21T14:29:26.823 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20297 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/ad7414.ko 2024-05-21T14:29:26.823 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22009 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/ad7418.ko 2024-05-21T14:29:26.823 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29449 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/adc128d818.ko 2024-05-21T14:29:26.823 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38097 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/adm1025.ko 2024-05-21T14:29:26.823 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 115057 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/adm1026.ko 2024-05-21T14:29:26.823 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23321 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/adm1029.ko 2024-05-21T14:29:26.823 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55225 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/adm1031.ko 2024-05-21T14:29:26.823 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/adm9240.ko 2024-05-21T14:29:26.823 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/ads7828.ko 2024-05-21T14:29:26.824 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12249 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/adt7410.ko 2024-05-21T14:29:26.824 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26505 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/adt7411.ko 2024-05-21T14:29:26.824 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89025 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/adt7462.ko 2024-05-21T14:29:26.824 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49153 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/adt7470.ko 2024-05-21T14:29:26.824 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81473 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/adt7475.ko 2024-05-21T14:29:26.824 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/adt7x10.ko 2024-05-21T14:29:26.824 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/amc6821.ko 2024-05-21T14:29:26.824 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/applesmc.ko 2024-05-21T14:29:26.824 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60193 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/asb100.ko 2024-05-21T14:29:26.824 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69009 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/asc7621.ko 2024-05-21T14:29:26.824 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47977 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-21T14:29:26.824 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20321 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/atxp1.ko 2024-05-21T14:29:26.824 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33641 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/coretemp.ko 2024-05-21T14:29:26.824 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/da9052-hwmon.ko 2024-05-21T14:29:26.824 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/da9055-hwmon.ko 2024-05-21T14:29:26.825 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55713 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-21T14:29:26.825 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 113201 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/dme1737.ko 2024-05-21T14:29:26.825 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/ds1621.ko 2024-05-21T14:29:26.825 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17489 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/ds620.ko 2024-05-21T14:29:26.825 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/emc1403.ko 2024-05-21T14:29:26.825 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/emc2103.ko 2024-05-21T14:29:26.825 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34649 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/emc6w201.ko 2024-05-21T14:29:26.825 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/f71805f.ko 2024-05-21T14:29:26.825 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/f71882fg.ko 2024-05-21T14:29:26.825 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50697 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/f75375s.ko 2024-05-21T14:29:26.825 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25361 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/fam15h_power.ko 2024-05-21T14:29:26.825 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65769 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/fschmd.ko 2024-05-21T14:29:26.825 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17201 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/g760a.ko 2024-05-21T14:29:26.825 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30585 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/g762.ko 2024-05-21T14:29:26.825 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59761 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/gl518sm.ko 2024-05-21T14:29:26.826 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/gl520sm.ko 2024-05-21T14:29:26.826 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15473 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/hih6130.ko 2024-05-21T14:29:26.826 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12089 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-21T14:29:26.826 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13137 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/i5500_temp.ko 2024-05-21T14:29:26.826 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27633 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/i5k_amb.ko 2024-05-21T14:29:26.826 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42585 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/ibmaem.ko 2024-05-21T14:29:26.826 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/ibmpex.ko 2024-05-21T14:29:26.826 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/ina209.ko 2024-05-21T14:29:26.826 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14537 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/ina2xx.ko 2024-05-21T14:29:26.826 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 156465 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/it87.ko 2024-05-21T14:29:26.826 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23129 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/jc42.ko 2024-05-21T14:29:26.827 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28273 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/k10temp.ko 2024-05-21T14:29:26.827 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15729 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/k8temp.ko 2024-05-21T14:29:26.827 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21713 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/lineage-pem.ko 2024-05-21T14:29:26.827 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57769 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/lm63.ko 2024-05-21T14:29:26.827 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19777 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/lm73.ko 2024-05-21T14:29:26.827 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44121 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/lm75.ko 2024-05-21T14:29:26.827 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23241 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/lm77.ko 2024-05-21T14:29:26.827 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41473 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/lm78.ko 2024-05-21T14:29:26.827 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/lm80.ko 2024-05-21T14:29:26.827 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20545 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/lm83.ko 2024-05-21T14:29:26.827 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 86497 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/lm85.ko 2024-05-21T14:29:26.828 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55641 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/lm87.ko 2024-05-21T14:29:26.828 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42249 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/lm90.ko 2024-05-21T14:29:26.828 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23385 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/lm92.ko 2024-05-21T14:29:26.828 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 131505 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/lm93.ko 2024-05-21T14:29:26.828 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40225 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/lm95234.ko 2024-05-21T14:29:26.828 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19137 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/lm95241.ko 2024-05-21T14:29:26.828 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/lm95245.ko 2024-05-21T14:29:26.828 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26393 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/ltc2945.ko 2024-05-21T14:29:26.828 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15481 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/ltc4151.ko 2024-05-21T14:29:26.828 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17793 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/ltc4215.ko 2024-05-21T14:29:26.828 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16633 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/ltc4222.ko 2024-05-21T14:29:26.828 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18377 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/ltc4245.ko 2024-05-21T14:29:26.828 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/ltc4260.ko 2024-05-21T14:29:26.828 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/ltc4261.ko 2024-05-21T14:29:26.829 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36769 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/max16065.ko 2024-05-21T14:29:26.829 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21585 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/max1619.ko 2024-05-21T14:29:26.829 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/max1668.ko 2024-05-21T14:29:26.829 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22753 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/max197.ko 2024-05-21T14:29:26.829 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32505 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/max6639.ko 2024-05-21T14:29:26.829 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27305 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/max6650.ko 2024-05-21T14:29:26.829 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39729 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/max6697.ko 2024-05-21T14:29:26.829 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/mc13783-adc.ko 2024-05-21T14:29:26.829 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/mcp3021.ko 2024-05-21T14:29:26.829 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-05-21T14:29:26.829 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56505 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/nct6683.ko 2024-05-21T14:29:26.829 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 141353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/nct6775-core.ko 2024-05-21T14:29:26.829 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72737 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/nct6775.ko 2024-05-21T14:29:26.830 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67841 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/nct7802.ko 2024-05-21T14:29:26.830 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97777 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/pc87360.ko 2024-05-21T14:29:26.830 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/pc87427.ko 2024-05-21T14:29:26.830 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21825 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/pcf8591.ko 2024-05-21T14:29:26.830 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/pmbus/ 2024-05-21T14:29:26.830 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24753 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-21T14:29:26.830 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-21T14:29:26.830 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33265 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-21T14:29:26.830 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10793 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-21T14:29:26.830 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19841 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-21T14:29:26.830 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-21T14:29:26.830 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17585 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-21T14:29:26.830 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101233 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-21T14:29:26.830 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9337 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-21T14:29:26.831 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-21T14:29:26.831 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-21T14:29:26.831 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-21T14:29:26.831 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/powr1220.ko 2024-05-21T14:29:26.831 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25433 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/sch5627.ko 2024-05-21T14:29:26.831 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/sch5636.ko 2024-05-21T14:29:26.831 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34561 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-21T14:29:26.831 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40849 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/sht15.ko 2024-05-21T14:29:26.831 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15977 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/sht21.ko 2024-05-21T14:29:26.832 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19337 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/shtc1.ko 2024-05-21T14:29:26.832 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48713 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/sis5595.ko 2024-05-21T14:29:26.832 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/smsc47b397.ko 2024-05-21T14:29:26.832 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46473 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/smsc47m1.ko 2024-05-21T14:29:26.832 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/smsc47m192.ko 2024-05-21T14:29:26.832 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/thmc50.ko 2024-05-21T14:29:26.832 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20089 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/tmp102.ko 2024-05-21T14:29:26.832 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/tmp103.ko 2024-05-21T14:29:26.832 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/tmp401.ko 2024-05-21T14:29:26.832 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23097 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/tmp421.ko 2024-05-21T14:29:26.832 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23033 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/via-cputemp.ko 2024-05-21T14:29:26.832 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50217 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/via686a.ko 2024-05-21T14:29:26.832 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/vt1211.ko 2024-05-21T14:29:26.833 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62737 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/vt8231.ko 2024-05-21T14:29:26.833 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71169 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/w83627ehf.ko 2024-05-21T14:29:26.833 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 96577 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/w83627hf.ko 2024-05-21T14:29:26.833 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/w83781d.ko 2024-05-21T14:29:26.833 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75129 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/w83791d.ko 2024-05-21T14:29:26.833 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83425 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/w83792d.ko 2024-05-21T14:29:26.833 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 116777 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/w83793.ko 2024-05-21T14:29:26.833 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 134441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/w83795.ko 2024-05-21T14:29:26.833 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20121 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/w83l785ts.ko 2024-05-21T14:29:26.833 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43385 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/w83l786ng.ko 2024-05-21T14:29:26.833 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15481 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-05-21T14:29:26.833 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12001 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-05-21T14:29:26.834 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/ 2024-05-21T14:29:26.834 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/algos/ 2024-05-21T14:29:26.834 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-21T14:29:26.834 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25273 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-21T14:29:26.834 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/ 2024-05-21T14:29:26.834 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-05-21T14:29:26.834 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-05-21T14:29:26.834 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-05-21T14:29:26.834 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21369 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-21T14:29:26.834 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30361 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-21T14:29:26.834 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-21T14:29:26.834 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17737 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-05-21T14:29:26.834 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7729 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-21T14:29:26.834 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15841 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-05-21T14:29:26.835 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64233 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-21T14:29:26.835 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28161 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-21T14:29:26.835 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24233 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-21T14:29:26.835 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-21T14:29:26.835 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-05-21T14:29:26.835 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-05-21T14:29:26.835 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 76969 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-21T14:29:26.835 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-21T14:29:26.835 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52937 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-21T14:29:26.835 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-05-21T14:29:26.835 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21305 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-21T14:29:26.835 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-21T14:29:26.835 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-05-21T14:29:26.836 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-21T14:29:26.836 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20057 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-21T14:29:26.836 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57217 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-21T14:29:26.836 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-05-21T14:29:26.836 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21145 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-21T14:29:26.836 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-21T14:29:26.836 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24713 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-05-21T14:29:26.836 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32585 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-05-21T14:29:26.836 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22609 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-21T14:29:26.836 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22825 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-05-21T14:29:26.836 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22649 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-21T14:29:26.836 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-21T14:29:26.836 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-21T14:29:26.836 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21793 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-21T14:29:26.837 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59193 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-05-21T14:29:26.837 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27849 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/i2c-mux.ko 2024-05-21T14:29:26.837 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/i2c-smbus.ko 2024-05-21T14:29:26.837 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29577 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/i2c-stub.ko 2024-05-21T14:29:26.837 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/muxes/ 2024-05-21T14:29:26.837 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17649 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-05-21T14:29:26.837 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16001 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-05-21T14:29:26.837 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36569 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-05-21T14:29:26.837 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/ 2024-05-21T14:29:26.837 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/core/ 2024-05-21T14:29:26.837 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 329697 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-21T14:29:26.837 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1119913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/core/ib_core.ko 2024-05-21T14:29:26.837 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-21T14:29:26.837 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 408433 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-21T14:29:26.837 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 120921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-21T14:29:26.838 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 347217 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-21T14:29:26.838 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 84945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-21T14:29:26.838 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/hw/ 2024-05-21T14:29:26.838 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/hw/cxgb4/ 2024-05-21T14:29:26.838 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 590929 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-21T14:29:26.838 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/hw/mlx4/ 2024-05-21T14:29:26.838 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 514641 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-21T14:29:26.838 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/hw/mlx5/ 2024-05-21T14:29:26.838 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 911665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-21T14:29:26.838 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/hw/mthca/ 2024-05-21T14:29:26.838 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 375545 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-21T14:29:26.838 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/hw/ocrdma/ 2024-05-21T14:29:26.838 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 197121 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-05-21T14:29:26.839 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/hw/usnic/ 2024-05-21T14:29:26.839 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 212553 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-05-21T14:29:26.839 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/ulp/ 2024-05-21T14:29:26.839 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/ulp/ipoib/ 2024-05-21T14:29:26.839 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 334401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-21T14:29:26.839 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/ulp/iser/ 2024-05-21T14:29:26.839 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 120673 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-21T14:29:26.839 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/ulp/isert/ 2024-05-21T14:29:26.839 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 132585 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-21T14:29:26.839 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/ulp/srp/ 2024-05-21T14:29:26.839 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 157937 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-21T14:29:26.839 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/ulp/srpt/ 2024-05-21T14:29:26.839 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 156673 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-21T14:29:26.839 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/ 2024-05-21T14:29:26.840 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12201 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/evbug.ko 2024-05-21T14:29:26.840 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27609 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/ff-memless.ko 2024-05-21T14:29:26.840 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/gameport/ 2024-05-21T14:29:26.840 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-21T14:29:26.840 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13985 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-21T14:29:26.840 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50713 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/gameport/gameport.ko 2024-05-21T14:29:26.840 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/joydev.ko 2024-05-21T14:29:26.840 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/ 2024-05-21T14:29:26.840 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15537 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-05-21T14:29:26.840 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14753 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-05-21T14:29:26.840 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-05-21T14:29:26.840 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28305 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-05-21T14:29:26.841 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45473 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-21T14:29:26.841 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-05-21T14:29:26.841 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/lkkbd.ko 2024-05-21T14:29:26.841 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/lm8323.ko 2024-05-21T14:29:26.841 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16761 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/lm8333.ko 2024-05-21T14:29:26.841 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25825 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-05-21T14:29:26.841 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21465 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-05-21T14:29:26.841 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-05-21T14:29:26.841 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19121 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-05-21T14:29:26.841 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13281 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/newtonkbd.ko 2024-05-21T14:29:26.841 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12233 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-05-21T14:29:26.842 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/qt1070.ko 2024-05-21T14:29:26.842 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21561 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/qt2160.ko 2024-05-21T14:29:26.842 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-05-21T14:29:26.842 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13121 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/stowaway.ko 2024-05-21T14:29:26.842 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22337 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/sunkbd.ko 2024-05-21T14:29:26.842 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20649 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-05-21T14:29:26.842 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-05-21T14:29:26.843 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19569 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-05-21T14:29:26.843 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/keyboard/xtkbd.ko 2024-05-21T14:29:26.843 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13137 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/matrix-keymap.ko 2024-05-21T14:29:26.843 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/mouse/ 2024-05-21T14:29:26.843 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/mouse/appletouch.ko 2024-05-21T14:29:26.843 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39553 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/mouse/bcm5974.ko 2024-05-21T14:29:26.843 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 160017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/mouse/cyapatp.ko 2024-05-21T14:29:26.844 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 114273 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-21T14:29:26.844 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15985 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/mouse/gpio_mouse.ko 2024-05-21T14:29:26.844 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 428185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/mouse/psmouse.ko 2024-05-21T14:29:26.844 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16937 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/mouse/sermouse.ko 2024-05-21T14:29:26.844 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-21T14:29:26.844 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27193 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-21T14:29:26.845 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18809 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-21T14:29:26.845 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/rmi4/ 2024-05-21T14:29:26.845 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 140969 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-21T14:29:26.845 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/serio/ 2024-05-21T14:29:26.845 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/serio/altera_ps2.ko 2024-05-21T14:29:26.845 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/serio/arc_ps2.ko 2024-05-21T14:29:26.846 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20385 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/serio/ct82c710.ko 2024-05-21T14:29:26.846 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-21T14:29:26.846 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18393 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/serio/parkbd.ko 2024-05-21T14:29:26.846 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15537 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/serio/pcips2.ko 2024-05-21T14:29:26.846 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23777 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/serio/ps2mult.ko 2024-05-21T14:29:26.846 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/serio/serio_raw.ko 2024-05-21T14:29:26.847 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/serio/serport.ko 2024-05-21T14:29:26.847 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16321 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/input/sparse-keymap.ko 2024-05-21T14:29:26.847 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/ 2024-05-21T14:29:26.847 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15737 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-88pm860x.ko 2024-05-21T14:29:26.847 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13161 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-adp5520.ko 2024-05-21T14:29:26.847 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77265 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-bd2802.ko 2024-05-21T14:29:26.848 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31097 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-blinkm.ko 2024-05-21T14:29:26.848 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11897 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-da903x.ko 2024-05-21T14:29:26.848 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14729 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-da9052.ko 2024-05-21T14:29:26.848 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-gpio.ko 2024-05-21T14:29:26.848 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-lm3530.ko 2024-05-21T14:29:26.848 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-lm3533.ko 2024-05-21T14:29:26.849 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-lm355x.ko 2024-05-21T14:29:26.849 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-lm3642.ko 2024-05-21T14:29:26.849 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18769 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-lp3944.ko 2024-05-21T14:29:26.849 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12809 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-lp8788.ko 2024-05-21T14:29:26.849 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18041 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-max8997.ko 2024-05-21T14:29:26.849 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-mc13783.ko 2024-05-21T14:29:26.850 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-menf21bmc.ko 2024-05-21T14:29:26.850 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-pca9532.ko 2024-05-21T14:29:26.850 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23809 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-pca955x.ko 2024-05-21T14:29:26.850 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21817 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-pca963x.ko 2024-05-21T14:29:26.850 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-ss4200.ko 2024-05-21T14:29:26.851 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28337 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-tca6507.ko 2024-05-21T14:29:26.851 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-wm831x-status.ko 2024-05-21T14:29:26.851 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13633 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/leds-wm8350.ko 2024-05-21T14:29:26.851 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/trigger/ 2024-05-21T14:29:26.851 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11761 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-21T14:29:26.851 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12649 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-21T14:29:26.852 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10233 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-21T14:29:26.852 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8641 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-21T14:29:26.852 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-21T14:29:26.852 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16601 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-21T14:29:26.852 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16769 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-21T14:29:26.853 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-21T14:29:26.853 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16713 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-21T14:29:26.853 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/ 2024-05-21T14:29:26.853 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/bcache/ 2024-05-21T14:29:26.853 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 790753 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/bcache/bcache.ko 2024-05-21T14:29:26.853 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49081 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-bio-prison.ko 2024-05-21T14:29:26.854 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 116825 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-bufio.ko 2024-05-21T14:29:26.854 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58281 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-cache-smq.ko 2024-05-21T14:29:26.854 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 199041 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-cache.ko 2024-05-21T14:29:26.854 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 134945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-crypt.ko 2024-05-21T14:29:26.854 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28897 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-delay.ko 2024-05-21T14:29:26.855 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67497 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-era.ko 2024-05-21T14:29:26.855 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-flakey.ko 2024-05-21T14:29:26.855 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-log-userspace.ko 2024-05-21T14:29:26.855 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41145 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-log.ko 2024-05-21T14:29:26.855 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60977 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-mirror.ko 2024-05-21T14:29:26.855 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-multipath.ko 2024-05-21T14:29:26.856 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19809 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-queue-length.ko 2024-05-21T14:29:26.856 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-raid.ko 2024-05-21T14:29:26.856 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-region-hash.ko 2024-05-21T14:29:26.856 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-round-robin.ko 2024-05-21T14:29:26.856 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20097 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-service-time.ko 2024-05-21T14:29:26.857 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 139817 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-snapshot.ko 2024-05-21T14:29:26.857 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-switch.ko 2024-05-21T14:29:26.857 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 234457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-thin-pool.ko 2024-05-21T14:29:26.857 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66425 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-verity.ko 2024-05-21T14:29:26.857 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9985 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/dm-zero.ko 2024-05-21T14:29:26.857 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/persistent-data/ 2024-05-21T14:29:26.858 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 264329 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-21T14:29:26.858 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43137 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/raid0.ko 2024-05-21T14:29:26.858 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125009 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/raid1.ko 2024-05-21T14:29:26.858 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 157681 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/raid10.ko 2024-05-21T14:29:26.858 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 444665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/md/raid456.ko 2024-05-21T14:29:26.859 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/message/ 2024-05-21T14:29:26.859 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/message/fusion/ 2024-05-21T14:29:26.859 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 214841 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/message/fusion/mptbase.ko 2024-05-21T14:29:26.859 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77985 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/message/fusion/mptctl.ko 2024-05-21T14:29:26.859 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54785 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/message/fusion/mptfc.ko 2024-05-21T14:29:26.860 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44633 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/message/fusion/mptlan.ko 2024-05-21T14:29:26.860 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 150761 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/message/fusion/mptsas.ko 2024-05-21T14:29:26.860 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97281 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/message/fusion/mptscsih.ko 2024-05-21T14:29:26.860 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/message/fusion/mptspi.ko 2024-05-21T14:29:26.860 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/ 2024-05-21T14:29:26.860 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19977 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/88pm800.ko 2024-05-21T14:29:26.861 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/88pm805.ko 2024-05-21T14:29:26.861 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/88pm80x.ko 2024-05-21T14:29:26.861 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/arizona-i2c.ko 2024-05-21T14:29:26.861 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 148633 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/arizona.ko 2024-05-21T14:29:26.861 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13281 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/bcm590xx.ko 2024-05-21T14:29:26.861 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/cros_ec_dev.ko 2024-05-21T14:29:26.862 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41009 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/dln2.ko 2024-05-21T14:29:26.862 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18601 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/janz-cmodio.ko 2024-05-21T14:29:26.862 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59089 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/kempld-core.ko 2024-05-21T14:29:26.862 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31897 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/lm3533-core.ko 2024-05-21T14:29:26.862 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17889 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-05-21T14:29:26.863 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14633 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/lp3943.ko 2024-05-21T14:29:26.863 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60497 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/lpc_ich.ko 2024-05-21T14:29:26.863 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/lpc_sch.ko 2024-05-21T14:29:26.863 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/max8907.ko 2024-05-21T14:29:26.863 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35537 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/mc13xxx-core.ko 2024-05-21T14:29:26.864 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12937 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-05-21T14:29:26.864 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/menf21bmc.ko 2024-05-21T14:29:26.864 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20281 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/pcf50633-adc.ko 2024-05-21T14:29:26.864 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10449 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/pcf50633-gpio.ko 2024-05-21T14:29:26.864 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42297 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/pcf50633.ko 2024-05-21T14:29:26.865 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-05-21T14:29:26.865 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/retu-mfd.ko 2024-05-21T14:29:26.865 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 99425 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/si476x-core.ko 2024-05-21T14:29:26.865 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58057 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/sm501.ko 2024-05-21T14:29:26.865 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60681 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/tps65010.ko 2024-05-21T14:29:26.865 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11785 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/tps6507x.ko 2024-05-21T14:29:26.866 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/viperboard.ko 2024-05-21T14:29:26.866 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/vx855.ko 2024-05-21T14:29:26.866 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21137 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/wl1273-core.ko 2024-05-21T14:29:26.866 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52361 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/mfd/wm8994.ko 2024-05-21T14:29:26.866 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/ 2024-05-21T14:29:26.867 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-05-21T14:29:26.867 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64265 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/ad525x_dpot.ko 2024-05-21T14:29:26.867 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/altera-stapl/ 2024-05-21T14:29:26.867 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57521 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-21T14:29:26.867 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22201 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/apds9802als.ko 2024-05-21T14:29:26.868 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/apds990x.ko 2024-05-21T14:29:26.868 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58633 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/bh1770glc.ko 2024-05-21T14:29:26.868 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/c2port/ 2024-05-21T14:29:26.868 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12825 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-05-21T14:29:26.868 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47449 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/c2port/core.ko 2024-05-21T14:29:26.868 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/cb710/ 2024-05-21T14:29:26.869 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/cb710/cb710.ko 2024-05-21T14:29:26.869 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/ds1682.ko 2024-05-21T14:29:26.869 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10153 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/dummy-irq.ko 2024-05-21T14:29:26.869 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/echo/ 2024-05-21T14:29:26.869 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/echo/echo.ko 2024-05-21T14:29:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/eeprom/ 2024-05-21T14:29:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43041 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/eeprom/at24.ko 2024-05-21T14:29:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18777 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-21T14:29:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15609 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/eeprom/max6875.ko 2024-05-21T14:29:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/enclosure.ko 2024-05-21T14:29:26.871 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/genwqe/ 2024-05-21T14:29:26.871 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 191649 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-05-21T14:29:26.871 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16537 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/hmc6352.ko 2024-05-21T14:29:26.871 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37761 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/hpilo.ko 2024-05-21T14:29:26.871 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/ibmasm/ 2024-05-21T14:29:26.871 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 92345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-05-21T14:29:26.872 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/ics932s401.ko 2024-05-21T14:29:26.872 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26737 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/isl29003.ko 2024-05-21T14:29:26.872 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/isl29020.ko 2024-05-21T14:29:26.872 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/lis3lv02d/ 2024-05-21T14:29:26.872 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-21T14:29:26.872 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17825 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-21T14:29:26.873 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/mei/ 2024-05-21T14:29:26.873 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 154169 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/mei/mei-me.ko 2024-05-21T14:29:26.873 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69809 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/mei/mei-txe.ko 2024-05-21T14:29:26.873 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 389033 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/mei/mei.ko 2024-05-21T14:29:26.873 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/phantom.ko 2024-05-21T14:29:26.873 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/ti-st/ 2024-05-21T14:29:26.873 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 91145 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/ti-st/st_drv.ko 2024-05-21T14:29:26.874 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/tifm_7xx1.ko 2024-05-21T14:29:26.874 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/tifm_core.ko 2024-05-21T14:29:26.874 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22233 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/tsl2550.ko 2024-05-21T14:29:26.874 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55793 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/vmw_balloon.ko 2024-05-21T14:29:26.874 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/vmw_vmci/ 2024-05-21T14:29:26.874 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 234905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-21T14:29:26.874 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ 2024-05-21T14:29:26.874 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/bonding/ 2024-05-21T14:29:26.874 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 620961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/bonding/bonding.ko 2024-05-21T14:29:26.874 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/dsa/ 2024-05-21T14:29:26.874 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/dsa/b53/ 2024-05-21T14:29:26.874 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 139817 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-21T14:29:26.874 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49545 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-21T14:29:26.875 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-21T14:29:26.875 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/dsa/mv88e6xxx/ 2024-05-21T14:29:26.875 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 587065 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-21T14:29:26.875 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19553 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/dummy.ko 2024-05-21T14:29:26.875 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21369 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/eql.ko 2024-05-21T14:29:26.875 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/ 2024-05-21T14:29:26.875 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/3com/ 2024-05-21T14:29:26.875 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53753 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-21T14:29:26.875 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49201 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-21T14:29:26.875 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 158649 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-21T14:29:26.875 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-21T14:29:26.875 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/8390/ 2024-05-21T14:29:26.876 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44161 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-21T14:29:26.876 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-21T14:29:26.876 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-21T14:29:26.876 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 109521 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-21T14:29:26.876 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/adaptec/ 2024-05-21T14:29:26.876 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-21T14:29:26.876 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/agere/ 2024-05-21T14:29:26.876 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 84329 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-21T14:29:26.876 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/alteon/ 2024-05-21T14:29:26.876 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70737 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-21T14:29:26.876 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/altera/ 2024-05-21T14:29:26.877 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-21T14:29:26.877 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/amd/ 2024-05-21T14:29:26.877 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-21T14:29:26.877 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56057 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-21T14:29:26.877 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 115881 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-21T14:29:26.877 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/atheros/ 2024-05-21T14:29:26.877 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/atheros/alx/ 2024-05-21T14:29:26.877 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 124497 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-21T14:29:26.877 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-05-21T14:29:26.877 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 128409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-21T14:29:26.877 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-05-21T14:29:26.877 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 110345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-21T14:29:26.877 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/atheros/atlx/ 2024-05-21T14:29:26.878 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-21T14:29:26.878 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 88953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-21T14:29:26.878 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/broadcom/ 2024-05-21T14:29:26.878 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 105633 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-21T14:29:26.878 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 228985 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-21T14:29:26.878 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-05-21T14:29:26.878 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1733353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-21T14:29:26.950 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 167185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-21T14:29:26.950 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/broadcom/genet/ 2024-05-21T14:29:26.951 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 161417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-21T14:29:26.951 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 440625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-21T14:29:26.951 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/brocade/ 2024-05-21T14:29:26.951 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/brocade/bna/ 2024-05-21T14:29:26.951 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 432201 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-21T14:29:26.951 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/chelsio/ 2024-05-21T14:29:26.951 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-05-21T14:29:26.951 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 257201 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-21T14:29:26.951 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-05-21T14:29:26.951 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 446177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-21T14:29:26.951 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-05-21T14:29:26.951 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1311433 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-21T14:29:26.951 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-05-21T14:29:26.952 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 206689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-21T14:29:26.952 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-05-21T14:29:26.952 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40161 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-21T14:29:26.952 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/cisco/ 2024-05-21T14:29:26.952 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/cisco/enic/ 2024-05-21T14:29:26.952 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 269313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-21T14:29:26.952 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/dec/ 2024-05-21T14:29:26.952 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/dec/tulip/ 2024-05-21T14:29:26.952 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85385 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-21T14:29:26.952 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-21T14:29:26.952 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 169089 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-21T14:29:26.952 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-21T14:29:26.952 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 76209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-21T14:29:26.953 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38065 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-21T14:29:26.953 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/dlink/ 2024-05-21T14:29:26.953 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-21T14:29:26.953 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-21T14:29:26.953 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/dnet.ko 2024-05-21T14:29:26.953 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/ec_bhf.ko 2024-05-21T14:29:26.953 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/emulex/ 2024-05-21T14:29:26.953 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/emulex/benet/ 2024-05-21T14:29:26.953 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 356377 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-21T14:29:26.953 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61737 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/ethoc.ko 2024-05-21T14:29:26.953 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/fealnx.ko 2024-05-21T14:29:26.953 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/fujitsu/ 2024-05-21T14:29:26.954 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-05-21T14:29:26.954 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/ 2024-05-21T14:29:26.954 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 115569 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-21T14:29:26.954 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/e1000/ 2024-05-21T14:29:26.954 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 366217 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-21T14:29:26.954 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/e1000e/ 2024-05-21T14:29:26.954 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 755793 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-21T14:29:26.954 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/fm10k/ 2024-05-21T14:29:26.954 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 324577 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-21T14:29:26.954 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/i40e/ 2024-05-21T14:29:26.955 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1196297 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-21T14:29:26.955 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/iavf/ 2024-05-21T14:29:26.955 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 362593 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-21T14:29:26.955 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/igb/ 2024-05-21T14:29:26.955 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 671801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-21T14:29:26.955 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/igbvf/ 2024-05-21T14:29:26.955 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 121537 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-21T14:29:26.955 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-05-21T14:29:26.955 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 966705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-21T14:29:26.955 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-05-21T14:29:26.955 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 193585 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-21T14:29:26.955 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108633 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/jme.ko 2024-05-21T14:29:26.955 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/marvell/ 2024-05-21T14:29:26.956 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25697 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-21T14:29:26.956 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 126881 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-21T14:29:26.956 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 150777 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-21T14:29:26.956 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/mellanox/ 2024-05-21T14:29:26.956 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-05-21T14:29:26.956 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 905033 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-21T14:29:26.956 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 344145 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-21T14:29:26.956 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-05-21T14:29:26.956 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-05-21T14:29:26.956 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1412417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-21T14:29:26.956 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/micrel/ 2024-05-21T14:29:26.956 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-05-21T14:29:26.956 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54497 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-05-21T14:29:26.956 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-05-21T14:29:26.957 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 117353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-21T14:29:26.957 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/myricom/ 2024-05-21T14:29:26.957 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-05-21T14:29:26.957 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 131425 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-21T14:29:26.957 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/natsemi/ 2024-05-21T14:29:26.957 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 91465 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-21T14:29:26.957 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-21T14:29:26.957 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/neterion/ 2024-05-21T14:29:26.957 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 181081 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-21T14:29:26.957 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/nvidia/ 2024-05-21T14:29:26.957 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 171417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-21T14:29:26.957 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/packetengines/ 2024-05-21T14:29:26.957 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58249 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-21T14:29:26.958 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50121 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-21T14:29:26.958 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/qlogic/ 2024-05-21T14:29:26.958 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-05-21T14:29:26.958 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 300817 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-21T14:29:26.958 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 105689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-21T14:29:26.958 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-05-21T14:29:26.958 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 885129 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-21T14:29:26.958 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/rdc/ 2024-05-21T14:29:26.958 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52305 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-21T14:29:26.958 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/realtek/ 2024-05-21T14:29:26.958 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81641 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-21T14:29:26.958 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-21T14:29:26.958 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-21T14:29:26.958 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 264161 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-21T14:29:26.959 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/samsung/ 2024-05-21T14:29:26.959 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-05-21T14:29:26.959 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 142449 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-05-21T14:29:26.959 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/sfc/ 2024-05-21T14:29:26.959 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1350385 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-21T14:29:26.959 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/silan/ 2024-05-21T14:29:26.959 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-21T14:29:26.959 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/sis/ 2024-05-21T14:29:26.959 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66505 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-21T14:29:26.959 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80065 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-21T14:29:26.959 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/smsc/ 2024-05-21T14:29:26.959 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-21T14:29:26.959 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 79457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-21T14:29:26.960 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100785 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-21T14:29:26.960 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-21T14:29:26.960 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/stmicro/ 2024-05-21T14:29:26.960 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-05-21T14:29:26.960 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14225 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-05-21T14:29:26.960 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46985 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-21T14:29:26.960 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-05-21T14:29:26.960 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 644537 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-21T14:29:26.960 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/sun/ 2024-05-21T14:29:26.960 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 128497 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-21T14:29:26.960 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 207993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-21T14:29:26.960 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82633 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-21T14:29:26.960 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 91353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-21T14:29:26.960 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/tehuti/ 2024-05-21T14:29:26.961 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-21T14:29:26.961 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/ti/ 2024-05-21T14:29:26.961 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 110729 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-21T14:29:26.961 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/via/ 2024-05-21T14:29:26.961 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 98689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-21T14:29:26.961 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-21T14:29:26.961 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/wiznet/ 2024-05-21T14:29:26.961 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61497 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-21T14:29:26.961 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40609 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-21T14:29:26.961 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/xircom/ 2024-05-21T14:29:26.961 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-21T14:29:26.961 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/fddi/ 2024-05-21T14:29:26.961 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49449 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/fddi/defxx.ko 2024-05-21T14:29:26.961 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/fddi/skfp/ 2024-05-21T14:29:26.962 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 275801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/fddi/skfp/skfp.ko 2024-05-21T14:29:26.962 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 91105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/geneve.ko 2024-05-21T14:29:26.962 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/hyperv/ 2024-05-21T14:29:26.962 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 290441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-21T14:29:26.962 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ieee802154/ 2024-05-21T14:29:26.962 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-21T14:29:26.962 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30001 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ifb.ko 2024-05-21T14:29:26.962 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ipvlan/ 2024-05-21T14:29:26.962 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108329 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-21T14:29:26.962 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78065 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/macvlan.ko 2024-05-21T14:29:26.962 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19273 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/macvtap.ko 2024-05-21T14:29:26.962 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/mdio/ 2024-05-21T14:29:26.962 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-21T14:29:26.963 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-21T14:29:26.963 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15697 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/mdio/mdio-gpio.ko 2024-05-21T14:29:26.963 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10025 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-21T14:29:26.963 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/mdio.ko 2024-05-21T14:29:26.963 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/mii.ko 2024-05-21T14:29:26.963 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62681 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/netconsole.ko 2024-05-21T14:29:26.963 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13145 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/nlmon.ko 2024-05-21T14:29:26.963 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/pcs/ 2024-05-21T14:29:26.963 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20585 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-21T14:29:26.963 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-21T14:29:26.963 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/ 2024-05-21T14:29:26.963 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12025 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/amd.ko 2024-05-21T14:29:26.963 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61985 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-21T14:29:26.963 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-21T14:29:26.964 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14281 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/bcm87xx.ko 2024-05-21T14:29:26.964 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/broadcom.ko 2024-05-21T14:29:26.964 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/cicada.ko 2024-05-21T14:29:26.964 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15065 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/davicom.ko 2024-05-21T14:29:26.964 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10753 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/et1011c.ko 2024-05-21T14:29:26.964 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/icplus.ko 2024-05-21T14:29:26.964 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/lxt.ko 2024-05-21T14:29:26.964 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103377 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/marvell.ko 2024-05-21T14:29:26.964 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 96025 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/micrel.ko 2024-05-21T14:29:26.964 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/national.ko 2024-05-21T14:29:26.964 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 121105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/phylink.ko 2024-05-21T14:29:26.964 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/qsemi.ko 2024-05-21T14:29:26.964 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/realtek.ko 2024-05-21T14:29:26.965 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/smsc.ko 2024-05-21T14:29:26.965 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12681 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/ste10Xp.ko 2024-05-21T14:29:26.965 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29217 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/phy/vitesse.ko 2024-05-21T14:29:26.965 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/plip/ 2024-05-21T14:29:26.965 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/plip/plip.ko 2024-05-21T14:29:26.965 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ppp/ 2024-05-21T14:29:26.965 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19361 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-21T14:29:26.965 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36273 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ppp/ppp_async.ko 2024-05-21T14:29:26.965 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21529 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-21T14:29:26.965 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-21T14:29:26.966 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35369 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-21T14:29:26.966 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53233 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ppp/pppoe.ko 2024-05-21T14:29:26.966 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ppp/pppox.ko 2024-05-21T14:29:26.966 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40081 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/ppp/pptp.ko 2024-05-21T14:29:26.966 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35937 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/sb1000.ko 2024-05-21T14:29:26.966 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/slip/ 2024-05-21T14:29:26.966 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/slip/slip.ko 2024-05-21T14:29:26.966 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/sungem_phy.ko 2024-05-21T14:29:26.966 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80161 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/tap.ko 2024-05-21T14:29:26.966 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/team/ 2024-05-21T14:29:26.966 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 137321 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/team/team.ko 2024-05-21T14:29:26.966 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16033 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-21T14:29:26.966 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-21T14:29:26.967 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-21T14:29:26.967 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10841 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/team/team_mode_random.ko 2024-05-21T14:29:26.967 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10473 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-21T14:29:26.967 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108089 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/veth.ko 2024-05-21T14:29:26.967 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/vmxnet3/ 2024-05-21T14:29:26.967 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 176497 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-21T14:29:26.967 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/vxlan/ 2024-05-21T14:29:26.967 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 383593 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/vxlan/vxlan.ko 2024-05-21T14:29:26.967 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/xen-netback/ 2024-05-21T14:29:26.967 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 175537 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-21T14:29:26.967 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ntb/ 2024-05-21T14:29:26.967 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25489 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ntb/ntb.ko 2024-05-21T14:29:26.967 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/nvme/ 2024-05-21T14:29:26.967 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/nvme/host/ 2024-05-21T14:29:26.967 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 335857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/nvme/host/nvme-core.ko 2024-05-21T14:29:26.967 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 126553 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/nvme/host/nvme.ko 2024-05-21T14:29:26.968 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/parport/ 2024-05-21T14:29:26.968 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 168145 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/parport/parport.ko 2024-05-21T14:29:26.968 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/parport/parport_cs.ko 2024-05-21T14:29:26.968 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103889 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/parport/parport_pc.ko 2024-05-21T14:29:26.968 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/parport/parport_serial.ko 2024-05-21T14:29:26.968 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pci/ 2024-05-21T14:29:26.968 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pci/hotplug/ 2024-05-21T14:29:26.968 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28489 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-21T14:29:26.968 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20201 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-05-21T14:29:26.968 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23889 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-05-21T14:29:26.968 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13089 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pci/pci-stub.ko 2024-05-21T14:29:26.968 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55329 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pci/xen-pcifront.ko 2024-05-21T14:29:26.968 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pcmcia/ 2024-05-21T14:29:26.968 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31529 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pcmcia/i82092.ko 2024-05-21T14:29:26.969 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 179961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pcmcia/pcmcia.ko 2024-05-21T14:29:26.969 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78161 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pcmcia/pcmcia_core.ko 2024-05-21T14:29:26.969 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-05-21T14:29:26.969 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pcmcia/pd6729.ko 2024-05-21T14:29:26.969 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 133753 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-21T14:29:26.969 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/phy/ 2024-05-21T14:29:26.969 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/phy/broadcom/ 2024-05-21T14:29:26.969 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12425 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-05-21T14:29:26.969 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/phy/samsung/ 2024-05-21T14:29:26.969 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9481 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-05-21T14:29:26.969 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pinctrl/ 2024-05-21T14:29:26.969 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pinctrl/intel/ 2024-05-21T14:29:26.969 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78193 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-21T14:29:26.969 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/ 2024-05-21T14:29:26.969 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/chrome/ 2024-05-21T14:29:26.970 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61041 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-05-21T14:29:26.970 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29657 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/chrome/cros_ec.ko 2024-05-21T14:29:26.970 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25521 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-05-21T14:29:26.970 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30217 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-05-21T14:29:26.970 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-05-21T14:29:26.970 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-05-21T14:29:26.970 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20153 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-05-21T14:29:26.970 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/ 2024-05-21T14:29:26.970 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87481 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-21T14:29:26.971 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/acerhdf.ko 2024-05-21T14:29:26.971 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-21T14:29:26.971 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-21T14:29:26.971 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33321 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-21T14:29:26.971 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 164769 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-21T14:29:26.971 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-21T14:29:26.971 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-21T14:29:26.971 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-21T14:29:26.971 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51881 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-21T14:29:26.971 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25889 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-21T14:29:26.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42761 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/hdaps.ko 2024-05-21T14:29:26.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/ibm_rtl.ko 2024-05-21T14:29:26.972 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/intel/ 2024-05-21T14:29:26.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14193 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-21T14:29:26.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10033 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-05-21T14:29:26.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54001 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/intel_ips.ko 2024-05-21T14:29:26.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-21T14:29:26.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12033 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-21T14:29:26.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43753 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-21T14:29:26.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51897 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-21T14:29:26.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-21T14:29:26.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20169 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-21T14:29:26.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15593 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-21T14:29:26.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20273 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-21T14:29:26.973 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11657 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-21T14:29:26.973 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/platform/x86/wmi.ko 2024-05-21T14:29:26.973 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/ 2024-05-21T14:29:26.973 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/ 2024-05-21T14:29:26.973 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/88pm860x_battery.ko 2024-05-21T14:29:26.973 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40425 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/88pm860x_charger.ko 2024-05-21T14:29:26.973 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/bq2415x_charger.ko 2024-05-21T14:29:26.973 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/bq24190_charger.ko 2024-05-21T14:29:26.973 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/bq24735-charger.ko 2024-05-21T14:29:26.973 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20241 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-05-21T14:29:26.973 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23233 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/da9030_battery.ko 2024-05-21T14:29:26.973 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23297 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/da9052-battery.ko 2024-05-21T14:29:26.973 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34489 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/ds2760_battery.ko 2024-05-21T14:29:26.974 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28641 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/ds2780_battery.ko 2024-05-21T14:29:26.974 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28809 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/ds2781_battery.ko 2024-05-21T14:29:26.974 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28657 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/ds2782_battery.ko 2024-05-21T14:29:26.974 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24217 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/gpio-charger.ko 2024-05-21T14:29:26.974 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23225 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/isp1704_charger.ko 2024-05-21T14:29:26.974 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24121 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/lp8727_charger.ko 2024-05-21T14:29:26.974 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14009 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/max14577_charger.ko 2024-05-21T14:29:26.974 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/max17042_battery.ko 2024-05-21T14:29:26.974 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/max8903_charger.ko 2024-05-21T14:29:26.974 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/max8925_power.ko 2024-05-21T14:29:26.975 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/pcf50633-charger.ko 2024-05-21T14:29:26.975 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44841 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/sbs-battery.ko 2024-05-21T14:29:26.975 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/test_power.ko 2024-05-21T14:29:26.975 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21585 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/tps65090-charger.ko 2024-05-21T14:29:26.975 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/wm831x_backup.ko 2024-05-21T14:29:26.975 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29081 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/wm831x_power.ko 2024-05-21T14:29:26.975 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/power/supply/wm8350_power.ko 2024-05-21T14:29:26.975 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/powercap/ 2024-05-21T14:29:26.975 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73297 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-21T14:29:26.975 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20433 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-21T14:29:26.976 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pps/ 2024-05-21T14:29:26.976 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pps/clients/ 2024-05-21T14:29:26.976 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-21T14:29:26.976 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15529 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-21T14:29:26.976 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18985 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pps/clients/pps_parport.ko 2024-05-21T14:29:26.976 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49817 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/pps/pps_core.ko 2024-05-21T14:29:26.976 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ptp/ 2024-05-21T14:29:26.976 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 91393 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ptp/ptp.ko 2024-05-21T14:29:26.976 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ptp/ptp_kvm.ko 2024-05-21T14:29:26.976 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ras/ 2024-05-21T14:29:26.976 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ras/amd/ 2024-05-21T14:29:26.976 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ras/amd/atl/ 2024-05-21T14:29:26.977 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-21T14:29:26.977 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47137 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ras/amd/fmpm.ko 2024-05-21T14:29:26.977 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/ 2024-05-21T14:29:26.977 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27593 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-88pm80x.ko 2024-05-21T14:29:26.977 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28969 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-88pm860x.ko 2024-05-21T14:29:26.977 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-21T14:29:26.977 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-da9052.ko 2024-05-21T14:29:26.977 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22569 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-da9055.ko 2024-05-21T14:29:26.977 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24337 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-da9063.ko 2024-05-21T14:29:26.977 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19729 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-21T14:29:26.977 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82225 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-21T14:29:26.977 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24481 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-21T14:29:26.978 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-21T14:29:26.978 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-21T14:29:26.978 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16057 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-21T14:29:26.978 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-21T14:29:26.978 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18025 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-21T14:29:26.978 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-21T14:29:26.978 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-em3027.ko 2024-05-21T14:29:26.978 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-21T14:29:26.978 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24097 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-21T14:29:26.978 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44129 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-21T14:29:26.978 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17145 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-lp8788.ko 2024-05-21T14:29:26.978 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-21T14:29:26.979 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-21T14:29:26.979 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33969 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-21T14:29:26.979 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17337 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-m48t86.ko 2024-05-21T14:29:26.979 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13985 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-max6900.ko 2024-05-21T14:29:26.979 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-max8907.ko 2024-05-21T14:29:26.981 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18521 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-max8925.ko 2024-05-21T14:29:26.982 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31337 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-max8997.ko 2024-05-21T14:29:26.982 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20329 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-max8998.ko 2024-05-21T14:29:26.982 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-05-21T14:29:26.982 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13153 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-21T14:29:26.982 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24329 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-palmas.ko 2024-05-21T14:29:26.982 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56777 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-21T14:29:26.982 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21601 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-pcf50633.ko 2024-05-21T14:29:26.982 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32657 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-21T14:29:26.982 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-21T14:29:26.982 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36065 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-21T14:29:26.982 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-21T14:29:26.982 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-rc5t583.ko 2024-05-21T14:29:26.982 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-21T14:29:26.983 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40081 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-21T14:29:26.983 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34529 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-21T14:29:26.983 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29977 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-21T14:29:26.983 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-21T14:29:26.983 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-s35390a.ko 2024-05-21T14:29:26.983 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20425 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-21T14:29:26.983 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21697 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-tps6586x.ko 2024-05-21T14:29:26.983 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-tps65910.ko 2024-05-21T14:29:26.983 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-wm831x.ko 2024-05-21T14:29:26.983 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-wm8350.ko 2024-05-21T14:29:26.983 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/rtc/rtc-x1205.ko 2024-05-21T14:29:26.983 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/ 2024-05-21T14:29:26.983 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90377 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/3w-9xxx.ko 2024-05-21T14:29:26.984 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69593 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/3w-sas.ko 2024-05-21T14:29:26.984 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/3w-xxxx.ko 2024-05-21T14:29:26.984 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 164569 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/BusLogic.ko 2024-05-21T14:29:26.984 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/a100u2w.ko 2024-05-21T14:29:26.984 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/aacraid/ 2024-05-21T14:29:26.984 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 340721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-21T14:29:26.984 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 120337 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/advansys.ko 2024-05-21T14:29:26.984 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/aic7xxx/ 2024-05-21T14:29:26.984 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 468081 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-21T14:29:26.984 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 380673 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-21T14:29:26.985 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/aic94xx/ 2024-05-21T14:29:26.985 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 243705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-05-21T14:29:26.985 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28841 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/am53c974.ko 2024-05-21T14:29:26.985 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/arcmsr/ 2024-05-21T14:29:26.985 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 135617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-21T14:29:26.985 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/atp870u.ko 2024-05-21T14:29:26.985 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/be2iscsi/ 2024-05-21T14:29:26.985 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 304993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-21T14:29:26.985 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/bfa/ 2024-05-21T14:29:26.985 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1527113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/bfa/bfa.ko 2024-05-21T14:29:26.985 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/bnx2fc/ 2024-05-21T14:29:26.985 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 297801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-21T14:29:26.986 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/bnx2i/ 2024-05-21T14:29:26.986 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 144401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-21T14:29:26.986 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/ch.ko 2024-05-21T14:29:26.986 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/csiostor/ 2024-05-21T14:29:26.986 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 390713 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-21T14:29:26.986 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/cxgbi/ 2024-05-21T14:29:26.986 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-05-21T14:29:26.986 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 88881 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-21T14:29:26.986 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-05-21T14:29:26.986 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 117481 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-21T14:29:26.986 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 173017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-21T14:29:26.987 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 91569 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/dc395x.ko 2024-05-21T14:29:26.987 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/dmx3191d.ko 2024-05-21T14:29:26.987 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/esas2r/ 2024-05-21T14:29:26.987 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 267577 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-21T14:29:26.987 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78969 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/esp_scsi.ko 2024-05-21T14:29:26.987 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/fcoe/ 2024-05-21T14:29:26.987 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 95329 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-21T14:29:26.987 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 194017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-21T14:29:26.987 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/fdomain.ko 2024-05-21T14:29:26.987 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/fnic/ 2024-05-21T14:29:26.987 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 366529 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/fnic/fnic.ko 2024-05-21T14:29:26.987 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 251505 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/hpsa.ko 2024-05-21T14:29:26.987 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65761 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/hptiop.ko 2024-05-21T14:29:26.988 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57097 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/hv_storvsc.ko 2024-05-21T14:29:26.988 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/imm.ko 2024-05-21T14:29:26.988 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55153 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/initio.ko 2024-05-21T14:29:26.988 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 327841 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/ipr.ko 2024-05-21T14:29:26.988 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 129785 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/ips.ko 2024-05-21T14:29:26.988 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/isci/ 2024-05-21T14:29:26.988 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 397785 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/isci/isci.ko 2024-05-21T14:29:26.988 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-21T14:29:26.988 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63121 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-21T14:29:26.988 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/libfc/ 2024-05-21T14:29:26.988 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 386849 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/libfc/libfc.ko 2024-05-21T14:29:26.989 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 178177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/libiscsi.ko 2024-05-21T14:29:26.989 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64809 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-21T14:29:26.989 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/libsas/ 2024-05-21T14:29:26.989 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 274009 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/libsas/libsas.ko 2024-05-21T14:29:26.989 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/lpfc/ 2024-05-21T14:29:26.989 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2736001 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-21T14:29:26.989 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/megaraid/ 2024-05-21T14:29:26.989 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 88529 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-21T14:29:26.989 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40145 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-21T14:29:26.989 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 389177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-21T14:29:26.989 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 104769 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/megaraid.ko 2024-05-21T14:29:26.990 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/mpt3sas/ 2024-05-21T14:29:26.990 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 836945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-21T14:29:26.990 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/mvsas/ 2024-05-21T14:29:26.990 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 158729 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-21T14:29:26.990 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 96537 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/mvumi.ko 2024-05-21T14:29:26.990 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/pcmcia/ 2024-05-21T14:29:26.990 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-05-21T14:29:26.990 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13273 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-05-21T14:29:26.990 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23153 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-05-21T14:29:26.990 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28265 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-05-21T14:29:26.991 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/pm8001/ 2024-05-21T14:29:26.991 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 443745 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-21T14:29:26.991 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 152033 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/pmcraid.ko 2024-05-21T14:29:26.991 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/ppa.ko 2024-05-21T14:29:26.991 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66977 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/qla1280.ko 2024-05-21T14:29:26.991 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/qla2xxx/ 2024-05-21T14:29:26.991 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2324809 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-21T14:29:26.991 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103601 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-21T14:29:26.991 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/qla4xxx/ 2024-05-21T14:29:26.991 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 697337 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-21T14:29:26.991 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/qlogicfas408.ko 2024-05-21T14:29:26.991 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/raid_class.ko 2024-05-21T14:29:26.991 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 322865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/scsi_debug.ko 2024-05-21T14:29:26.992 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 219857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-21T14:29:26.992 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 357153 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-21T14:29:26.992 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 121185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-21T14:29:26.992 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 93481 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-21T14:29:26.992 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-21T14:29:26.992 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33009 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/ses.ko 2024-05-21T14:29:26.992 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 138121 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/st.ko 2024-05-21T14:29:26.992 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/stex.ko 2024-05-21T14:29:26.992 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/sym53c8xx_2/ 2024-05-21T14:29:26.992 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 205025 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-21T14:29:26.992 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55425 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/virtio_scsi.ko 2024-05-21T14:29:26.993 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-21T14:29:26.993 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48777 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/wd719x.ko 2024-05-21T14:29:26.993 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/scsi/xen-scsifront.ko 2024-05-21T14:29:26.993 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ssb/ 2024-05-21T14:29:26.993 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 174913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ssb/ssb.ko 2024-05-21T14:29:26.993 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/target/ 2024-05-21T14:29:26.993 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/target/iscsi/ 2024-05-21T14:29:26.993 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 920169 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-21T14:29:26.993 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/target/loopback/ 2024-05-21T14:29:26.993 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60321 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-21T14:29:26.993 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48129 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/target/target_core_file.ko 2024-05-21T14:29:26.993 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54233 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/target/target_core_iblock.ko 2024-05-21T14:29:26.994 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1170033 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/target/target_core_mod.ko 2024-05-21T14:29:26.994 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51897 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/target/target_core_pscsi.ko 2024-05-21T14:29:26.994 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 149721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/target/target_core_user.ko 2024-05-21T14:29:26.994 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/target/tcm_fc/ 2024-05-21T14:29:26.994 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90057 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-21T14:29:26.994 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/ 2024-05-21T14:29:26.995 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/ 2024-05-21T14:29:26.995 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/int340x_thermal/ 2024-05-21T14:29:26.995 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28121 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-21T14:29:26.995 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-21T14:29:26.995 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11329 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-21T14:29:26.995 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-21T14:29:26.995 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17385 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-21T14:29:26.995 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-21T14:29:26.995 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36729 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-21T14:29:26.996 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-21T14:29:26.996 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16745 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-21T14:29:26.996 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12929 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-21T14:29:26.996 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12281 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-21T14:29:26.996 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15241 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-21T14:29:26.996 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46065 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-21T14:29:26.996 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17673 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-21T14:29:26.997 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-21T14:29:26.997 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-05-21T14:29:26.997 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-21T14:29:26.997 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12849 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-21T14:29:26.997 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30577 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-21T14:29:26.997 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/ 2024-05-21T14:29:26.997 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/ipwireless/ 2024-05-21T14:29:26.997 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 99313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-21T14:29:26.997 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69729 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/moxa.ko 2024-05-21T14:29:26.997 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61649 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/mxser.ko 2024-05-21T14:29:26.997 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 134401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/n_gsm.ko 2024-05-21T14:29:26.997 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/n_hdlc.ko 2024-05-21T14:29:26.998 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78969 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/nozomi.ko 2024-05-21T14:29:26.998 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/serial/ 2024-05-21T14:29:26.998 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/serial/8250/ 2024-05-21T14:29:26.998 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44057 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-05-21T14:29:26.998 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65121 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-21T14:29:26.998 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23121 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-05-21T14:29:26.998 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28161 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/serial/altera_uart.ko 2024-05-21T14:29:26.998 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10673 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/serial/arc_uart.ko 2024-05-21T14:29:26.998 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 91665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-05-21T14:29:26.998 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/serial/jsm/ 2024-05-21T14:29:26.998 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 120577 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-21T14:29:26.998 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35161 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/serial/rp2.ko 2024-05-21T14:29:26.999 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65641 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/tty/serial/sc16is7xx.ko 2024-05-21T14:29:26.999 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ufs/ 2024-05-21T14:29:26.999 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ufs/core/ 2024-05-21T14:29:26.999 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 693081 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-21T14:29:26.999 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ufs/host/ 2024-05-21T14:29:26.999 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34449 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-21T14:29:26.999 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16697 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-05-21T14:29:26.999 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/uio/ 2024-05-21T14:29:26.999 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/uio/uio.ko 2024-05-21T14:29:26.999 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14305 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/uio/uio_aec.ko 2024-05-21T14:29:26.999 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/uio/uio_cif.ko 2024-05-21T14:29:26.999 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/uio/uio_dmem_genirq.ko 2024-05-21T14:29:26.999 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15633 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/uio/uio_mf624.ko 2024-05-21T14:29:26.999 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/uio/uio_netx.ko 2024-05-21T14:29:27.000 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/uio/uio_pci_generic.ko 2024-05-21T14:29:27.000 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18633 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-05-21T14:29:27.000 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16025 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/uio/uio_sercos3.ko 2024-05-21T14:29:27.000 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/ 2024-05-21T14:29:27.000 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/c67x00/ 2024-05-21T14:29:27.000 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90321 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/c67x00/c67x00.ko 2024-05-21T14:29:27.000 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/chipidea/ 2024-05-21T14:29:27.000 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 189209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-05-21T14:29:27.000 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21529 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-05-21T14:29:27.000 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15121 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-05-21T14:29:27.000 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-05-21T14:29:27.000 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14777 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-05-21T14:29:27.000 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/class/ 2024-05-21T14:29:27.000 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101545 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/class/cdc-acm.ko 2024-05-21T14:29:27.001 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-21T14:29:27.001 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/class/usblp.ko 2024-05-21T14:29:27.001 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 107417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/class/usbtmc.ko 2024-05-21T14:29:27.001 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/common/ 2024-05-21T14:29:27.001 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/common/ulpi.ko 2024-05-21T14:29:27.001 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/dwc2/ 2024-05-21T14:29:27.001 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13097 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-05-21T14:29:27.001 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/dwc3/ 2024-05-21T14:29:27.001 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13529 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-05-21T14:29:27.001 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33465 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-05-21T14:29:27.001 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 574593 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/dwc3/dwc3.ko 2024-05-21T14:29:27.001 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/ 2024-05-21T14:29:27.002 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/ 2024-05-21T14:29:27.002 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72249 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/u_ether.ko 2024-05-21T14:29:27.002 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/u_serial.ko 2024-05-21T14:29:27.002 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-05-21T14:29:27.002 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49737 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-05-21T14:29:27.002 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33041 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-05-21T14:29:27.002 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43553 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-05-21T14:29:27.002 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 131345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-05-21T14:29:27.002 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62321 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-05-21T14:29:27.002 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 146617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-05-21T14:29:27.002 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-05-21T14:29:27.002 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-05-21T14:29:27.002 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37649 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-05-21T14:29:27.003 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-05-21T14:29:27.003 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101249 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-05-21T14:29:27.003 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22425 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-05-21T14:29:27.003 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-05-21T14:29:27.003 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 84937 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-05-21T14:29:27.003 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/legacy/ 2024-05-21T14:29:27.003 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-05-21T14:29:27.003 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20281 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-05-21T14:29:27.003 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-05-21T14:29:27.003 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24497 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-05-21T14:29:27.003 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33041 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-05-21T14:29:27.003 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21609 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-05-21T14:29:27.003 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22385 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-05-21T14:29:27.003 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-05-21T14:29:27.004 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-05-21T14:29:27.004 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18521 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-05-21T14:29:27.004 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-05-21T14:29:27.004 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-05-21T14:29:27.004 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-05-21T14:29:27.004 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17505 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-05-21T14:29:27.004 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 204049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/libcomposite.ko 2024-05-21T14:29:27.004 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/udc/ 2024-05-21T14:29:27.004 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19569 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-05-21T14:29:27.004 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/udc/bdc/ 2024-05-21T14:29:27.004 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 182561 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-05-21T14:29:27.004 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45545 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-05-21T14:29:27.004 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-05-21T14:29:27.005 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85217 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-05-21T14:29:27.005 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-05-21T14:29:27.005 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/udc/net2272.ko 2024-05-21T14:29:27.005 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90361 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/udc/net2280.ko 2024-05-21T14:29:27.005 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 94841 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-05-21T14:29:27.005 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80521 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-05-21T14:29:27.005 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87465 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-05-21T14:29:27.005 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 95441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-05-21T14:29:27.005 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 195969 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-05-21T14:29:27.005 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/host/ 2024-05-21T14:29:27.005 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/host/bcma-hcd.ko 2024-05-21T14:29:27.005 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108321 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/host/isp116x-hcd.ko 2024-05-21T14:29:27.005 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 104377 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-05-21T14:29:27.005 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102273 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-05-21T14:29:27.006 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-21T14:29:27.006 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17505 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/host/sl811_cs.ko 2024-05-21T14:29:27.006 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16377 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/host/ssb-hcd.ko 2024-05-21T14:29:27.006 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32553 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-05-21T14:29:27.006 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/image/ 2024-05-21T14:29:27.006 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/image/mdc800.ko 2024-05-21T14:29:27.006 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/image/microtek.ko 2024-05-21T14:29:27.006 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/ 2024-05-21T14:29:27.006 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/adutux.ko 2024-05-21T14:29:27.006 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23825 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/appledisplay.ko 2024-05-21T14:29:27.007 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-05-21T14:29:27.007 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26673 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/cytherm.ko 2024-05-21T14:29:27.007 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15561 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/ehset.ko 2024-05-21T14:29:27.007 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/emi26.ko 2024-05-21T14:29:27.007 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18881 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/emi62.ko 2024-05-21T14:29:27.007 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13057 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/ezusb.ko 2024-05-21T14:29:27.007 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22241 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/idmouse.ko 2024-05-21T14:29:27.007 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42729 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/iowarrior.ko 2024-05-21T14:29:27.007 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-21T14:29:27.007 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42241 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/ldusb.ko 2024-05-21T14:29:27.007 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42233 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/legousbtower.ko 2024-05-21T14:29:27.007 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33641 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/lvstest.ko 2024-05-21T14:29:27.007 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/sisusbvga/ 2024-05-21T14:29:27.008 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-21T14:29:27.008 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14601 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-21T14:29:27.008 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24593 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/usb3503.ko 2024-05-21T14:29:27.008 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/usblcd.ko 2024-05-21T14:29:27.008 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27809 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-21T14:29:27.008 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 84265 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/usbtest.ko 2024-05-21T14:29:27.008 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52065 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/uss720.ko 2024-05-21T14:29:27.008 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/misc/yurex.ko 2024-05-21T14:29:27.008 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/mon/ 2024-05-21T14:29:27.008 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 91529 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/mon/usbmon.ko 2024-05-21T14:29:27.008 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/musb/ 2024-05-21T14:29:27.008 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 396209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/musb/musb_hdrc.ko 2024-05-21T14:29:27.008 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/phy/ 2024-05-21T14:29:27.009 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25497 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/phy/phy-generic.ko 2024-05-21T14:29:27.009 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23697 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-05-21T14:29:27.009 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/phy/phy-isp1301.ko 2024-05-21T14:29:27.009 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26361 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/phy/phy-tahvo.ko 2024-05-21T14:29:27.009 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/ 2024-05-21T14:29:27.009 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14761 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/aircable.ko 2024-05-21T14:29:27.009 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/ark3116.ko 2024-05-21T14:29:27.009 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30681 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-21T14:29:27.009 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44329 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/ch341.ko 2024-05-21T14:29:27.009 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 79681 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/cp210x.ko 2024-05-21T14:29:27.009 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35137 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/cyberjack.ko 2024-05-21T14:29:27.009 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-21T14:29:27.009 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58329 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-21T14:29:27.009 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/empeg.ko 2024-05-21T14:29:27.009 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53009 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/f81232.ko 2024-05-21T14:29:27.010 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 188609 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-21T14:29:27.010 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61489 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-21T14:29:27.010 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 152305 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-21T14:29:27.010 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 142833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/io_ti.ko 2024-05-21T14:29:27.010 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69217 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/ipaq.ko 2024-05-21T14:29:27.010 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21425 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/ipw.ko 2024-05-21T14:29:27.010 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29769 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/ir-usb.ko 2024-05-21T14:29:27.010 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66361 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-21T14:29:27.010 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122329 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/keyspan.ko 2024-05-21T14:29:27.010 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41297 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-21T14:29:27.010 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29465 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-21T14:29:27.010 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-21T14:29:27.010 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38041 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/mct_u232.ko 2024-05-21T14:29:27.011 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25569 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/metro-usb.ko 2024-05-21T14:29:27.011 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 79681 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/mos7720.ko 2024-05-21T14:29:27.011 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89969 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/mos7840.ko 2024-05-21T14:29:27.011 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/mxuport.ko 2024-05-21T14:29:27.011 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/navman.ko 2024-05-21T14:29:27.011 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13761 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/omninet.ko 2024-05-21T14:29:27.011 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28881 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/opticon.ko 2024-05-21T14:29:27.011 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 193857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/option.ko 2024-05-21T14:29:27.011 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45337 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/oti6858.ko 2024-05-21T14:29:27.011 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61761 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/pl2303.ko 2024-05-21T14:29:27.011 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10321 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/qcaux.ko 2024-05-21T14:29:27.011 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39985 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/qcserial.ko 2024-05-21T14:29:27.011 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40529 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/quatech2.ko 2024-05-21T14:29:27.011 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/safe_serial.ko 2024-05-21T14:29:27.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/sierra.ko 2024-05-21T14:29:27.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25225 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-21T14:29:27.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34065 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/ssu100.ko 2024-05-21T14:29:27.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19601 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/symbolserial.ko 2024-05-21T14:29:27.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70497 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-21T14:29:27.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24297 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-21T14:29:27.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11465 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/usb_debug.ko 2024-05-21T14:29:27.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39321 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-21T14:29:27.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 151137 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/usbserial.ko 2024-05-21T14:29:27.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32505 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/visor.ko 2024-05-21T14:29:27.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43577 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/whiteheat.ko 2024-05-21T14:29:27.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/wishbone-serial.ko 2024-05-21T14:29:27.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-21T14:29:27.013 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/storage/ 2024-05-21T14:29:27.013 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/storage/uas.ko 2024-05-21T14:29:27.013 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-21T14:29:27.013 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14369 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-21T14:29:27.013 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-21T14:29:27.013 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-21T14:29:27.013 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-21T14:29:27.013 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-21T14:29:27.013 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22769 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-21T14:29:27.013 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/storage/ums-karma.ko 2024-05-21T14:29:27.013 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-21T14:29:27.013 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-21T14:29:27.013 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33849 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-21T14:29:27.014 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22577 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-21T14:29:27.014 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41785 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-21T14:29:27.014 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 201193 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/storage/usb-storage.ko 2024-05-21T14:29:27.014 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/usbip/ 2024-05-21T14:29:27.014 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 76041 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-21T14:29:27.014 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-21T14:29:27.014 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122321 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-21T14:29:27.014 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/vfio/ 2024-05-21T14:29:27.014 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/vfio/pci/ 2024-05-21T14:29:27.014 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 206921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-21T14:29:27.014 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33577 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-21T14:29:27.014 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 134265 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/vfio/vfio.ko 2024-05-21T14:29:27.014 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 93673 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-21T14:29:27.015 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/vhost/ 2024-05-21T14:29:27.015 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 138721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/vhost/vhost.ko 2024-05-21T14:29:27.015 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20161 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-21T14:29:27.015 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71281 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/vhost/vhost_net.ko 2024-05-21T14:29:27.015 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 107905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/vhost/vhost_scsi.ko 2024-05-21T14:29:27.015 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/ 2024-05-21T14:29:27.015 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/ 2024-05-21T14:29:27.015 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-05-21T14:29:27.015 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14433 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/aat2870_bl.ko 2024-05-21T14:29:27.015 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29153 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/adp5520_bl.ko 2024-05-21T14:29:27.015 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41169 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/adp8860_bl.ko 2024-05-21T14:29:27.015 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51745 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/adp8870_bl.ko 2024-05-21T14:29:27.015 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20305 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/apple_bl.ko 2024-05-21T14:29:27.015 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19825 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/as3711_bl.ko 2024-05-21T14:29:27.016 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14737 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/bd6107.ko 2024-05-21T14:29:27.016 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13337 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/da903x_bl.ko 2024-05-21T14:29:27.016 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13649 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/da9052_bl.ko 2024-05-21T14:29:27.016 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13785 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/gpio_backlight.ko 2024-05-21T14:29:27.016 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17473 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/kb3886_bl.ko 2024-05-21T14:29:27.016 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/lcd.ko 2024-05-21T14:29:27.016 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/lm3533_bl.ko 2024-05-21T14:29:27.016 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23393 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/lm3639_bl.ko 2024-05-21T14:29:27.016 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/lv5207lp.ko 2024-05-21T14:29:27.016 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/max8925_bl.ko 2024-05-21T14:29:27.016 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13025 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/pandora_bl.ko 2024-05-21T14:29:27.016 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13057 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-05-21T14:29:27.016 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13329 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-21T14:29:27.017 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/video/backlight/wm831x_bl.ko 2024-05-21T14:29:27.017 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/ 2024-05-21T14:29:27.017 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/masters/ 2024-05-21T14:29:27.017 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23033 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/masters/ds2482.ko 2024-05-21T14:29:27.017 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/masters/ds2490.ko 2024-05-21T14:29:27.017 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/masters/matrox_w1.ko 2024-05-21T14:29:27.017 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/masters/w1-gpio.ko 2024-05-21T14:29:27.017 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/slaves/ 2024-05-21T14:29:27.017 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14001 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-21T14:29:27.018 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-21T14:29:27.018 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-21T14:29:27.018 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12121 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-21T14:29:27.018 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16449 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-21T14:29:27.018 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16201 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-21T14:29:27.018 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-21T14:29:27.018 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-21T14:29:27.018 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-21T14:29:27.018 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-21T14:29:27.018 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70369 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-21T14:29:27.018 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 129433 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/w1/wire.ko 2024-05-21T14:29:27.019 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/ 2024-05-21T14:29:27.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22337 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/acquirewdt.ko 2024-05-21T14:29:27.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23825 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/advantechwdt.ko 2024-05-21T14:29:27.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-21T14:29:27.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-21T14:29:27.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21985 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/cpu5wdt.ko 2024-05-21T14:29:27.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16465 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/da9052_wdt.ko 2024-05-21T14:29:27.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/da9055_wdt.ko 2024-05-21T14:29:27.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/da9063_wdt.ko 2024-05-21T14:29:27.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/dw_wdt.ko 2024-05-21T14:29:27.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23521 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/eurotechwdt.ko 2024-05-21T14:29:27.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26817 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-21T14:29:27.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/hpwdt.ko 2024-05-21T14:29:27.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/i6300esb.ko 2024-05-21T14:29:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12673 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-21T14:29:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26737 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-21T14:29:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/ib700wdt.ko 2024-05-21T14:29:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/ibmasr.ko 2024-05-21T14:29:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22713 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-21T14:29:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-21T14:29:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/it87_wdt.ko 2024-05-21T14:29:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/kempld_wdt.ko 2024-05-21T14:29:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21569 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/machzwd.ko 2024-05-21T14:29:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/mena21_wdt.ko 2024-05-21T14:29:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15001 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-05-21T14:29:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29753 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/nv_tco.ko 2024-05-21T14:29:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20569 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-05-21T14:29:27.020 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/pc87413_wdt.ko 2024-05-21T14:29:27.021 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-21T14:29:27.021 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37193 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-21T14:29:27.021 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/retu_wdt.ko 2024-05-21T14:29:27.021 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24433 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-05-21T14:29:27.021 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16985 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-05-21T14:29:27.021 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-21T14:29:27.021 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29169 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/sc1200wdt.ko 2024-05-21T14:29:27.021 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27489 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-21T14:29:27.021 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-05-21T14:29:27.021 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/softdog.ko 2024-05-21T14:29:27.021 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26009 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-21T14:29:27.022 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/twl4030_wdt.ko 2024-05-21T14:29:27.022 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/via_wdt.ko 2024-05-21T14:29:27.022 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23393 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-21T14:29:27.022 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-21T14:29:27.022 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32481 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-21T14:29:27.022 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22577 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/wafer5823wdt.ko 2024-05-21T14:29:27.022 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33465 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/wdt_pci.ko 2024-05-21T14:29:27.022 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/wm831x_wdt.ko 2024-05-21T14:29:27.022 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16081 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/wm8350_wdt.ko 2024-05-21T14:29:27.022 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/watchdog/xen_wdt.ko 2024-05-21T14:29:27.022 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/xen/ 2024-05-21T14:29:27.022 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/xen/xen-evtchn.ko 2024-05-21T14:29:27.023 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30649 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/xen/xen-gntalloc.ko 2024-05-21T14:29:27.023 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55713 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/xen/xen-gntdev.ko 2024-05-21T14:29:27.023 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/xen/xen-pciback/ 2024-05-21T14:29:27.023 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 213913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-21T14:29:27.023 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/xen/xen-privcmd.ko 2024-05-21T14:29:27.023 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85713 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/xen/xen-scsiback.ko 2024-05-21T14:29:27.023 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/xen/xenfs/ 2024-05-21T14:29:27.023 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23433 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-21T14:29:27.023 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/ 2024-05-21T14:29:27.023 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/9p/ 2024-05-21T14:29:27.023 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 192617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/9p/9p.ko 2024-05-21T14:29:27.024 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/adfs/ 2024-05-21T14:29:27.024 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78153 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/adfs/adfs.ko 2024-05-21T14:29:27.024 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/affs/ 2024-05-21T14:29:27.024 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 197849 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/affs/affs.ko 2024-05-21T14:29:27.024 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/afs/ 2024-05-21T14:29:27.024 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1261113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/afs/kafs.ko 2024-05-21T14:29:27.024 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/autofs/ 2024-05-21T14:29:27.024 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 127377 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/autofs/autofs4.ko 2024-05-21T14:29:27.024 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/befs/ 2024-05-21T14:29:27.024 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80521 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/befs/befs.ko 2024-05-21T14:29:27.024 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/bfs/ 2024-05-21T14:29:27.024 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50473 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/bfs/bfs.ko 2024-05-21T14:29:27.024 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45561 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/binfmt_misc.ko 2024-05-21T14:29:27.025 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/btrfs/ 2024-05-21T14:29:27.025 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 4489593 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/btrfs/btrfs.ko 2024-05-21T14:29:27.025 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/cachefiles/ 2024-05-21T14:29:27.025 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 376857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/cachefiles/cachefiles.ko 2024-05-21T14:29:27.025 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/ceph/ 2024-05-21T14:29:27.025 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1587233 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/ceph/ceph.ko 2024-05-21T14:29:27.025 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/coda/ 2024-05-21T14:29:27.025 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 130073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/coda/coda.ko 2024-05-21T14:29:27.025 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/configfs/ 2024-05-21T14:29:27.025 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 139081 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/configfs/configfs.ko 2024-05-21T14:29:27.025 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/cramfs/ 2024-05-21T14:29:27.025 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/cramfs/cramfs.ko 2024-05-21T14:29:27.025 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/dlm/ 2024-05-21T14:29:27.025 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 813225 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/dlm/dlm.ko 2024-05-21T14:29:27.026 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/efs/ 2024-05-21T14:29:27.026 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/efs/efs.ko 2024-05-21T14:29:27.026 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/f2fs/ 2024-05-21T14:29:27.026 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1906817 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/f2fs/f2fs.ko 2024-05-21T14:29:27.026 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/fat/ 2024-05-21T14:29:27.026 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35137 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/fat/msdos.ko 2024-05-21T14:29:27.026 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/freevxfs/ 2024-05-21T14:29:27.026 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/freevxfs/freevxfs.ko 2024-05-21T14:29:27.026 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/fuse/ 2024-05-21T14:29:27.026 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/fuse/cuse.ko 2024-05-21T14:29:27.026 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/gfs2/ 2024-05-21T14:29:27.026 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1486521 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/gfs2/gfs2.ko 2024-05-21T14:29:27.026 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/hfs/ 2024-05-21T14:29:27.027 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 183305 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/hfs/hfs.ko 2024-05-21T14:29:27.027 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/hfsplus/ 2024-05-21T14:29:27.027 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 282097 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/hfsplus/hfsplus.ko 2024-05-21T14:29:27.027 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/hpfs/ 2024-05-21T14:29:27.027 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 249009 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/hpfs/hpfs.ko 2024-05-21T14:29:27.027 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/isofs/ 2024-05-21T14:29:27.027 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 93033 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/isofs/isofs.ko 2024-05-21T14:29:27.027 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/jfs/ 2024-05-21T14:29:27.027 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 533073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/jfs/jfs.ko 2024-05-21T14:29:27.027 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/lockd/ 2024-05-21T14:29:27.027 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 361369 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/lockd/lockd.ko 2024-05-21T14:29:27.027 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/minix/ 2024-05-21T14:29:27.028 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 112609 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/minix/minix.ko 2024-05-21T14:29:27.028 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/netfs/ 2024-05-21T14:29:27.028 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 591585 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/netfs/netfs.ko 2024-05-21T14:29:27.028 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nfs/ 2024-05-21T14:29:27.028 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nfs/blocklayout/ 2024-05-21T14:29:27.028 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102561 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-21T14:29:27.028 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nfs/filelayout/ 2024-05-21T14:29:27.028 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-21T14:29:27.028 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nfs/flexfilelayout/ 2024-05-21T14:29:27.028 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 147689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-21T14:29:27.028 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1320249 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nfs/nfs.ko 2024-05-21T14:29:27.028 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nfs/nfsv2.ko 2024-05-21T14:29:27.028 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 151641 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nfs/nfsv3.ko 2024-05-21T14:29:27.028 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2518505 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nfs/nfsv4.ko 2024-05-21T14:29:27.029 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nfs_common/ 2024-05-21T14:29:27.029 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19849 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nfs_common/grace.ko 2024-05-21T14:29:27.029 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nfs_common/nfs_acl.ko 2024-05-21T14:29:27.029 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nfsd/ 2024-05-21T14:29:27.029 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2024049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nfsd/nfsd.ko 2024-05-21T14:29:27.029 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nilfs2/ 2024-05-21T14:29:27.029 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 734025 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nilfs2/nilfs2.ko 2024-05-21T14:29:27.029 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/ 2024-05-21T14:29:27.029 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14977 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/mac-celtic.ko 2024-05-21T14:29:27.029 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/mac-centeuro.ko 2024-05-21T14:29:27.029 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14977 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/mac-croatian.ko 2024-05-21T14:29:27.029 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/mac-cyrillic.ko 2024-05-21T14:29:27.029 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/mac-gaelic.ko 2024-05-21T14:29:27.029 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14041 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/mac-greek.ko 2024-05-21T14:29:27.030 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14977 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/mac-iceland.ko 2024-05-21T14:29:27.030 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/mac-inuit.ko 2024-05-21T14:29:27.030 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15281 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/mac-roman.ko 2024-05-21T14:29:27.030 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14977 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/mac-romanian.ko 2024-05-21T14:29:27.030 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14977 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/mac-turkish.ko 2024-05-21T14:29:27.030 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12481 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_ascii.ko 2024-05-21T14:29:27.030 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp1250.ko 2024-05-21T14:29:27.030 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp1251.ko 2024-05-21T14:29:27.030 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp1255.ko 2024-05-21T14:29:27.030 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp737.ko 2024-05-21T14:29:27.030 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp775.ko 2024-05-21T14:29:27.030 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp850.ko 2024-05-21T14:29:27.030 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp852.ko 2024-05-21T14:29:27.031 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp855.ko 2024-05-21T14:29:27.031 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13097 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp857.ko 2024-05-21T14:29:27.031 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14033 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp860.ko 2024-05-21T14:29:27.031 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp861.ko 2024-05-21T14:29:27.031 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14657 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp862.ko 2024-05-21T14:29:27.031 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp863.ko 2024-05-21T14:29:27.031 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14033 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp864.ko 2024-05-21T14:29:27.031 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp865.ko 2024-05-21T14:29:27.031 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp866.ko 2024-05-21T14:29:27.031 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp869.ko 2024-05-21T14:29:27.031 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13169 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp874.ko 2024-05-21T14:29:27.031 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 95625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp932.ko 2024-05-21T14:29:27.032 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 144209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp936.ko 2024-05-21T14:29:27.032 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 167137 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp949.ko 2024-05-21T14:29:27.032 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_cp950.ko 2024-05-21T14:29:27.032 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_euc-jp.ko 2024-05-21T14:29:27.032 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12489 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_iso8859-1.ko 2024-05-21T14:29:27.032 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_iso8859-13.ko 2024-05-21T14:29:27.032 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_iso8859-14.ko 2024-05-21T14:29:27.032 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_iso8859-15.ko 2024-05-21T14:29:27.032 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_iso8859-2.ko 2024-05-21T14:29:27.032 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_iso8859-3.ko 2024-05-21T14:29:27.032 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_iso8859-4.ko 2024-05-21T14:29:27.032 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_iso8859-5.ko 2024-05-21T14:29:27.033 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_iso8859-6.ko 2024-05-21T14:29:27.033 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_iso8859-7.ko 2024-05-21T14:29:27.033 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_iso8859-9.ko 2024-05-21T14:29:27.033 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_koi8-r.ko 2024-05-21T14:29:27.033 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_koi8-ru.ko 2024-05-21T14:29:27.033 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_koi8-u.ko 2024-05-21T14:29:27.033 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7521 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-21T14:29:27.033 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9601 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/nls/nls_utf8.ko 2024-05-21T14:29:27.033 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/ocfs2/ 2024-05-21T14:29:27.033 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/ocfs2/cluster/ 2024-05-21T14:29:27.033 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 302073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-21T14:29:27.033 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/ocfs2/dlm/ 2024-05-21T14:29:27.034 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 548169 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-21T14:29:27.034 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/ocfs2/dlmfs/ 2024-05-21T14:29:27.034 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66361 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-21T14:29:27.034 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 3245617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/ocfs2/ocfs2.ko 2024-05-21T14:29:27.077 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-21T14:29:27.078 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-21T14:29:27.078 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-21T14:29:27.078 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/omfs/ 2024-05-21T14:29:27.078 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67489 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/omfs/omfs.ko 2024-05-21T14:29:27.078 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/overlayfs/ 2024-05-21T14:29:27.078 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 462873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/overlayfs/overlay.ko 2024-05-21T14:29:27.078 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/pstore/ 2024-05-21T14:29:27.078 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67977 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/pstore/ramoops.ko 2024-05-21T14:29:27.078 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/qnx4/ 2024-05-21T14:29:27.078 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/qnx4/qnx4.ko 2024-05-21T14:29:27.078 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/qnx6/ 2024-05-21T14:29:27.079 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56097 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/qnx6/qnx6.ko 2024-05-21T14:29:27.079 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/quota/ 2024-05-21T14:29:27.079 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/quota/quota_tree.ko 2024-05-21T14:29:27.079 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/quota/quota_v1.ko 2024-05-21T14:29:27.079 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28817 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/quota/quota_v2.ko 2024-05-21T14:29:27.079 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/reiserfs/ 2024-05-21T14:29:27.079 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 684841 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/reiserfs/reiserfs.ko 2024-05-21T14:29:27.079 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/romfs/ 2024-05-21T14:29:27.079 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34673 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/romfs/romfs.ko 2024-05-21T14:29:27.079 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/smb/ 2024-05-21T14:29:27.079 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/smb/client/ 2024-05-21T14:29:27.079 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 3319041 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/smb/client/cifs.ko 2024-05-21T14:29:27.079 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/smb/common/ 2024-05-21T14:29:27.079 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/smb/common/cifs_arc4.ko 2024-05-21T14:29:27.080 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12737 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/smb/common/cifs_md4.ko 2024-05-21T14:29:27.080 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/squashfs/ 2024-05-21T14:29:27.080 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 164185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/squashfs/squashfs.ko 2024-05-21T14:29:27.080 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/sysv/ 2024-05-21T14:29:27.080 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 115977 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/sysv/sysv.ko 2024-05-21T14:29:27.080 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/udf/ 2024-05-21T14:29:27.080 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 310017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/udf/udf.ko 2024-05-21T14:29:27.080 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/ufs/ 2024-05-21T14:29:27.080 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 198233 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/ufs/ufs.ko 2024-05-21T14:29:27.080 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/xfs/ 2024-05-21T14:29:27.080 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 5192705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/fs/xfs/xfs.ko 2024-05-21T14:29:27.080 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/kernel/ 2024-05-21T14:29:27.080 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/kernel/locking/ 2024-05-21T14:29:27.081 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/kernel/locking/locktorture.ko 2024-05-21T14:29:27.081 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/kernel/time/ 2024-05-21T14:29:27.081 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15753 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/kernel/time/test_udelay.ko 2024-05-21T14:29:27.081 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/kernel/torture.ko 2024-05-21T14:29:27.081 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/ 2024-05-21T14:29:27.081 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/crc-itu-t.ko 2024-05-21T14:29:27.081 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7081 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/crc7.ko 2024-05-21T14:29:27.081 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/crc8.ko 2024-05-21T14:29:27.081 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/crypto/ 2024-05-21T14:29:27.081 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8009 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/crypto/libarc4.ko 2024-05-21T14:29:27.081 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38985 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/crypto/libdes.ko 2024-05-21T14:29:27.081 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/interval_tree_test.ko 2024-05-21T14:29:27.081 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/libcrc32c.ko 2024-05-21T14:29:27.081 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29065 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/lru_cache.ko 2024-05-21T14:29:27.082 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/lz4/ 2024-05-21T14:29:27.082 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36169 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/lz4/lz4_compress.ko 2024-05-21T14:29:27.082 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24729 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/lz4/lz4hc_compress.ko 2024-05-21T14:29:27.082 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/math/ 2024-05-21T14:29:27.082 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7281 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/math/cordic.ko 2024-05-21T14:29:27.082 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9169 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/memory-notifier-error-inject.ko 2024-05-21T14:29:27.082 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/notifier-error-inject.ko 2024-05-21T14:29:27.082 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/percpu_test.ko 2024-05-21T14:29:27.082 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9249 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/pm-notifier-error-inject.ko 2024-05-21T14:29:27.082 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/raid6/ 2024-05-21T14:29:27.082 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 152025 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/raid6/raid6_pq.ko 2024-05-21T14:29:27.082 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24481 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/rbtree_test.ko 2024-05-21T14:29:27.083 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/reed_solomon/ 2024-05-21T14:29:27.083 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21385 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-21T14:29:27.083 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40969 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/test-kstrtox.ko 2024-05-21T14:29:27.083 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 4912441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/test_bpf.ko 2024-05-21T14:29:27.083 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61169 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/test_firmware.ko 2024-05-21T14:29:27.083 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7121 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/test_module.ko 2024-05-21T14:29:27.083 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24937 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/test_user_copy.ko 2024-05-21T14:29:27.083 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11329 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/ts_bm.ko 2024-05-21T14:29:27.083 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/ts_fsm.ko 2024-05-21T14:29:27.083 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11369 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/ts_kmp.ko 2024-05-21T14:29:27.083 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/xz/ 2024-05-21T14:29:27.083 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/lib/xz/xz_dec_test.ko 2024-05-21T14:29:27.083 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/mm/ 2024-05-21T14:29:27.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20529 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/mm/hwpoison-inject.ko 2024-05-21T14:29:27.084 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ 2024-05-21T14:29:27.084 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/6lowpan/ 2024-05-21T14:29:27.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66969 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/6lowpan/6lowpan.ko 2024-05-21T14:29:27.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7577 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/6lowpan/nhc_dest.ko 2024-05-21T14:29:27.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7529 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/6lowpan/nhc_fragment.ko 2024-05-21T14:29:27.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/6lowpan/nhc_hop.ko 2024-05-21T14:29:27.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-21T14:29:27.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7529 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/6lowpan/nhc_mobility.ko 2024-05-21T14:29:27.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7521 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/6lowpan/nhc_routing.ko 2024-05-21T14:29:27.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17225 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/6lowpan/nhc_udp.ko 2024-05-21T14:29:27.084 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/802/ 2024-05-21T14:29:27.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36729 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/802/garp.ko 2024-05-21T14:29:27.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42297 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/802/mrp.ko 2024-05-21T14:29:27.085 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9849 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/802/p8022.ko 2024-05-21T14:29:27.085 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/802/psnap.ko 2024-05-21T14:29:27.085 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13537 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/802/stp.ko 2024-05-21T14:29:27.085 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/8021q/ 2024-05-21T14:29:27.085 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106793 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/8021q/8021q.ko 2024-05-21T14:29:27.085 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/9p/ 2024-05-21T14:29:27.085 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 236793 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/9p/9pnet.ko 2024-05-21T14:29:27.085 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44449 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/9p/9pnet_fd.ko 2024-05-21T14:29:27.085 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/9p/9pnet_rdma.ko 2024-05-21T14:29:27.085 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/9p/9pnet_virtio.ko 2024-05-21T14:29:27.086 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/batman-adv/ 2024-05-21T14:29:27.086 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 879697 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/batman-adv/batman-adv.ko 2024-05-21T14:29:27.086 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/ 2024-05-21T14:29:27.086 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 84761 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/br_netfilter.ko 2024-05-21T14:29:27.086 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1030873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/bridge.ko 2024-05-21T14:29:27.086 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ 2024-05-21T14:29:27.086 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-21T14:29:27.086 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14569 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-21T14:29:27.086 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-21T14:29:27.086 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-21T14:29:27.086 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-21T14:29:27.086 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10001 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-21T14:29:27.086 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10337 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-21T14:29:27.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11145 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-21T14:29:27.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15385 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-21T14:29:27.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8841 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-21T14:29:27.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8777 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-21T14:29:27.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9569 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-21T14:29:27.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-21T14:29:27.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-21T14:29:27.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-21T14:29:27.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-21T14:29:27.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13713 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-21T14:29:27.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13249 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-21T14:29:27.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-21T14:29:27.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-21T14:29:27.088 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70529 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/ebtables.ko 2024-05-21T14:29:27.088 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-21T14:29:27.088 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16217 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-21T14:29:27.088 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ceph/ 2024-05-21T14:29:27.088 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1243505 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ceph/libceph.ko 2024-05-21T14:29:27.088 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/core/ 2024-05-21T14:29:27.088 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 153801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/core/pktgen.ko 2024-05-21T14:29:27.088 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/dccp/ 2024-05-21T14:29:27.088 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 244889 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/dccp/dccp.ko 2024-05-21T14:29:27.088 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10273 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/dccp/dccp_diag.ko 2024-05-21T14:29:27.088 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71033 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/dccp/dccp_ipv4.ko 2024-05-21T14:29:27.088 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/dccp/dccp_ipv6.ko 2024-05-21T14:29:27.088 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/dsa/ 2024-05-21T14:29:27.088 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 507705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/dsa/dsa_core.ko 2024-05-21T14:29:27.089 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15841 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/dsa/tag_brcm.ko 2024-05-21T14:29:27.089 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/dsa/tag_dsa.ko 2024-05-21T14:29:27.089 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/dsa/tag_none.ko 2024-05-21T14:29:27.089 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10465 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/dsa/tag_trailer.ko 2024-05-21T14:29:27.089 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/hsr/ 2024-05-21T14:29:27.089 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 128873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/hsr/hsr.ko 2024-05-21T14:29:27.089 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ieee802154/ 2024-05-21T14:29:27.089 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ieee802154/6lowpan/ 2024-05-21T14:29:27.089 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55505 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-21T14:29:27.089 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 357425 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ieee802154/ieee802154.ko 2024-05-21T14:29:27.089 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59393 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-21T14:29:27.089 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/ 2024-05-21T14:29:27.089 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29041 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/ah4.ko 2024-05-21T14:29:27.090 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/esp4.ko 2024-05-21T14:29:27.090 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60233 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/fou.ko 2024-05-21T14:29:27.090 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21937 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/gre.ko 2024-05-21T14:29:27.090 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/inet_diag.ko 2024-05-21T14:29:27.090 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75489 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/ip_gre.ko 2024-05-21T14:29:27.090 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/ip_tunnel.ko 2024-05-21T14:29:27.090 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/ip_vti.ko 2024-05-21T14:29:27.090 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/ipcomp.ko 2024-05-21T14:29:27.090 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34745 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/ipip.ko 2024-05-21T14:29:27.090 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/ 2024-05-21T14:29:27.090 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45521 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-21T14:29:27.090 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10137 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-21T14:29:27.090 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-21T14:29:27.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50169 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/ip_tables.ko 2024-05-21T14:29:27.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11369 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-21T14:29:27.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-05-21T14:29:27.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-21T14:29:27.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-21T14:29:27.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-21T14:29:27.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-05-21T14:29:27.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13377 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-21T14:29:27.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17297 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-21T14:29:27.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13241 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-21T14:29:27.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11969 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-21T14:29:27.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14505 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-21T14:29:27.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-21T14:29:27.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32473 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-21T14:29:27.092 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20737 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-21T14:29:27.092 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-21T14:29:27.092 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25753 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-05-21T14:29:27.092 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10249 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-21T14:29:27.092 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17161 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-21T14:29:27.092 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-21T14:29:27.092 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-21T14:29:27.092 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10065 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-21T14:29:27.092 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/tcp_bic.ko 2024-05-21T14:29:27.092 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/tcp_dctcp.ko 2024-05-21T14:29:27.092 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/tcp_diag.ko 2024-05-21T14:29:27.092 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/tcp_highspeed.ko 2024-05-21T14:29:27.092 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14385 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/tcp_htcp.ko 2024-05-21T14:29:27.093 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11665 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/tcp_hybla.ko 2024-05-21T14:29:27.093 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13449 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/tcp_illinois.ko 2024-05-21T14:29:27.093 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11737 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/tcp_lp.ko 2024-05-21T14:29:27.093 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9601 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/tcp_scalable.ko 2024-05-21T14:29:27.093 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/tcp_vegas.ko 2024-05-21T14:29:27.093 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/tcp_veno.ko 2024-05-21T14:29:27.093 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/tcp_westwood.ko 2024-05-21T14:29:27.093 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11745 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/tcp_yeah.ko 2024-05-21T14:29:27.093 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28585 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/tunnel4.ko 2024-05-21T14:29:27.093 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21137 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/udp_diag.ko 2024-05-21T14:29:27.093 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/udp_tunnel.ko 2024-05-21T14:29:27.093 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-21T14:29:27.093 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/ 2024-05-21T14:29:27.094 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/ah6.ko 2024-05-21T14:29:27.094 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47433 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/esp6.ko 2024-05-21T14:29:27.094 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/fou6.ko 2024-05-21T14:29:27.094 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/ip6_gre.ko 2024-05-21T14:29:27.094 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 118881 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/ip6_tunnel.ko 2024-05-21T14:29:27.094 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16249 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-21T14:29:27.094 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71089 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/ip6_vti.ko 2024-05-21T14:29:27.094 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16249 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/ipcomp6.ko 2024-05-21T14:29:27.094 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/mip6.ko 2024-05-21T14:29:27.094 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ 2024-05-21T14:29:27.094 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50673 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-21T14:29:27.095 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-05-21T14:29:27.095 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11593 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-21T14:29:27.095 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16361 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-21T14:29:27.095 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15929 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-21T14:29:27.095 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-21T14:29:27.095 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-21T14:29:27.095 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-21T14:29:27.095 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-21T14:29:27.095 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11137 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-21T14:29:27.095 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12473 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-21T14:29:27.096 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-21T14:29:27.096 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13001 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-21T14:29:27.096 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-21T14:29:27.096 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17449 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-21T14:29:27.096 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13249 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-21T14:29:27.096 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11977 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-21T14:29:27.096 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-21T14:29:27.096 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9361 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-21T14:29:27.096 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29817 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-21T14:29:27.096 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-21T14:29:27.096 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-21T14:29:27.097 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11097 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-21T14:29:27.097 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18521 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-21T14:29:27.097 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10065 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-21T14:29:27.097 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 94089 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/sit.ko 2024-05-21T14:29:27.097 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30297 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/tunnel6.ko 2024-05-21T14:29:27.097 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28369 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-21T14:29:27.097 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/key/ 2024-05-21T14:29:27.097 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106369 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/key/af_key.ko 2024-05-21T14:29:27.097 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/l2tp/ 2024-05-21T14:29:27.097 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 153217 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/l2tp/l2tp_core.ko 2024-05-21T14:29:27.097 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24273 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-21T14:29:27.097 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31985 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/l2tp/l2tp_eth.ko 2024-05-21T14:29:27.098 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43641 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/l2tp/l2tp_ip.ko 2024-05-21T14:29:27.098 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/l2tp/l2tp_ip6.ko 2024-05-21T14:29:27.098 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/l2tp/l2tp_netlink.ko 2024-05-21T14:29:27.098 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66241 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/l2tp/l2tp_ppp.ko 2024-05-21T14:29:27.098 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/lapb/ 2024-05-21T14:29:27.098 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/lapb/lapb.ko 2024-05-21T14:29:27.098 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/llc/ 2024-05-21T14:29:27.098 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27385 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/llc/llc.ko 2024-05-21T14:29:27.098 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 332889 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/llc/llc2.ko 2024-05-21T14:29:27.098 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/mac802154/ 2024-05-21T14:29:27.098 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 388873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/mac802154/mac802154.ko 2024-05-21T14:29:27.098 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/mpls/ 2024-05-21T14:29:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10577 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/mpls/mpls_gso.ko 2024-05-21T14:29:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ 2024-05-21T14:29:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipset/ 2024-05-21T14:29:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 147745 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipset/ip_set.ko 2024-05-21T14:29:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34473 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-21T14:29:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-21T14:29:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32553 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-21T14:29:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 124041 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-21T14:29:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 124345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-21T14:29:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 126681 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-21T14:29:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 126473 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-21T14:29:27.099 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 137833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-21T14:29:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-21T14:29:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 133681 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-21T14:29:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 139073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-21T14:29:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 138265 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-21T14:29:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 136177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-21T14:29:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 139897 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-21T14:29:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37129 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-21T14:29:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipvs/ 2024-05-21T14:29:27.100 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 534113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-21T14:29:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14201 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-21T14:29:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-21T14:29:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20561 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-21T14:29:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20953 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-21T14:29:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24577 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-21T14:29:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-21T14:29:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-21T14:29:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12649 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-21T14:29:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-21T14:29:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-21T14:29:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15977 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-21T14:29:27.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-21T14:29:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12809 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-21T14:29:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55217 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_conncount.ko 2024-05-21T14:29:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 496817 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_conntrack.ko 2024-05-21T14:29:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18097 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-21T14:29:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11793 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-21T14:29:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-21T14:29:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 134377 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-21T14:29:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24513 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-21T14:29:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-21T14:29:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 140801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-21T14:29:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38305 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-21T14:29:27.102 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18937 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-21T14:29:27.103 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 79873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-21T14:29:27.103 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12561 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-21T14:29:27.103 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21089 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-21T14:29:27.103 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-21T14:29:27.103 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 117201 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_flow_table.ko 2024-05-21T14:29:27.103 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-21T14:29:27.103 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_log_syslog.ko 2024-05-21T14:29:27.103 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 118369 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_nat.ko 2024-05-21T14:29:27.103 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11369 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-21T14:29:27.103 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14185 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-21T14:29:27.103 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13345 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_nat_irc.ko 2024-05-21T14:29:27.103 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34609 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_nat_sip.ko 2024-05-21T14:29:27.104 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9889 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-21T14:29:27.104 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53393 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-21T14:29:27.104 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 807985 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nf_tables.ko 2024-05-21T14:29:27.104 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53049 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nfnetlink.ko 2024-05-21T14:29:27.104 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36481 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-21T14:29:27.104 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-05-21T14:29:27.104 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49297 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nfnetlink_log.ko 2024-05-21T14:29:27.104 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26473 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-21T14:29:27.104 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65145 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-21T14:29:27.104 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_chain_nat.ko 2024-05-21T14:29:27.104 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41769 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_compat.ko 2024-05-21T14:29:27.104 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50657 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_ct.ko 2024-05-21T14:29:27.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11081 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-21T14:29:27.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13745 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_fib.ko 2024-05-21T14:29:27.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16545 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-21T14:29:27.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_hash.ko 2024-05-21T14:29:27.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25225 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_limit.ko 2024-05-21T14:29:27.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17921 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_log.ko 2024-05-21T14:29:27.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17449 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_masq.ko 2024-05-21T14:29:27.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_nat.ko 2024-05-21T14:29:27.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16473 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_numgen.ko 2024-05-21T14:29:27.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13945 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_osf.ko 2024-05-21T14:29:27.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_queue.ko 2024-05-21T14:29:27.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16657 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_redir.ko 2024-05-21T14:29:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_reject.ko 2024-05-21T14:29:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11377 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_reject_inet.ko 2024-05-21T14:29:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15057 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_socket.ko 2024-05-21T14:29:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24993 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_synproxy.ko 2024-05-21T14:29:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17641 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/nft_tproxy.ko 2024-05-21T14:29:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108393 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/x_tables.ko 2024-05-21T14:29:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14193 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_AUDIT.ko 2024-05-21T14:29:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-21T14:29:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-21T14:29:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-21T14:29:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_CT.ko 2024-05-21T14:29:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_DSCP.ko 2024-05-21T14:29:27.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_HL.ko 2024-05-21T14:29:27.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15745 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_HMARK.ko 2024-05-21T14:29:27.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45217 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-21T14:29:27.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15937 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_LED.ko 2024-05-21T14:29:27.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13017 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_LOG.ko 2024-05-21T14:29:27.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13377 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-21T14:29:27.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13321 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_NETMAP.ko 2024-05-21T14:29:27.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10857 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_NFLOG.ko 2024-05-21T14:29:27.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15361 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-21T14:29:27.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23089 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_RATEEST.ko 2024-05-21T14:29:27.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12553 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-21T14:29:27.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16689 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_SECMARK.ko 2024-05-21T14:29:27.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18985 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-21T14:29:27.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11769 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-21T14:29:27.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20697 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_TEE.ko 2024-05-21T14:29:27.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_TPROXY.ko 2024-05-21T14:29:27.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9449 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_TRACE.ko 2024-05-21T14:29:27.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15289 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_addrtype.ko 2024-05-21T14:29:27.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16633 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_bpf.ko 2024-05-21T14:29:27.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20489 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_cgroup.ko 2024-05-21T14:29:27.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_cluster.ko 2024-05-21T14:29:27.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8465 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_comment.ko 2024-05-21T14:29:27.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11961 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_connbytes.ko 2024-05-21T14:29:27.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12969 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_connlabel.ko 2024-05-21T14:29:27.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_connlimit.ko 2024-05-21T14:29:27.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15841 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_connmark.ko 2024-05-21T14:29:27.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14209 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_conntrack.ko 2024-05-21T14:29:27.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_cpu.ko 2024-05-21T14:29:27.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12489 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_dccp.ko 2024-05-21T14:29:27.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9001 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_devgroup.ko 2024-05-21T14:29:27.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10257 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_dscp.ko 2024-05-21T14:29:27.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12657 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_ecn.ko 2024-05-21T14:29:27.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_esp.ko 2024-05-21T14:29:27.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52817 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_hashlimit.ko 2024-05-21T14:29:27.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_helper.ko 2024-05-21T14:29:27.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9521 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_hl.ko 2024-05-21T14:29:27.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13241 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_ipcomp.ko 2024-05-21T14:29:27.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_iprange.ko 2024-05-21T14:29:27.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_ipvs.ko 2024-05-21T14:29:27.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19193 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_l2tp.ko 2024-05-21T14:29:27.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9137 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_length.ko 2024-05-21T14:29:27.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11521 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_limit.ko 2024-05-21T14:29:27.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8449 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_mac.ko 2024-05-21T14:29:27.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9881 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_mark.ko 2024-05-21T14:29:27.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_multiport.ko 2024-05-21T14:29:27.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16161 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_nat.ko 2024-05-21T14:29:27.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11433 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_nfacct.ko 2024-05-21T14:29:27.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9433 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_osf.ko 2024-05-21T14:29:27.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11561 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_owner.ko 2024-05-21T14:29:27.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_physdev.ko 2024-05-21T14:29:27.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_pkttype.ko 2024-05-21T14:29:27.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13553 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_policy.ko 2024-05-21T14:29:27.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_quota.ko 2024-05-21T14:29:27.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11881 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_rateest.ko 2024-05-21T14:29:27.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9273 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_realm.ko 2024-05-21T14:29:27.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43465 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_recent.ko 2024-05-21T14:29:27.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_sctp.ko 2024-05-21T14:29:27.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36489 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_set.ko 2024-05-21T14:29:27.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19777 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_socket.ko 2024-05-21T14:29:27.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10753 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_state.ko 2024-05-21T14:29:27.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10849 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_statistic.ko 2024-05-21T14:29:27.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10025 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_string.ko 2024-05-21T14:29:27.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9593 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_tcpmss.ko 2024-05-21T14:29:27.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18449 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_tcpudp.ko 2024-05-21T14:29:27.112 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12441 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_time.ko 2024-05-21T14:29:27.112 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netfilter/xt_u32.ko 2024-05-21T14:29:27.112 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netlink/ 2024-05-21T14:29:27.112 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17233 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/netlink/netlink_diag.ko 2024-05-21T14:29:27.112 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/nsh/ 2024-05-21T14:29:27.112 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14073 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/nsh/nsh.ko 2024-05-21T14:29:27.112 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/openvswitch/ 2024-05-21T14:29:27.112 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 488825 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/openvswitch/openvswitch.ko 2024-05-21T14:29:27.112 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12009 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/openvswitch/vport-geneve.ko 2024-05-21T14:29:27.112 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10873 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/openvswitch/vport-gre.ko 2024-05-21T14:29:27.112 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/openvswitch/vport-vxlan.ko 2024-05-21T14:29:27.112 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/packet/ 2024-05-21T14:29:27.112 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15929 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/packet/af_packet_diag.ko 2024-05-21T14:29:27.113 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/phonet/ 2024-05-21T14:29:27.113 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 142025 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/phonet/phonet.ko 2024-05-21T14:29:27.113 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68817 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/phonet/pn_pep.ko 2024-05-21T14:29:27.113 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/rds/ 2024-05-21T14:29:27.113 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 318617 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/rds/rds.ko 2024-05-21T14:29:27.113 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 202305 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/rds/rds_rdma.ko 2024-05-21T14:29:27.113 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85105 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/rds/rds_tcp.ko 2024-05-21T14:29:27.113 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/rxrpc/ 2024-05-21T14:29:27.113 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1027897 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/rxrpc/rxrpc.ko 2024-05-21T14:29:27.113 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/ 2024-05-21T14:29:27.113 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39001 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/act_csum.ko 2024-05-21T14:29:27.113 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28721 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/act_gact.ko 2024-05-21T14:29:27.113 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/act_mirred.ko 2024-05-21T14:29:27.113 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27593 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/act_nat.ko 2024-05-21T14:29:27.114 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53465 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/act_pedit.ko 2024-05-21T14:29:27.114 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38705 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/act_police.ko 2024-05-21T14:29:27.114 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23969 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/act_simple.ko 2024-05-21T14:29:27.114 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43417 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/act_skbedit.ko 2024-05-21T14:29:27.114 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45673 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/act_vlan.ko 2024-05-21T14:29:27.114 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32129 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/cls_basic.ko 2024-05-21T14:29:27.114 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41457 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/cls_bpf.ko 2024-05-21T14:29:27.114 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23225 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/cls_cgroup.ko 2024-05-21T14:29:27.114 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37305 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/cls_flow.ko 2024-05-21T14:29:27.114 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39601 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/cls_fw.ko 2024-05-21T14:29:27.114 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49321 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/cls_route.ko 2024-05-21T14:29:27.114 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 79145 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/cls_u32.ko 2024-05-21T14:29:27.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8713 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/em_cmp.ko 2024-05-21T14:29:27.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15385 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/em_ipset.ko 2024-05-21T14:29:27.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48785 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/em_meta.ko 2024-05-21T14:29:27.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9241 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/em_nbyte.ko 2024-05-21T14:29:27.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13369 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/em_text.ko 2024-05-21T14:29:27.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8377 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/em_u32.ko 2024-05-21T14:29:27.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_choke.ko 2024-05-21T14:29:27.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25097 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_codel.ko 2024-05-21T14:29:27.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43481 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_drr.ko 2024-05-21T14:29:27.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43153 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_fq.ko 2024-05-21T14:29:27.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39177 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_fq_codel.ko 2024-05-21T14:29:27.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42889 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_gred.ko 2024-05-21T14:29:27.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62817 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_hfsc.ko 2024-05-21T14:29:27.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26585 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_hhf.ko 2024-05-21T14:29:27.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_htb.ko 2024-05-21T14:29:27.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33545 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_ingress.ko 2024-05-21T14:29:27.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36625 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_mqprio.ko 2024-05-21T14:29:27.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12297 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_mqprio_lib.ko 2024-05-21T14:29:27.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33065 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_multiq.ko 2024-05-21T14:29:27.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44793 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_netem.ko 2024-05-21T14:29:27.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32833 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_pie.ko 2024-05-21T14:29:27.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13505 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_plug.ko 2024-05-21T14:29:27.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_prio.ko 2024-05-21T14:29:27.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60249 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_qfq.ko 2024-05-21T14:29:27.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40889 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_red.ko 2024-05-21T14:29:27.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33433 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_sfb.ko 2024-05-21T14:29:27.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38329 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_sfq.ko 2024-05-21T14:29:27.117 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35777 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_tbf.ko 2024-05-21T14:29:27.117 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34161 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sched/sch_teql.ko 2024-05-21T14:29:27.117 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sctp/ 2024-05-21T14:29:27.117 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1187313 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sctp/sctp.ko 2024-05-21T14:29:27.117 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23913 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sctp/sctp_diag.ko 2024-05-21T14:29:27.117 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sunrpc/ 2024-05-21T14:29:27.117 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sunrpc/auth_gss/ 2024-05-21T14:29:27.117 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 432409 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-21T14:29:27.117 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70113 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-21T14:29:27.117 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1940889 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sunrpc/sunrpc.ko 2024-05-21T14:29:27.117 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sunrpc/xprtrdma/ 2024-05-21T14:29:27.117 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 890729 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-21T14:29:27.118 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/tipc/ 2024-05-21T14:29:27.118 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1122337 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/tipc/tipc.ko 2024-05-21T14:29:27.118 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12153 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/tipc/tipc_diag.ko 2024-05-21T14:29:27.118 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/unix/ 2024-05-21T14:29:27.118 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18801 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/unix/unix_diag.ko 2024-05-21T14:29:27.118 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/vmw_vsock/ 2024-05-21T14:29:27.118 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 105609 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-21T14:29:27.118 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90265 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-21T14:29:27.118 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 123769 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/vmw_vsock/vsock.ko 2024-05-21T14:29:27.118 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12905 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-21T14:29:27.118 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20401 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-21T14:29:27.119 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/x25/ 2024-05-21T14:29:27.119 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 165841 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/x25/x25.ko 2024-05-21T14:29:27.119 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/xfrm/ 2024-05-21T14:29:27.119 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26729 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/xfrm/xfrm_algo.ko 2024-05-21T14:29:27.119 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23353 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-21T14:29:27.119 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 131865 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/kernel/net/xfrm/xfrm_user.ko 2024-05-21T14:29:27.119 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 644769 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/modules.alias 2024-05-21T14:29:27.119 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 628542 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/modules.alias.bin 2024-05-21T14:29:27.119 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7706 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/modules.builtin 2024-05-21T14:29:27.119 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23609 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/modules.builtin.alias.bin 2024-05-21T14:29:27.119 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9941 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/modules.builtin.bin 2024-05-21T14:29:27.119 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70990 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/modules.builtin.modinfo 2024-05-21T14:29:27.119 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 146959 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/modules.dep 2024-05-21T14:29:27.119 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 232835 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/modules.dep.bin 2024-05-21T14:29:27.120 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 210 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/modules.devname 2024-05-21T14:29:27.120 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72602 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/modules.order 2024-05-21T14:29:27.120 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 879 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/modules.softdep 2024-05-21T14:29:27.120 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 258450 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/modules.symbols 2024-05-21T14:29:27.120 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 313019 2024-05-21 01:11 ./lib/modules/6.9.0-rc3-g4fed890e8ce3/modules.symbols.bin 2024-05-21T14:29:27.120 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./usr/ 2024-05-21T14:29:27.120 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./usr/share/ 2024-05-21T14:29:27.120 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./usr/share/doc/ 2024-05-21T14:29:27.120 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2024-05-21 01:11 ./usr/share/doc/linux-image-6.9.0-rc3-g4fed890e8ce3/ 2024-05-21T14:29:27.120 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 174 2024-05-21 01:11 ./usr/share/doc/linux-image-6.9.0-rc3-g4fed890e8ce3/changelog.Debian.gz 2024-05-21T14:29:27.120 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 691 2024-05-21 01:11 ./usr/share/doc/linux-image-6.9.0-rc3-g4fed890e8ce3/copyright 2024-05-21T14:29:27.126 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g4fed890e8ce3 2024-05-21T14:29:27.126 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g4fed890e8ce3 2024-05-21T14:29:27.126 DEBUG:teuthology.orchestra.run.smithi078:> egrep '(submenu|menuentry.*6.9.0-rc3-g4fed890e8ce3).*{' /boot/grub/grub.cfg 2024-05-21T14:29:27.133 INFO:teuthology.orchestra.run.smithi078.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-21T14:29:27.133 INFO:teuthology.orchestra.run.smithi078.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g4fed890e8ce3' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g4fed890e8ce3-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-21T14:29:27.133 INFO:teuthology.orchestra.run.smithi078.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g4fed890e8ce3 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g4fed890e8ce3-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-21T14:29:27.134 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-05-21T14:29:27.134 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g4fed890e8ce3 2024-05-21T14:29:27.134 DEBUG:teuthology.orchestra.run.smithi078:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-05-21T14:29:27.178 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi078.front.sepia.ceph.com to complete... 2024-05-21T14:29:27.616 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub' 2024-05-21T14:29:27.617 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-21T14:29:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2024-05-21T14:29:27.850 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g4fed890e8ce3 2024-05-21T14:29:27.856 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g4fed890e8ce3 2024-05-21T14:29:28.116 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-21T14:29:28.121 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-21T14:29:28.163 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-21T14:29:28.169 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-21T14:29:28.292 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-21T14:29:28.293 INFO:teuthology.orchestra.run.smithi078.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-21T14:29:28.293 INFO:teuthology.orchestra.run.smithi078.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-21T14:29:28.314 INFO:teuthology.orchestra.run.smithi078.stderr:done 2024-05-21T14:29:59.435 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-21T14:29:59.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-05-21T14:29:59.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T14:30:17.886 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-05-21T14:30:26.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-05-21T14:30:26.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T14:30:29.950 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-05-21T14:30:41.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-05-21T14:30:41.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T14:31:00.386 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-05-21T14:31:15.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-05-21T14:31:15.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T14:31:15.836 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-05-21T14:31:16.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-05-21T14:31:16.667 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g4fed890e8ce3"... 2024-05-21T14:31:16.667 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-05-21T14:31:16.715 INFO:teuthology.orchestra.run.smithi078.stdout:6.9.0-rc3-g4fed890e8ce3 2024-05-21T14:31:16.715 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g4fed890e8ce3 vs 6.9.0-rc3-g4fed890e8ce3 2024-05-21T14:31:16.715 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-21T14:31:16.715 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-21T14:31:17.716 DEBUG:teuthology.parallel:result is None 2024-05-21T14:31:17.717 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-21T14:31:17.725 INFO:teuthology.task.internal:Creating test directory... 2024-05-21T14:31:17.725 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-21T14:31:17.728 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-21T14:31:17.734 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-21T14:31:17.756 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-21T14:31:17.796 INFO:teuthology.task.internal:Creating archive directory... 2024-05-21T14:31:17.796 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-21T14:31:17.800 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-21T14:31:17.836 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-21T14:31:17.843 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-21T14:31:17.843 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-21T14:31:17.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T14:31:17.875 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-21T14:31:17.878 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-21T14:31:17.943 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-21T14:31:17.958 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-21T14:31:17.960 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-21T14:31:17.978 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-21T14:31:17.981 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-21T14:31:17.989 INFO:teuthology.task.internal:Configuring sudo... 2024-05-21T14:31:17.989 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-21T14:31:17.993 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-21T14:31:18.020 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-21T14:31:18.029 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-21T14:31:18.030 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-21T14:31:18.054 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-21T14:31:18.067 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-21T14:31:18.112 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-21T14:31:18.164 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:31:18.164 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-21T14:31:18.235 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-21T14:31:18.241 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-21T14:31:18.287 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:31:18.287 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-21T14:31:18.352 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2024-05-21T14:31:18.355 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2024-05-21T14:31:18.474 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-21T14:31:18.485 INFO:teuthology.task.internal:Starting timer... 2024-05-21T14:31:18.485 INFO:teuthology.run_tasks:Running task pcp... 2024-05-21T14:31:18.520 INFO:teuthology.run_tasks:Running task selinux... 2024-05-21T14:31:18.564 DEBUG:teuthology.task.selinux:Excluding smithi078: OS 'ubuntu' does not support SELinux 2024-05-21T14:31:18.564 DEBUG:teuthology.task.selinux:Excluding smithi084: OS 'ubuntu' does not support SELinux 2024-05-21T14:31:18.565 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-21T14:31:18.565 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-21T14:31:18.565 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-21T14:31:18.566 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-21T14:31:18.596 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-21T14:31:18.600 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-21T14:31:18.756 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-21T14:31:18.768 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-21T14:31:18.769 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi078.front.sepia.ceph.com,smithi084.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-21T14:38:48.425 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi084.front.sepia.ceph.com')] 2024-05-21T14:38:48.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-05-21T14:38:48.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T14:38:48.513 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-05-21T14:38:48.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-05-21T14:38:48.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-05-21T14:38:48.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T14:38:48.734 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-05-21T14:38:48.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-05-21T14:38:48.842 INFO:teuthology.run_tasks:Running task clock... 2024-05-21T14:38:48.852 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-21T14:38:48.853 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-21T14:38:48.853 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-21T14:38:48.856 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-21T14:38:48.856 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-21T14:38:48.890 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-21T14:38:48.891 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: Command line: ntpd -gq 2024-05-21T14:38:48.891 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: ---------------------------------------------------- 2024-05-21T14:38:48.891 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: ntp-4 is maintained by Network Time Foundation, 2024-05-21T14:38:48.891 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-21T14:38:48.891 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: corporation. Support and training for ntp-4 are 2024-05-21T14:38:48.891 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: available at https://www.nwtime.org/support 2024-05-21T14:38:48.891 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: ---------------------------------------------------- 2024-05-21T14:38:48.892 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: proto: precision = 0.043 usec (-24) 2024-05-21T14:38:48.892 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: basedate set to 2022-02-04 2024-05-21T14:38:48.892 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: gps base set to 2022-02-06 (week 2196) 2024-05-21T14:38:48.893 INFO:teuthology.orchestra.run.smithi078.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-21T14:38:48.893 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-21T14:38:48.893 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: restrict ::: KOD does nothing without LIMITED. 2024-05-21T14:38:48.893 INFO:teuthology.orchestra.run.smithi078.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-21T14:38:48.894 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: Listen and drop on 0 v6wildcard [::]:123 2024-05-21T14:38:48.894 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-21T14:38:48.895 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: Listen normally on 2 lo 127.0.0.1:123 2024-05-21T14:38:48.895 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: Listen normally on 3 enp3s0f1 172.21.15.78:123 2024-05-21T14:38:48.895 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: Listen normally on 4 lo [::1]:123 2024-05-21T14:38:48.895 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d4dd%5]:123 2024-05-21T14:38:48.895 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:48 ntpd[17587]: Listening on routing socket on fd #22 for interface updates 2024-05-21T14:38:48.916 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-21T14:38:48.916 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: Command line: ntpd -gq 2024-05-21T14:38:48.916 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: ---------------------------------------------------- 2024-05-21T14:38:48.916 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: ntp-4 is maintained by Network Time Foundation, 2024-05-21T14:38:48.916 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-21T14:38:48.916 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: corporation. Support and training for ntp-4 are 2024-05-21T14:38:48.916 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: available at https://www.nwtime.org/support 2024-05-21T14:38:48.916 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: ---------------------------------------------------- 2024-05-21T14:38:48.917 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: proto: precision = 0.047 usec (-24) 2024-05-21T14:38:48.917 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: basedate set to 2022-02-04 2024-05-21T14:38:48.917 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: gps base set to 2022-02-06 (week 2196) 2024-05-21T14:38:48.917 INFO:teuthology.orchestra.run.smithi084.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-21T14:38:48.918 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-21T14:38:48.918 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: restrict ::: KOD does nothing without LIMITED. 2024-05-21T14:38:48.918 INFO:teuthology.orchestra.run.smithi084.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-21T14:38:48.919 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: Listen and drop on 0 v6wildcard [::]:123 2024-05-21T14:38:48.919 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-21T14:38:48.919 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: Listen normally on 2 lo 127.0.0.1:123 2024-05-21T14:38:48.919 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: Listen normally on 3 enp3s0f1 172.21.15.84:123 2024-05-21T14:38:48.919 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: Listen normally on 4 lo [::1]:123 2024-05-21T14:38:48.919 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d751%5]:123 2024-05-21T14:38:48.919 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:48 ntpd[18063]: Listening on routing socket on fd #22 for interface updates 2024-05-21T14:38:49.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:49 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:49.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:49 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:49.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:49 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:49.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:49 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:49.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:49 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:49.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:49 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:49.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:49 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:49.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:49 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:49.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:49 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:49.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:49 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:49.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:49 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:49.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:49 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:50.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:50 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:50.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:50 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:50.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:50 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:50.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:50 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:50.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:50 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:50.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:50 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:50.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:50 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:50.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:50 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:50.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:50 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:50.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:50 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:50.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:50 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:50.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:50 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:50.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:50 ntpd[18063]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:50.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:50 ntpd[18063]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:50.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:50 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:50.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:50 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:50.918 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:50 ntpd[18063]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:50.918 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:50 ntpd[18063]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:51.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:51 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:51.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:51 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:51.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:51 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:51.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:51 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:51.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:51 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:51.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:51 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:51.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:51 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:51.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:51 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:51.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:51 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:51.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:51 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:51.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:51 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:51.893 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:51 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:51.893 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:51 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:51.893 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:51 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:51 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:51 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:51 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:51 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:51 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:51 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:51 ntpd[18063]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:51 ntpd[18063]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:52.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:52 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:52.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:52 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:52.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:52 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:52.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:52 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:52.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:52 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:52.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:52 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:52.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:52 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:52.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:52 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:52.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:52 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:52.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:52 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:52.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:52 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:52.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:52 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:52.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:52 ntpd[18063]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:52.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:52 ntpd[18063]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:52.918 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:52 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:52.918 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:52 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:52.918 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:52 ntpd[18063]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:52.918 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:52 ntpd[18063]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:53.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:53 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:53.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:53 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:53.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:53 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:53.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:53 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:53.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:53 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:53.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:53 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:53.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:53 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:53.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:53 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:53.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:53 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:53.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:53 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:53.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:53 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:53.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:53 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:53.916 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:53 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:53.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:53 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:53.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:53 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:53.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:53 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:53.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:53 ntpd[18063]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:53.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:53 ntpd[18063]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:54.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:54 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:54.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:54 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:54.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:54 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:54.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:54 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:54.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:54 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:54.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:54 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:54.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:54 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:54.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:54 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:54.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:54 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:54.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:54 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:54.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:54 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:54.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:54 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:54.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:54 ntpd[18063]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:54.918 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:54 ntpd[18063]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:54.918 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:54 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:54.918 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:54 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:54.918 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:54 ntpd[18063]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:54.918 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:54 ntpd[18063]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:55.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:55 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:55.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:55 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:55.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:55 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:55.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:55 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:55.891 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:55 ntpd[17587]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:55.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:55 ntpd[17587]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:55.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:55 ntpd[17587]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:55.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:55 ntpd[17587]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:55.892 INFO:teuthology.orchestra.run.smithi078.stdout:21 May 14:38:55 ntpd[17587]: ntpd: time slew +0.000201 s 2024-05-21T14:38:55.892 INFO:teuthology.orchestra.run.smithi078.stdout:ntpd: time slew +0.000201s 2024-05-21T14:38:55.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:55 ntpd[17587]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-21T14:38:55.892 INFO:teuthology.orchestra.run.smithi078.stderr:21 May 14:38:55 ntpd[17587]: can't open /var/log/ntpstats/loopstats.20240521: Permission denied 2024-05-21T14:38:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:55 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:55 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:55 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:55.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:55 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:55.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:55 ntpd[18063]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:55.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:55 ntpd[18063]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:55.998 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2024-05-21T14:38:55.998 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2024-05-21T14:38:55.998 INFO:teuthology.orchestra.run.smithi078.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T14:38:55.998 INFO:teuthology.orchestra.run.smithi078.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T14:38:55.998 INFO:teuthology.orchestra.run.smithi078.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T14:38:55.999 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T14:38:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:56 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:56 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:56 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:56 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:56 ntpd[18063]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T14:38:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:56 ntpd[18063]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T14:38:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:56 ntpd[18063]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T14:38:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:56 ntpd[18063]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T14:38:56.918 INFO:teuthology.orchestra.run.smithi084.stdout:21 May 14:38:56 ntpd[18063]: ntpd: time slew -0.000504 s 2024-05-21T14:38:56.918 INFO:teuthology.orchestra.run.smithi084.stdout:ntpd: time slew -0.000504s 2024-05-21T14:38:56.918 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:56 ntpd[18063]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-21T14:38:56.918 INFO:teuthology.orchestra.run.smithi084.stderr:21 May 14:38:56 ntpd[18063]: can't open /var/log/ntpstats/loopstats.20240521: Permission denied 2024-05-21T14:38:57.064 INFO:teuthology.orchestra.run.smithi084.stdout: remote refid st t when poll reach delay offset jitter 2024-05-21T14:38:57.064 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================== 2024-05-21T14:38:57.064 INFO:teuthology.orchestra.run.smithi084.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T14:38:57.064 INFO:teuthology.orchestra.run.smithi084.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T14:38:57.064 INFO:teuthology.orchestra.run.smithi084.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T14:38:57.064 INFO:teuthology.orchestra.run.smithi084.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T14:38:57.065 INFO:teuthology.run_tasks:Running task install... 2024-05-21T14:38:57.073 DEBUG:teuthology.task.install:project ceph 2024-05-21T14:38:57.073 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'}} 2024-05-21T14:38:57.073 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'} 2024-05-21T14:38:57.073 INFO:teuthology.task.install:Using flavor: default 2024-05-21T14:38:57.079 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-21T14:38:57.079 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-21T14:38:57.080 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-key list | grep Ceph 2024-05-21T14:38:57.080 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-key list | grep Ceph 2024-05-21T14:38:57.167 INFO:teuthology.orchestra.run.smithi084.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-21T14:38:57.182 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-21T14:38:57.194 INFO:teuthology.orchestra.run.smithi084.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-21T14:38:57.195 INFO:teuthology.orchestra.run.smithi084.stdout:uid [ unknown] Ceph.com (release key) 2024-05-21T14:38:57.195 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-21T14:38:57.195 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-21T14:38:57.195 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-21T14:38:57.232 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-21T14:38:57.232 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph.com (release key) 2024-05-21T14:38:57.233 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-21T14:38:57.233 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-21T14:38:57.234 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-21T14:38:57.342 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default/ 2024-05-21T14:38:57.342 INFO:teuthology.task.install.deb:Package version is 19.0.0-2744-gd2b507c7-1jammy 2024-05-21T14:38:57.375 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default/ 2024-05-21T14:38:57.375 INFO:teuthology.task.install.deb:Package version is 19.0.0-2744-gd2b507c7-1jammy 2024-05-21T14:38:57.629 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:38:57.630 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-21T14:38:57.644 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get update 2024-05-21T14:38:57.648 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:38:57.648 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-21T14:38:57.668 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2024-05-21T14:38:57.812 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-21T14:38:57.826 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-21T14:38:57.826 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-21T14:38:57.847 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-21T14:38:57.855 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-21T14:38:57.865 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-21T14:38:57.886 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-21T14:38:57.969 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-21T14:38:58.076 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy InRelease 2024-05-21T14:38:58.132 INFO:teuthology.orchestra.run.smithi084.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy InRelease 2024-05-21T14:38:58.140 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-21T14:38:58.278 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-21T14:38:58.292 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-21T14:38:58.347 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,408 B] 2024-05-21T14:38:58.380 INFO:teuthology.orchestra.run.smithi084.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-21T14:38:58.422 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-05-21T14:38:58.507 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,408 B] 2024-05-21T14:38:58.598 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 28.9 kB in 1s (40.8 kB/s) 2024-05-21T14:38:58.598 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-05-21T14:38:58.695 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 28.9 kB in 1s (33.8 kB/s) 2024-05-21T14:38:59.612 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-05-21T14:38:59.627 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2744-gd2b507c7-1jammy cephadm=19.0.0-2744-gd2b507c7-1jammy ceph-mds=19.0.0-2744-gd2b507c7-1jammy ceph-mgr=19.0.0-2744-gd2b507c7-1jammy ceph-common=19.0.0-2744-gd2b507c7-1jammy ceph-fuse=19.0.0-2744-gd2b507c7-1jammy ceph-test=19.0.0-2744-gd2b507c7-1jammy ceph-volume=19.0.0-2744-gd2b507c7-1jammy radosgw=19.0.0-2744-gd2b507c7-1jammy python3-rados=19.0.0-2744-gd2b507c7-1jammy python3-rgw=19.0.0-2744-gd2b507c7-1jammy python3-cephfs=19.0.0-2744-gd2b507c7-1jammy python3-rbd=19.0.0-2744-gd2b507c7-1jammy libcephfs2=19.0.0-2744-gd2b507c7-1jammy libcephfs-dev=19.0.0-2744-gd2b507c7-1jammy librados2=19.0.0-2744-gd2b507c7-1jammy librbd1=19.0.0-2744-gd2b507c7-1jammy rbd-fuse=19.0.0-2744-gd2b507c7-1jammy python3-cephfs=19.0.0-2744-gd2b507c7-1jammy cephfs-shell=19.0.0-2744-gd2b507c7-1jammy cephfs-top=19.0.0-2744-gd2b507c7-1jammy cephfs-mirror=19.0.0-2744-gd2b507c7-1jammy 2024-05-21T14:38:59.664 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2024-05-21T14:38:59.680 DEBUG:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2744-gd2b507c7-1jammy cephadm=19.0.0-2744-gd2b507c7-1jammy ceph-mds=19.0.0-2744-gd2b507c7-1jammy ceph-mgr=19.0.0-2744-gd2b507c7-1jammy ceph-common=19.0.0-2744-gd2b507c7-1jammy ceph-fuse=19.0.0-2744-gd2b507c7-1jammy ceph-test=19.0.0-2744-gd2b507c7-1jammy ceph-volume=19.0.0-2744-gd2b507c7-1jammy radosgw=19.0.0-2744-gd2b507c7-1jammy python3-rados=19.0.0-2744-gd2b507c7-1jammy python3-rgw=19.0.0-2744-gd2b507c7-1jammy python3-cephfs=19.0.0-2744-gd2b507c7-1jammy python3-rbd=19.0.0-2744-gd2b507c7-1jammy libcephfs2=19.0.0-2744-gd2b507c7-1jammy libcephfs-dev=19.0.0-2744-gd2b507c7-1jammy librados2=19.0.0-2744-gd2b507c7-1jammy librbd1=19.0.0-2744-gd2b507c7-1jammy rbd-fuse=19.0.0-2744-gd2b507c7-1jammy python3-cephfs=19.0.0-2744-gd2b507c7-1jammy cephfs-shell=19.0.0-2744-gd2b507c7-1jammy cephfs-top=19.0.0-2744-gd2b507c7-1jammy cephfs-mirror=19.0.0-2744-gd2b507c7-1jammy 2024-05-21T14:38:59.701 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-05-21T14:38:59.742 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2024-05-21T14:38:59.877 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-05-21T14:38:59.877 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-05-21T14:38:59.943 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2024-05-21T14:38:59.943 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2024-05-21T14:39:00.057 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-05-21T14:39:00.057 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-21T14:39:00.058 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-21T14:39:00.058 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-21T14:39:00.058 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-21T14:39:00.058 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-21T14:39:00.058 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-21T14:39:00.059 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2024-05-21T14:39:00.059 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-21T14:39:00.060 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-21T14:39:00.060 INFO:teuthology.orchestra.run.smithi078.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-21T14:39:00.061 INFO:teuthology.orchestra.run.smithi078.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-21T14:39:00.061 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-21T14:39:00.061 INFO:teuthology.orchestra.run.smithi078.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-21T14:39:00.061 INFO:teuthology.orchestra.run.smithi078.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-21T14:39:00.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-21T14:39:00.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-21T14:39:00.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-21T14:39:00.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-21T14:39:00.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-21T14:39:00.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-21T14:39:00.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-21T14:39:00.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-21T14:39:00.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-21T14:39:00.061 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-21T14:39:00.062 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-21T14:39:00.062 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-21T14:39:00.062 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-21T14:39:00.062 INFO:teuthology.orchestra.run.smithi078.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-21T14:39:00.062 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-21T14:39:00.062 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-21T14:39:00.062 INFO:teuthology.orchestra.run.smithi078.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-21T14:39:00.062 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2024-05-21T14:39:00.063 INFO:teuthology.orchestra.run.smithi078.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-21T14:39:00.063 INFO:teuthology.orchestra.run.smithi078.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-21T14:39:00.063 INFO:teuthology.orchestra.run.smithi078.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-21T14:39:00.063 INFO:teuthology.orchestra.run.smithi078.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-21T14:39:00.063 INFO:teuthology.orchestra.run.smithi078.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-21T14:39:00.063 INFO:teuthology.orchestra.run.smithi078.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-21T14:39:00.063 INFO:teuthology.orchestra.run.smithi078.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-21T14:39:00.063 INFO:teuthology.orchestra.run.smithi078.stdout:Recommended packages: 2024-05-21T14:39:00.063 INFO:teuthology.orchestra.run.smithi078.stdout: btrfs-tools 2024-05-21T14:39:00.139 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages were automatically installed and are no longer required: 2024-05-21T14:39:00.139 INFO:teuthology.orchestra.run.smithi084.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-21T14:39:00.139 INFO:teuthology.orchestra.run.smithi084.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-21T14:39:00.140 INFO:teuthology.orchestra.run.smithi084.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-21T14:39:00.140 INFO:teuthology.orchestra.run.smithi084.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-21T14:39:00.140 INFO:teuthology.orchestra.run.smithi084.stdout: python2.7-minimal 2024-05-21T14:39:00.140 INFO:teuthology.orchestra.run.smithi084.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-21T14:39:00.140 INFO:teuthology.orchestra.run.smithi084.stdout:The following additional packages will be installed: 2024-05-21T14:39:00.141 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-21T14:39:00.141 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-21T14:39:00.141 INFO:teuthology.orchestra.run.smithi084.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-21T14:39:00.141 INFO:teuthology.orchestra.run.smithi084.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-21T14:39:00.142 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-21T14:39:00.142 INFO:teuthology.orchestra.run.smithi084.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-21T14:39:00.142 INFO:teuthology.orchestra.run.smithi084.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-21T14:39:00.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-21T14:39:00.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-21T14:39:00.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-21T14:39:00.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-21T14:39:00.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-21T14:39:00.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-21T14:39:00.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-21T14:39:00.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-21T14:39:00.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-21T14:39:00.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-21T14:39:00.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-21T14:39:00.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-21T14:39:00.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-21T14:39:00.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-21T14:39:00.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-21T14:39:00.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-21T14:39:00.143 INFO:teuthology.orchestra.run.smithi084.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-21T14:39:00.143 INFO:teuthology.orchestra.run.smithi084.stdout:Suggested packages: 2024-05-21T14:39:00.144 INFO:teuthology.orchestra.run.smithi084.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-21T14:39:00.144 INFO:teuthology.orchestra.run.smithi084.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-21T14:39:00.144 INFO:teuthology.orchestra.run.smithi084.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-21T14:39:00.144 INFO:teuthology.orchestra.run.smithi084.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-21T14:39:00.144 INFO:teuthology.orchestra.run.smithi084.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-21T14:39:00.144 INFO:teuthology.orchestra.run.smithi084.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-21T14:39:00.144 INFO:teuthology.orchestra.run.smithi084.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-21T14:39:00.144 INFO:teuthology.orchestra.run.smithi084.stdout:Recommended packages: 2024-05-21T14:39:00.144 INFO:teuthology.orchestra.run.smithi084.stdout: btrfs-tools 2024-05-21T14:39:00.211 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2024-05-21T14:39:00.212 INFO:teuthology.orchestra.run.smithi078.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-21T14:39:00.212 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-21T14:39:00.212 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-21T14:39:00.212 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-21T14:39:00.213 INFO:teuthology.orchestra.run.smithi078.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-21T14:39:00.214 INFO:teuthology.orchestra.run.smithi078.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-21T14:39:00.214 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-21T14:39:00.214 INFO:teuthology.orchestra.run.smithi078.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-21T14:39:00.214 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-21T14:39:00.214 INFO:teuthology.orchestra.run.smithi078.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-21T14:39:00.214 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-21T14:39:00.214 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-21T14:39:00.214 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-21T14:39:00.214 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-21T14:39:00.214 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-21T14:39:00.214 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-21T14:39:00.214 INFO:teuthology.orchestra.run.smithi078.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-21T14:39:00.214 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-21T14:39:00.215 INFO:teuthology.orchestra.run.smithi078.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-21T14:39:00.215 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-21T14:39:00.215 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-21T14:39:00.215 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-21T14:39:00.215 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-21T14:39:00.215 INFO:teuthology.orchestra.run.smithi078.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-21T14:39:00.215 INFO:teuthology.orchestra.run.smithi078.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-21T14:39:00.215 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-21T14:39:00.215 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-21T14:39:00.215 INFO:teuthology.orchestra.run.smithi078.stdout: socat unzip xmlstarlet zip 2024-05-21T14:39:00.247 INFO:teuthology.orchestra.run.smithi084.stdout:The following NEW packages will be installed: 2024-05-21T14:39:00.247 INFO:teuthology.orchestra.run.smithi084.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-21T14:39:00.247 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-21T14:39:00.247 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-21T14:39:00.247 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-21T14:39:00.248 INFO:teuthology.orchestra.run.smithi084.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-21T14:39:00.248 INFO:teuthology.orchestra.run.smithi084.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-21T14:39:00.248 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-21T14:39:00.248 INFO:teuthology.orchestra.run.smithi084.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-21T14:39:00.249 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-21T14:39:00.249 INFO:teuthology.orchestra.run.smithi084.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-21T14:39:00.249 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-21T14:39:00.249 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-21T14:39:00.249 INFO:teuthology.orchestra.run.smithi084.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-21T14:39:00.249 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-21T14:39:00.249 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-21T14:39:00.249 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-21T14:39:00.249 INFO:teuthology.orchestra.run.smithi084.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-21T14:39:00.249 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-21T14:39:00.249 INFO:teuthology.orchestra.run.smithi084.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-21T14:39:00.249 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-21T14:39:00.249 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-21T14:39:00.249 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-21T14:39:00.250 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-21T14:39:00.250 INFO:teuthology.orchestra.run.smithi084.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-21T14:39:00.250 INFO:teuthology.orchestra.run.smithi084.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-21T14:39:00.250 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-21T14:39:00.250 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-21T14:39:00.250 INFO:teuthology.orchestra.run.smithi084.stdout: socat unzip xmlstarlet zip 2024-05-21T14:39:00.313 INFO:teuthology.orchestra.run.smithi084.stdout:0 upgraded, 124 newly installed, 0 to remove and 310 not upgraded. 2024-05-21T14:39:00.313 INFO:teuthology.orchestra.run.smithi084.stdout:Need to get 180 MB of archives. 2024-05-21T14:39:00.313 INFO:teuthology.orchestra.run.smithi084.stdout:After this operation, 905 MB of additional disk space will be used. 2024-05-21T14:39:00.313 INFO:teuthology.orchestra.run.smithi084.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-21T14:39:00.334 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-21T14:39:00.346 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-21T14:39:00.395 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-21T14:39:00.410 INFO:teuthology.orchestra.run.smithi078.stdout:0 upgraded, 124 newly installed, 0 to remove and 310 not upgraded. 2024-05-21T14:39:00.410 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 180 MB of archives. 2024-05-21T14:39:00.410 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 905 MB of additional disk space will be used. 2024-05-21T14:39:00.410 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-21T14:39:00.421 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-21T14:39:00.424 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-21T14:39:00.437 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-21T14:39:00.490 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-21T14:39:00.493 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-21T14:39:00.494 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-21T14:39:00.505 INFO:teuthology.orchestra.run.smithi084.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-21T14:39:00.509 INFO:teuthology.orchestra.run.smithi084.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-21T14:39:00.510 INFO:teuthology.orchestra.run.smithi084.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-21T14:39:00.520 INFO:teuthology.orchestra.run.smithi084.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-21T14:39:00.522 INFO:teuthology.orchestra.run.smithi084.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-21T14:39:00.525 INFO:teuthology.orchestra.run.smithi084.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-21T14:39:00.526 INFO:teuthology.orchestra.run.smithi084.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-21T14:39:00.532 INFO:teuthology.orchestra.run.smithi084.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-21T14:39:00.538 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-21T14:39:00.548 INFO:teuthology.orchestra.run.smithi084.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-21T14:39:00.550 INFO:teuthology.orchestra.run.smithi084.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-21T14:39:00.552 INFO:teuthology.orchestra.run.smithi084.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-21T14:39:00.553 INFO:teuthology.orchestra.run.smithi084.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-21T14:39:00.553 INFO:teuthology.orchestra.run.smithi084.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-21T14:39:00.555 INFO:teuthology.orchestra.run.smithi084.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-21T14:39:00.555 INFO:teuthology.orchestra.run.smithi084.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-21T14:39:00.555 INFO:teuthology.orchestra.run.smithi084.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-21T14:39:00.556 INFO:teuthology.orchestra.run.smithi084.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-21T14:39:00.575 INFO:teuthology.orchestra.run.smithi084.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-21T14:39:00.575 INFO:teuthology.orchestra.run.smithi084.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-21T14:39:00.576 INFO:teuthology.orchestra.run.smithi084.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-21T14:39:00.595 INFO:teuthology.orchestra.run.smithi084.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-21T14:39:00.596 INFO:teuthology.orchestra.run.smithi084.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-21T14:39:00.597 INFO:teuthology.orchestra.run.smithi084.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-21T14:39:00.598 INFO:teuthology.orchestra.run.smithi084.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-21T14:39:00.600 INFO:teuthology.orchestra.run.smithi084.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-21T14:39:00.600 INFO:teuthology.orchestra.run.smithi084.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-21T14:39:00.601 INFO:teuthology.orchestra.run.smithi084.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-21T14:39:00.616 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2744-gd2b507c7-1jammy [3,508 kB] 2024-05-21T14:39:00.617 INFO:teuthology.orchestra.run.smithi084.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-21T14:39:00.619 INFO:teuthology.orchestra.run.smithi084.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-21T14:39:00.620 INFO:teuthology.orchestra.run.smithi084.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-21T14:39:00.641 INFO:teuthology.orchestra.run.smithi084.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-21T14:39:00.642 INFO:teuthology.orchestra.run.smithi084.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-21T14:39:00.643 INFO:teuthology.orchestra.run.smithi084.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-21T14:39:00.644 INFO:teuthology.orchestra.run.smithi084.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-21T14:39:00.646 INFO:teuthology.orchestra.run.smithi084.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-21T14:39:00.649 INFO:teuthology.orchestra.run.smithi084.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-21T14:39:00.651 INFO:teuthology.orchestra.run.smithi084.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-21T14:39:00.672 INFO:teuthology.orchestra.run.smithi084.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-21T14:39:00.673 INFO:teuthology.orchestra.run.smithi084.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-21T14:39:00.677 INFO:teuthology.orchestra.run.smithi084.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-21T14:39:00.700 INFO:teuthology.orchestra.run.smithi084.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-21T14:39:00.701 INFO:teuthology.orchestra.run.smithi084.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-21T14:39:00.707 INFO:teuthology.orchestra.run.smithi084.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-21T14:39:00.741 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-21T14:39:00.769 INFO:teuthology.orchestra.run.smithi084.stdout:Get:53 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2744-gd2b507c7-1jammy [3,508 kB] 2024-05-21T14:39:00.806 INFO:teuthology.orchestra.run.smithi084.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-21T14:39:00.808 INFO:teuthology.orchestra.run.smithi084.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-21T14:39:00.810 INFO:teuthology.orchestra.run.smithi084.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-21T14:39:00.811 INFO:teuthology.orchestra.run.smithi084.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-21T14:39:00.813 INFO:teuthology.orchestra.run.smithi084.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-21T14:39:00.834 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-21T14:39:00.848 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-21T14:39:00.887 INFO:teuthology.orchestra.run.smithi084.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-21T14:39:00.891 INFO:teuthology.orchestra.run.smithi084.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-21T14:39:00.892 INFO:teuthology.orchestra.run.smithi084.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-21T14:39:00.900 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-21T14:39:00.918 INFO:teuthology.orchestra.run.smithi084.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-21T14:39:00.918 INFO:teuthology.orchestra.run.smithi084.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-21T14:39:00.920 INFO:teuthology.orchestra.run.smithi084.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-21T14:39:00.920 INFO:teuthology.orchestra.run.smithi084.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-21T14:39:00.921 INFO:teuthology.orchestra.run.smithi084.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-21T14:39:00.922 INFO:teuthology.orchestra.run.smithi084.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-21T14:39:00.923 INFO:teuthology.orchestra.run.smithi084.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-21T14:39:00.934 INFO:teuthology.orchestra.run.smithi084.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-21T14:39:00.939 INFO:teuthology.orchestra.run.smithi084.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-21T14:39:00.954 INFO:teuthology.orchestra.run.smithi084.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-21T14:39:00.956 INFO:teuthology.orchestra.run.smithi084.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-21T14:39:00.958 INFO:teuthology.orchestra.run.smithi084.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-21T14:39:00.963 INFO:teuthology.orchestra.run.smithi084.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-21T14:39:00.967 INFO:teuthology.orchestra.run.smithi084.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-21T14:39:00.968 INFO:teuthology.orchestra.run.smithi084.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-21T14:39:00.969 INFO:teuthology.orchestra.run.smithi084.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-21T14:39:00.970 INFO:teuthology.orchestra.run.smithi084.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-21T14:39:00.980 INFO:teuthology.orchestra.run.smithi084.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-21T14:39:00.981 INFO:teuthology.orchestra.run.smithi084.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-21T14:39:01.000 INFO:teuthology.orchestra.run.smithi084.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-21T14:39:01.001 INFO:teuthology.orchestra.run.smithi084.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-21T14:39:01.002 INFO:teuthology.orchestra.run.smithi084.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-21T14:39:01.002 INFO:teuthology.orchestra.run.smithi084.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-21T14:39:01.005 INFO:teuthology.orchestra.run.smithi084.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-21T14:39:01.006 INFO:teuthology.orchestra.run.smithi084.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-21T14:39:01.016 INFO:teuthology.orchestra.run.smithi084.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-21T14:39:01.016 INFO:teuthology.orchestra.run.smithi084.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-21T14:39:01.021 INFO:teuthology.orchestra.run.smithi084.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-21T14:39:01.024 INFO:teuthology.orchestra.run.smithi084.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-21T14:39:01.041 INFO:teuthology.orchestra.run.smithi084.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-21T14:39:01.074 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-21T14:39:01.083 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-21T14:39:01.114 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-21T14:39:01.122 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-21T14:39:01.287 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-21T14:39:01.869 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-21T14:39:01.885 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-21T14:39:01.900 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-21T14:39:01.909 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-21T14:39:01.910 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-21T14:39:01.926 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-21T14:39:01.965 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-21T14:39:01.977 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-21T14:39:01.980 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-21T14:39:01.981 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-21T14:39:02.151 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-21T14:39:02.234 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-21T14:39:02.257 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-21T14:39:02.315 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-21T14:39:02.363 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-21T14:39:02.384 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-21T14:39:02.406 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-21T14:39:02.580 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-21T14:39:02.596 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-21T14:39:02.603 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-21T14:39:02.608 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-21T14:39:02.793 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-21T14:39:02.876 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-21T14:39:02.891 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-21T14:39:03.077 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-21T14:39:03.129 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-21T14:39:03.141 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-21T14:39:03.299 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-21T14:39:03.299 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-21T14:39:03.304 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-21T14:39:03.309 INFO:teuthology.orchestra.run.smithi078.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-21T14:39:03.323 INFO:teuthology.orchestra.run.smithi078.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-21T14:39:03.508 INFO:teuthology.orchestra.run.smithi078.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-21T14:39:03.576 INFO:teuthology.orchestra.run.smithi078.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2744-gd2b507c7-1jammy [3,279 kB] 2024-05-21T14:39:03.760 INFO:teuthology.orchestra.run.smithi078.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-21T14:39:03.892 INFO:teuthology.orchestra.run.smithi078.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-21T14:39:03.936 INFO:teuthology.orchestra.run.smithi078.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-21T14:39:04.026 INFO:teuthology.orchestra.run.smithi078.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-21T14:39:04.036 INFO:teuthology.orchestra.run.smithi078.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-21T14:39:04.048 INFO:teuthology.orchestra.run.smithi078.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-21T14:39:04.093 INFO:teuthology.orchestra.run.smithi078.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-21T14:39:04.128 INFO:teuthology.orchestra.run.smithi084.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2744-gd2b507c7-1jammy [3,279 kB] 2024-05-21T14:39:04.357 INFO:teuthology.orchestra.run.smithi078.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-21T14:39:04.358 INFO:teuthology.orchestra.run.smithi078.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-21T14:39:04.359 INFO:teuthology.orchestra.run.smithi078.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-21T14:39:04.524 INFO:teuthology.orchestra.run.smithi078.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-21T14:39:04.864 INFO:teuthology.orchestra.run.smithi078.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-21T14:39:05.131 INFO:teuthology.orchestra.run.smithi078.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2744-gd2b507c7-1jammy [726 kB] 2024-05-21T14:39:05.248 INFO:teuthology.orchestra.run.smithi078.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2744-gd2b507c7-1jammy [357 kB] 2024-05-21T14:39:05.268 INFO:teuthology.orchestra.run.smithi078.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-21T14:39:05.269 INFO:teuthology.orchestra.run.smithi084.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2744-gd2b507c7-1jammy [726 kB] 2024-05-21T14:39:05.276 INFO:teuthology.orchestra.run.smithi078.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-21T14:39:05.277 INFO:teuthology.orchestra.run.smithi078.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-21T14:39:05.348 INFO:teuthology.orchestra.run.smithi078.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-21T14:39:05.348 INFO:teuthology.orchestra.run.smithi078.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-21T14:39:05.349 INFO:teuthology.orchestra.run.smithi078.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-21T14:39:05.349 INFO:teuthology.orchestra.run.smithi078.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-21T14:39:05.350 INFO:teuthology.orchestra.run.smithi078.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-21T14:39:05.351 INFO:teuthology.orchestra.run.smithi078.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-21T14:39:05.363 INFO:teuthology.orchestra.run.smithi078.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2744-gd2b507c7-1jammy [32.8 kB] 2024-05-21T14:39:05.365 INFO:teuthology.orchestra.run.smithi078.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2744-gd2b507c7-1jammy [180 kB] 2024-05-21T14:39:05.424 INFO:teuthology.orchestra.run.smithi078.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2744-gd2b507c7-1jammy [67.1 kB] 2024-05-21T14:39:05.475 INFO:teuthology.orchestra.run.smithi078.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2744-gd2b507c7-1jammy [334 kB] 2024-05-21T14:39:05.516 INFO:teuthology.orchestra.run.smithi078.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-21T14:39:05.555 INFO:teuthology.orchestra.run.smithi078.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2744-gd2b507c7-1jammy [7,068 kB] 2024-05-21T14:39:05.560 INFO:teuthology.orchestra.run.smithi084.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2744-gd2b507c7-1jammy [357 kB] 2024-05-21T14:39:05.653 INFO:teuthology.orchestra.run.smithi084.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2744-gd2b507c7-1jammy [32.8 kB] 2024-05-21T14:39:05.654 INFO:teuthology.orchestra.run.smithi084.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2744-gd2b507c7-1jammy [180 kB] 2024-05-21T14:39:05.727 INFO:teuthology.orchestra.run.smithi078.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-21T14:39:05.740 INFO:teuthology.orchestra.run.smithi084.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2744-gd2b507c7-1jammy [67.1 kB] 2024-05-21T14:39:05.745 INFO:teuthology.orchestra.run.smithi084.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2744-gd2b507c7-1jammy [334 kB] 2024-05-21T14:39:05.901 INFO:teuthology.orchestra.run.smithi084.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2744-gd2b507c7-1jammy [7,068 kB] 2024-05-21T14:39:06.054 INFO:teuthology.orchestra.run.smithi078.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-21T14:39:06.101 INFO:teuthology.orchestra.run.smithi078.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-21T14:39:06.128 INFO:teuthology.orchestra.run.smithi078.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-21T14:39:06.137 INFO:teuthology.orchestra.run.smithi078.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-21T14:39:06.184 INFO:teuthology.orchestra.run.smithi078.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-21T14:39:06.209 INFO:teuthology.orchestra.run.smithi078.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-21T14:39:06.212 INFO:teuthology.orchestra.run.smithi078.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-21T14:39:06.218 INFO:teuthology.orchestra.run.smithi078.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-21T14:39:06.221 INFO:teuthology.orchestra.run.smithi078.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-21T14:39:06.417 INFO:teuthology.orchestra.run.smithi078.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-21T14:39:06.675 INFO:teuthology.orchestra.run.smithi078.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-21T14:39:06.937 INFO:teuthology.orchestra.run.smithi078.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-21T14:39:06.940 INFO:teuthology.orchestra.run.smithi078.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-21T14:39:06.956 INFO:teuthology.orchestra.run.smithi078.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-21T14:39:06.961 INFO:teuthology.orchestra.run.smithi078.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-21T14:39:06.999 INFO:teuthology.orchestra.run.smithi078.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-21T14:39:07.013 INFO:teuthology.orchestra.run.smithi078.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-21T14:39:07.104 INFO:teuthology.orchestra.run.smithi078.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-21T14:39:07.105 INFO:teuthology.orchestra.run.smithi078.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-21T14:39:07.107 INFO:teuthology.orchestra.run.smithi078.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-21T14:39:07.287 INFO:teuthology.orchestra.run.smithi078.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-21T14:39:07.560 INFO:teuthology.orchestra.run.smithi078.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-21T14:39:08.144 INFO:teuthology.orchestra.run.smithi084.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2744-gd2b507c7-1jammy [112 kB] 2024-05-21T14:39:08.147 INFO:teuthology.orchestra.run.smithi084.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2744-gd2b507c7-1jammy [471 kB] 2024-05-21T14:39:08.266 INFO:teuthology.orchestra.run.smithi084.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2744-gd2b507c7-1jammy [25.3 MB] 2024-05-21T14:39:08.764 INFO:teuthology.orchestra.run.smithi078.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2744-gd2b507c7-1jammy [112 kB] 2024-05-21T14:39:08.765 INFO:teuthology.orchestra.run.smithi078.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2744-gd2b507c7-1jammy [471 kB] 2024-05-21T14:39:09.044 INFO:teuthology.orchestra.run.smithi078.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2744-gd2b507c7-1jammy [25.3 MB] 2024-05-21T14:39:18.432 INFO:teuthology.orchestra.run.smithi084.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2744-gd2b507c7-1jammy [4,905 kB] 2024-05-21T14:39:19.684 INFO:teuthology.orchestra.run.smithi078.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2744-gd2b507c7-1jammy [4,905 kB] 2024-05-21T14:39:19.879 INFO:teuthology.orchestra.run.smithi084.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2744-gd2b507c7-1jammy [244 kB] 2024-05-21T14:39:19.954 INFO:teuthology.orchestra.run.smithi084.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2744-gd2b507c7-1jammy [125 kB] 2024-05-21T14:39:19.966 INFO:teuthology.orchestra.run.smithi084.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2744-gd2b507c7-1jammy [1,519 kB] 2024-05-21T14:39:20.494 INFO:teuthology.orchestra.run.smithi084.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2744-gd2b507c7-1jammy [6,135 kB] 2024-05-21T14:39:20.806 INFO:teuthology.orchestra.run.smithi078.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2744-gd2b507c7-1jammy [244 kB] 2024-05-21T14:39:20.859 INFO:teuthology.orchestra.run.smithi078.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2744-gd2b507c7-1jammy [125 kB] 2024-05-21T14:39:20.897 INFO:teuthology.orchestra.run.smithi078.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2744-gd2b507c7-1jammy [1,519 kB] 2024-05-21T14:39:21.237 INFO:teuthology.orchestra.run.smithi078.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2744-gd2b507c7-1jammy [6,135 kB] 2024-05-21T14:39:22.184 INFO:teuthology.orchestra.run.smithi084.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2744-gd2b507c7-1jammy [22.5 MB] 2024-05-21T14:39:22.189 INFO:teuthology.orchestra.run.smithi078.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2744-gd2b507c7-1jammy [22.5 MB] 2024-05-21T14:39:25.505 INFO:teuthology.orchestra.run.smithi078.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2744-gd2b507c7-1jammy [14.1 kB] 2024-05-21T14:39:25.506 INFO:teuthology.orchestra.run.smithi078.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2744-gd2b507c7-1jammy [857 kB] 2024-05-21T14:39:26.759 INFO:teuthology.orchestra.run.smithi078.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2744-gd2b507c7-1jammy [2,366 kB] 2024-05-21T14:39:27.086 INFO:teuthology.orchestra.run.smithi078.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2744-gd2b507c7-1jammy [791 kB] 2024-05-21T14:39:27.205 INFO:teuthology.orchestra.run.smithi078.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2744-gd2b507c7-1jammy [148 kB] 2024-05-21T14:39:27.247 INFO:teuthology.orchestra.run.smithi078.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2744-gd2b507c7-1jammy [2,324 kB] 2024-05-21T14:39:27.608 INFO:teuthology.orchestra.run.smithi078.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2744-gd2b507c7-1jammy [8,625 kB] 2024-05-21T14:39:28.199 INFO:teuthology.orchestra.run.smithi084.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2744-gd2b507c7-1jammy [14.1 kB] 2024-05-21T14:39:28.200 INFO:teuthology.orchestra.run.smithi084.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2744-gd2b507c7-1jammy [857 kB] 2024-05-21T14:39:28.277 INFO:teuthology.orchestra.run.smithi084.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2744-gd2b507c7-1jammy [2,366 kB] 2024-05-21T14:39:28.775 INFO:teuthology.orchestra.run.smithi084.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2744-gd2b507c7-1jammy [791 kB] 2024-05-21T14:39:28.944 INFO:teuthology.orchestra.run.smithi084.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2744-gd2b507c7-1jammy [148 kB] 2024-05-21T14:39:29.003 INFO:teuthology.orchestra.run.smithi084.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2744-gd2b507c7-1jammy [2,324 kB] 2024-05-21T14:39:29.302 INFO:teuthology.orchestra.run.smithi078.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2744-gd2b507c7-1jammy [14.2 kB] 2024-05-21T14:39:29.303 INFO:teuthology.orchestra.run.smithi078.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2744-gd2b507c7-1jammy [50.5 MB] 2024-05-21T14:39:29.511 INFO:teuthology.orchestra.run.smithi084.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2744-gd2b507c7-1jammy [8,625 kB] 2024-05-21T14:39:31.560 INFO:teuthology.orchestra.run.smithi084.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2744-gd2b507c7-1jammy [14.2 kB] 2024-05-21T14:39:31.560 INFO:teuthology.orchestra.run.smithi084.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2744-gd2b507c7-1jammy [50.5 MB] 2024-05-21T14:39:37.969 INFO:teuthology.orchestra.run.smithi078.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2744-gd2b507c7-1jammy [121 kB] 2024-05-21T14:39:38.000 INFO:teuthology.orchestra.run.smithi078.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2744-gd2b507c7-1jammy [232 kB] 2024-05-21T14:39:38.015 INFO:teuthology.orchestra.run.smithi078.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2744-gd2b507c7-1jammy [34.0 kB] 2024-05-21T14:39:38.036 INFO:teuthology.orchestra.run.smithi078.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2744-gd2b507c7-1jammy [23.4 kB] 2024-05-21T14:39:38.038 INFO:teuthology.orchestra.run.smithi078.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2744-gd2b507c7-1jammy [38.9 kB] 2024-05-21T14:39:38.040 INFO:teuthology.orchestra.run.smithi078.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2744-gd2b507c7-1jammy [13.9 MB] 2024-05-21T14:39:40.851 INFO:teuthology.orchestra.run.smithi078.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2744-gd2b507c7-1jammy [92.8 kB] 2024-05-21T14:39:41.520 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 180 MB in 41s (4,419 kB/s) 2024-05-21T14:39:41.688 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-21T14:39:41.756 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-05-21T14:39:41.759 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-21T14:39:41.803 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-21T14:39:42.097 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-21T14:39:42.110 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-21T14:39:42.147 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-21T14:39:42.458 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cmd2. 2024-05-21T14:39:42.471 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-21T14:39:42.508 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-21T14:39:42.863 INFO:teuthology.orchestra.run.smithi084.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2744-gd2b507c7-1jammy [121 kB] 2024-05-21T14:39:42.866 INFO:teuthology.orchestra.run.smithi084.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2744-gd2b507c7-1jammy [232 kB] 2024-05-21T14:39:42.869 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-21T14:39:42.870 INFO:teuthology.orchestra.run.smithi084.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2744-gd2b507c7-1jammy [34.0 kB] 2024-05-21T14:39:42.871 INFO:teuthology.orchestra.run.smithi084.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2744-gd2b507c7-1jammy [23.4 kB] 2024-05-21T14:39:42.872 INFO:teuthology.orchestra.run.smithi084.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2744-gd2b507c7-1jammy [38.9 kB] 2024-05-21T14:39:42.873 INFO:teuthology.orchestra.run.smithi084.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2744-gd2b507c7-1jammy [13.9 MB] 2024-05-21T14:39:42.883 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-21T14:39:42.969 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-21T14:39:43.339 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-21T14:39:43.353 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-21T14:39:43.398 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-21T14:39:43.742 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-21T14:39:43.755 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-21T14:39:43.800 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-21T14:39:44.329 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-21T14:39:44.343 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T14:39:44.394 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T14:39:44.815 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-21T14:39:44.829 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T14:39:44.865 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T14:39:45.201 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-21T14:39:45.215 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T14:39:45.259 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T14:39:45.629 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-21T14:39:45.643 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-21T14:39:45.688 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-21T14:39:45.900 INFO:teuthology.orchestra.run.smithi084.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2744-gd2b507c7-1jammy [92.8 kB] 2024-05-21T14:39:46.007 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librados2. 2024-05-21T14:39:46.021 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../010-librados2_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:46.066 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librados2 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:46.531 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 180 MB in 46s (3,933 kB/s) 2024-05-21T14:39:46.676 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-21T14:39:46.684 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librbd1. 2024-05-21T14:39:46.698 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../011-librbd1_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:46.743 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librbd1 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:46.755 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-05-21T14:39:46.759 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-21T14:39:46.800 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-21T14:39:47.094 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-21T14:39:47.114 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-21T14:39:47.152 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-21T14:39:47.189 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs2. 2024-05-21T14:39:47.203 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:47.247 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs2 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:47.472 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cmd2. 2024-05-21T14:39:47.492 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-21T14:39:47.530 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-21T14:39:47.542 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rados. 2024-05-21T14:39:47.555 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:47.617 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rados (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:47.866 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-21T14:39:47.887 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-21T14:39:47.936 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-21T14:39:47.950 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:39:47.958 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-21T14:39:47.994 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-argparse (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:48.245 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-21T14:39:48.247 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cephfs. 2024-05-21T14:39:48.257 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-21T14:39:48.261 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:48.287 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-21T14:39:48.305 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cephfs (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:48.600 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-21T14:39:48.614 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:39:48.614 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-21T14:39:48.637 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-21T14:39:48.650 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-common (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:48.673 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-21T14:39:48.953 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-prettytable. 2024-05-21T14:39:48.967 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-21T14:39:49.011 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-21T14:39:49.118 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-21T14:39:49.139 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T14:39:49.184 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T14:39:49.297 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rbd. 2024-05-21T14:39:49.312 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:49.356 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rbd (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:49.523 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-21T14:39:49.541 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T14:39:49.571 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T14:39:49.701 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-21T14:39:49.715 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-21T14:39:49.759 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-21T14:39:49.941 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-21T14:39:49.961 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T14:39:50.020 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-21T14:39:50.024 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T14:39:50.034 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-21T14:39:50.095 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-21T14:39:50.361 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-21T14:39:50.382 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-21T14:39:50.398 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-21T14:39:50.412 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-21T14:39:50.419 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-21T14:39:50.456 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-21T14:39:50.747 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librados2. 2024-05-21T14:39:50.767 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../010-librados2_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:50.784 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua5.1. 2024-05-21T14:39:50.799 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-21T14:39:50.804 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librados2 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:50.859 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-21T14:39:51.165 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-any. 2024-05-21T14:39:51.179 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-21T14:39:51.221 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-21T14:39:51.474 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package zip. 2024-05-21T14:39:51.488 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-21T14:39:51.532 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking zip (3.0-12build2) ... 2024-05-21T14:39:51.532 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librbd1. 2024-05-21T14:39:51.554 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../011-librbd1_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:51.591 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librbd1 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:51.885 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package unzip. 2024-05-21T14:39:51.900 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-21T14:39:51.943 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-21T14:39:52.052 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libcephfs2. 2024-05-21T14:39:52.073 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:52.102 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libcephfs2 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:52.346 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rados. 2024-05-21T14:39:52.358 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:52.421 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rados (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:52.447 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package luarocks. 2024-05-21T14:39:52.462 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-21T14:39:52.514 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-21T14:39:52.748 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-21T14:39:52.769 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:39:52.807 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-ceph-argparse (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:52.964 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librgw2. 2024-05-21T14:39:52.978 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../027-librgw2_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:53.030 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librgw2 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:53.068 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cephfs. 2024-05-21T14:39:53.088 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:53.134 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cephfs (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:53.612 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-21T14:39:53.633 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:39:53.666 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rgw. 2024-05-21T14:39:53.670 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-ceph-common (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:53.680 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:53.725 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rgw (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:54.057 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-prettytable. 2024-05-21T14:39:54.078 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-21T14:39:54.086 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-21T14:39:54.100 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-21T14:39:54.123 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-21T14:39:54.145 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-21T14:39:54.426 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rbd. 2024-05-21T14:39:54.439 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libradosstriper1. 2024-05-21T14:39:54.450 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:54.454 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:54.484 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rbd (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:54.506 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libradosstriper1 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:54.895 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-21T14:39:54.916 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-21T14:39:54.962 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-21T14:39:54.992 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-common. 2024-05-21T14:39:55.007 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:55.051 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-common (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:55.273 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-21T14:39:55.294 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-21T14:39:55.339 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-21T14:39:55.709 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-21T14:39:55.721 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-21T14:39:55.767 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-21T14:39:56.095 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package lua5.1. 2024-05-21T14:39:56.116 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-21T14:39:56.162 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-21T14:39:56.181 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-base. 2024-05-21T14:39:56.196 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:56.282 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-base (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:56.532 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package lua-any. 2024-05-21T14:39:56.552 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-21T14:39:56.598 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-21T14:39:57.059 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package zip. 2024-05-21T14:39:57.071 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-21T14:39:57.094 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-21T14:39:57.109 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-21T14:39:57.119 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking zip (3.0-12build2) ... 2024-05-21T14:39:57.152 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-21T14:39:57.462 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package unzip. 2024-05-21T14:39:57.464 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cheroot. 2024-05-21T14:39:57.479 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-21T14:39:57.483 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-21T14:39:57.520 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-21T14:39:57.522 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-21T14:39:57.917 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-21T14:39:57.932 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-21T14:39:57.975 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-21T14:39:57.982 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package luarocks. 2024-05-21T14:39:58.003 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-21T14:39:58.058 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-21T14:39:58.295 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-21T14:39:58.309 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-21T14:39:58.361 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-21T14:39:58.432 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librgw2. 2024-05-21T14:39:58.453 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../027-librgw2_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:58.490 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librgw2 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:58.757 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-21T14:39:58.771 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-21T14:39:58.823 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-21T14:39:59.109 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rgw. 2024-05-21T14:39:59.121 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:59.159 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rgw (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:39:59.193 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempora. 2024-05-21T14:39:59.207 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-21T14:39:59.259 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-21T14:39:59.512 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-21T14:39:59.533 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-21T14:39:59.570 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-21T14:39:59.654 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-portend. 2024-05-21T14:39:59.668 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-21T14:39:59.720 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-21T14:39:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libradosstriper1. 2024-05-21T14:39:59.902 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:39:59.939 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libradosstriper1 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:00.141 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-21T14:40:00.155 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-21T14:40:00.224 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-21T14:40:00.301 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-common. 2024-05-21T14:40:00.322 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:00.351 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-common (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:00.543 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-21T14:40:00.557 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-21T14:40:00.601 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-21T14:40:00.963 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-natsort. 2024-05-21T14:40:00.977 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-21T14:40:01.022 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-21T14:40:01.333 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-logutils. 2024-05-21T14:40:01.347 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-21T14:40:01.392 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-21T14:40:01.711 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-21T14:40:01.730 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-21T14:40:01.770 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-21T14:40:01.857 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-base. 2024-05-21T14:40:01.877 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:01.926 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-base (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:02.035 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-mako. 2024-05-21T14:40:02.046 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-21T14:40:02.089 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-21T14:40:02.401 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-21T14:40:02.416 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-21T14:40:02.468 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-21T14:40:02.702 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-21T14:40:02.713 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-21T14:40:02.743 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-21T14:40:02.753 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-21T14:40:02.768 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-21T14:40:02.812 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-21T14:40:03.013 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cheroot. 2024-05-21T14:40:03.033 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-21T14:40:03.096 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-21T14:40:03.115 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webob. 2024-05-21T14:40:03.129 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-21T14:40:03.195 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-21T14:40:03.424 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-21T14:40:03.445 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-21T14:40:03.482 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-21T14:40:03.526 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-waitress. 2024-05-21T14:40:03.541 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-21T14:40:03.587 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-21T14:40:03.785 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-21T14:40:03.806 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-21T14:40:03.843 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-21T14:40:03.896 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempita. 2024-05-21T14:40:03.910 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-21T14:40:03.987 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-21T14:40:04.121 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-21T14:40:04.141 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-21T14:40:04.179 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-21T14:40:04.232 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-paste. 2024-05-21T14:40:04.247 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-21T14:40:04.282 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-21T14:40:04.457 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-tempora. 2024-05-21T14:40:04.478 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-21T14:40:04.515 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-21T14:40:04.585 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-21T14:40:04.600 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-21T14:40:04.644 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-21T14:40:04.810 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-portend. 2024-05-21T14:40:04.830 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-21T14:40:04.868 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-21T14:40:04.971 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-21T14:40:04.986 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-21T14:40:05.030 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-21T14:40:05.171 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-21T14:40:05.191 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-21T14:40:05.229 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-21T14:40:05.333 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webtest. 2024-05-21T14:40:05.348 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-21T14:40:05.391 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-21T14:40:05.515 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-21T14:40:05.535 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-21T14:40:05.573 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-21T14:40:05.702 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pecan. 2024-05-21T14:40:05.716 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-21T14:40:05.761 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-21T14:40:05.910 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-natsort. 2024-05-21T14:40:05.931 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-21T14:40:05.968 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-21T14:40:06.091 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-certifi. 2024-05-21T14:40:06.105 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-21T14:40:06.141 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-21T14:40:06.280 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-logutils. 2024-05-21T14:40:06.301 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-21T14:40:06.338 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-21T14:40:06.494 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-idna. 2024-05-21T14:40:06.508 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-05-21T14:40:06.552 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-21T14:40:06.599 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-21T14:40:06.620 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-21T14:40:06.648 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-21T14:40:06.855 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-urllib3. 2024-05-21T14:40:06.870 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-21T14:40:06.913 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-21T14:40:06.918 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-mako. 2024-05-21T14:40:06.940 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-21T14:40:06.976 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-21T14:40:07.267 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests. 2024-05-21T14:40:07.281 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-21T14:40:07.288 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-21T14:40:07.309 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-21T14:40:07.325 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-21T14:40:07.346 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-21T14:40:07.637 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-21T14:40:07.651 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-21T14:40:07.674 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-21T14:40:07.695 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-21T14:40:07.695 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-21T14:40:07.732 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-21T14:40:08.002 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-webob. 2024-05-21T14:40:08.023 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-21T14:40:08.031 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-21T14:40:08.045 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:40:08.051 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-21T14:40:08.089 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:08.354 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-waitress. 2024-05-21T14:40:08.376 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-21T14:40:08.407 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-21T14:40:08.436 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-21T14:40:08.450 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:08.494 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:08.665 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-tempita. 2024-05-21T14:40:08.687 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-21T14:40:08.724 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-21T14:40:08.839 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-21T14:40:08.853 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-21T14:40:08.897 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-21T14:40:09.026 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-paste. 2024-05-21T14:40:09.047 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-21T14:40:09.085 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-21T14:40:09.208 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-openssl. 2024-05-21T14:40:09.223 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-21T14:40:09.267 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-21T14:40:09.421 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-21T14:40:09.442 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-21T14:40:09.488 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-21T14:40:09.628 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr. 2024-05-21T14:40:09.643 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:09.678 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:09.740 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-21T14:40:09.752 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-21T14:40:09.790 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-21T14:40:10.057 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mon. 2024-05-21T14:40:10.071 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:10.077 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-webtest. 2024-05-21T14:40:10.097 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-21T14:40:10.114 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mon (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:10.135 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-21T14:40:10.446 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pecan. 2024-05-21T14:40:10.466 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-21T14:40:10.504 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-21T14:40:10.693 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-osd. 2024-05-21T14:40:10.708 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:10.752 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-osd (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:10.882 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-certifi. 2024-05-21T14:40:10.896 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-21T14:40:10.934 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-21T14:40:11.245 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-idna. 2024-05-21T14:40:11.257 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-05-21T14:40:11.295 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-21T14:40:11.548 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-urllib3. 2024-05-21T14:40:11.568 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-21T14:40:11.588 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph. 2024-05-21T14:40:11.603 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../068-ceph_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:11.606 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-21T14:40:11.685 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:11.935 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-requests. 2024-05-21T14:40:11.956 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-21T14:40:11.993 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-21T14:40:12.083 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-fuse. 2024-05-21T14:40:12.098 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:12.149 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-fuse (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:12.304 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-21T14:40:12.325 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-21T14:40:12.362 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-21T14:40:12.651 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-21T14:40:12.669 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:40:12.706 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:12.728 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mds. 2024-05-21T14:40:12.742 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:12.786 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mds (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:13.061 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-21T14:40:13.082 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:13.119 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:13.172 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephadm. 2024-05-21T14:40:13.187 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../071-cephadm_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:13.247 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephadm (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:13.439 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-21T14:40:13.460 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-21T14:40:13.497 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-21T14:40:13.533 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-21T14:40:13.548 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-21T14:40:13.591 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-21T14:40:13.800 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-openssl. 2024-05-21T14:40:13.821 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-21T14:40:13.858 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-21T14:40:13.894 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-21T14:40:13.909 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-21T14:40:13.953 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-21T14:40:14.161 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr. 2024-05-21T14:40:14.182 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:14.211 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:14.614 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mon. 2024-05-21T14:40:14.635 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:14.672 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mon (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:14.941 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-babel. 2024-05-21T14:40:14.955 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-21T14:40:14.999 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-21T14:40:15.302 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jinja2. 2024-05-21T14:40:15.302 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-osd. 2024-05-21T14:40:15.316 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-21T14:40:15.323 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:15.360 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-21T14:40:15.361 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-osd (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:15.713 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-21T14:40:15.727 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:40:15.772 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:16.125 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-21T14:40:16.139 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-21T14:40:16.183 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-21T14:40:16.380 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph. 2024-05-21T14:40:16.401 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../068-ceph_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:16.430 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:16.520 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-routes. 2024-05-21T14:40:16.534 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-21T14:40:16.578 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-21T14:40:16.674 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-fuse. 2024-05-21T14:40:16.695 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:16.732 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-fuse (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:16.898 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-21T14:40:16.912 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:40:16.972 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:17.103 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mds. 2024-05-21T14:40:17.123 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:17.161 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mds (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:17.580 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package cephadm. 2024-05-21T14:40:17.601 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../071-cephadm_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:17.638 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking cephadm (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:17.933 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-21T14:40:17.953 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-21T14:40:17.982 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-21T14:40:18.178 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-21T14:40:18.192 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-21T14:40:18.236 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-21T14:40:18.327 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-21T14:40:18.339 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-21T14:40:18.377 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-21T14:40:18.765 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-joblib. 2024-05-21T14:40:18.778 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-21T14:40:18.823 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-21T14:40:19.193 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-21T14:40:19.207 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-21T14:40:19.329 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-21T14:40:19.490 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-babel. 2024-05-21T14:40:19.512 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-21T14:40:19.548 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-21T14:40:19.657 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn. 2024-05-21T14:40:19.670 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-21T14:40:19.715 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-21T14:40:19.843 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jinja2. 2024-05-21T14:40:19.864 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-21T14:40:19.893 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-21T14:40:20.204 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-21T14:40:20.225 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:40:20.254 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:20.408 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-21T14:40:20.422 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:40:20.466 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:20.591 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-21T14:40:20.612 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-21T14:40:20.641 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-21T14:40:20.910 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-routes. 2024-05-21T14:40:20.931 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-21T14:40:20.968 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-21T14:40:21.313 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-21T14:40:21.334 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:40:21.371 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:21.403 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cachetools. 2024-05-21T14:40:21.418 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-21T14:40:21.461 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-21T14:40:21.797 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-21T14:40:21.812 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-21T14:40:21.855 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-21T14:40:22.201 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-21T14:40:22.216 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-21T14:40:22.259 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-21T14:40:22.587 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rsa. 2024-05-21T14:40:22.602 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-21T14:40:22.609 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-21T14:40:22.622 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-21T14:40:22.645 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-21T14:40:22.651 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-21T14:40:22.925 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-google-auth. 2024-05-21T14:40:22.938 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-21T14:40:22.974 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-21T14:40:23.147 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-joblib. 2024-05-21T14:40:23.168 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-21T14:40:23.204 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-21T14:40:23.285 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-21T14:40:23.300 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-21T14:40:23.369 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-21T14:40:23.566 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-21T14:40:23.588 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-21T14:40:23.680 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-websocket. 2024-05-21T14:40:23.695 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-21T14:40:23.727 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-21T14:40:23.738 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-21T14:40:24.013 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-sklearn. 2024-05-21T14:40:24.034 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-21T14:40:24.079 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-21T14:40:24.119 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-21T14:40:24.134 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-21T14:40:24.177 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-21T14:40:24.788 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-21T14:40:24.810 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:40:24.862 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:24.899 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-21T14:40:24.913 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:40:24.958 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:25.236 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-21T14:40:25.250 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-21T14:40:25.294 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-21T14:40:25.655 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-21T14:40:25.669 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-21T14:40:25.714 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-21T14:40:25.865 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cachetools. 2024-05-21T14:40:25.887 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-21T14:40:25.932 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-21T14:40:25.975 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package jq. 2024-05-21T14:40:25.988 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-21T14:40:26.033 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-21T14:40:26.243 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-21T14:40:26.264 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-21T14:40:26.269 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package socat. 2024-05-21T14:40:26.283 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-21T14:40:26.301 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-21T14:40:26.319 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-21T14:40:26.621 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-21T14:40:26.630 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package xmlstarlet. 2024-05-21T14:40:26.634 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-21T14:40:26.645 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-21T14:40:26.671 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-21T14:40:26.689 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-21T14:40:26.974 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rsa. 2024-05-21T14:40:26.996 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-21T14:40:27.035 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-test. 2024-05-21T14:40:27.049 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-21T14:40:27.049 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:27.085 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-test (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:27.437 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-google-auth. 2024-05-21T14:40:27.459 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-21T14:40:27.511 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-21T14:40:27.922 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-21T14:40:27.944 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-21T14:40:27.997 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-21T14:40:28.600 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-websocket. 2024-05-21T14:40:28.621 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-21T14:40:28.666 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-21T14:40:28.995 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-21T14:40:29.016 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-21T14:40:29.061 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-21T14:40:29.389 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-volume. 2024-05-21T14:40:29.404 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:40:29.439 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-volume (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:29.768 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-21T14:40:29.775 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-21T14:40:29.783 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:29.787 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:40:29.818 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-mirror (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:29.825 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:30.145 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-21T14:40:30.155 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-colorama. 2024-05-21T14:40:30.166 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-21T14:40:30.170 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-21T14:40:30.211 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-21T14:40:30.213 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-21T14:40:30.474 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-shell. 2024-05-21T14:40:30.489 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:40:30.532 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-shell (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:30.556 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-21T14:40:30.577 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-21T14:40:30.614 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-21T14:40:30.793 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-top. 2024-05-21T14:40:30.808 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:40:30.874 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-top (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:30.891 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package jq. 2024-05-21T14:40:30.913 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-21T14:40:30.950 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-21T14:40:31.104 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-21T14:40:31.119 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:31.154 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs-dev (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:31.186 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package socat. 2024-05-21T14:40:31.198 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-21T14:40:31.227 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-21T14:40:31.465 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-21T14:40:31.480 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-21T14:40:31.522 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package xmlstarlet. 2024-05-21T14:40:31.523 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-21T14:40:31.543 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-21T14:40:31.580 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-21T14:40:31.878 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-21T14:40:31.893 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-21T14:40:31.928 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-21T14:40:31.934 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-test. 2024-05-21T14:40:31.946 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:31.984 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-test (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:32.307 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package nvme-cli. 2024-05-21T14:40:32.322 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-21T14:40:32.365 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-21T14:40:32.820 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package pkg-config. 2024-05-21T14:40:32.835 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-21T14:40:32.878 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-21T14:40:33.123 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-21T14:40:33.138 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-21T14:40:33.223 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-21T14:40:33.602 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-21T14:40:33.617 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-21T14:40:33.659 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-21T14:40:34.013 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastescript. 2024-05-21T14:40:34.028 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-21T14:40:34.071 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-21T14:40:34.416 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pluggy. 2024-05-21T14:40:34.431 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-21T14:40:34.474 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-21T14:40:34.480 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-volume. 2024-05-21T14:40:34.501 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:40:34.546 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-volume (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:34.811 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-psutil. 2024-05-21T14:40:34.826 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-21T14:40:34.877 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-21T14:40:34.925 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-21T14:40:34.947 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:34.991 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking cephfs-mirror (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:35.197 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-py. 2024-05-21T14:40:35.212 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-21T14:40:35.255 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-21T14:40:35.314 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-colorama. 2024-05-21T14:40:35.333 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-21T14:40:35.378 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-21T14:40:35.609 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pygments. 2024-05-21T14:40:35.622 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package cephfs-shell. 2024-05-21T14:40:35.624 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-21T14:40:35.640 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:40:35.666 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-21T14:40:35.680 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking cephfs-shell (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:35.924 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package cephfs-top. 2024-05-21T14:40:35.937 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2744-gd2b507c7-1jammy_all.deb ... 2024-05-21T14:40:35.966 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking cephfs-top (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:36.121 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-21T14:40:36.136 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-21T14:40:36.179 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-21T14:40:36.219 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-21T14:40:36.240 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:36.285 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libcephfs-dev (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:36.507 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-toml. 2024-05-21T14:40:36.522 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-21T14:40:36.565 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-21T14:40:36.630 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-21T14:40:36.651 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-21T14:40:36.696 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-21T14:40:36.835 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pytest. 2024-05-21T14:40:36.850 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-21T14:40:36.884 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-21T14:40:37.026 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-21T14:40:37.047 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-21T14:40:37.092 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-21T14:40:37.247 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplejson. 2024-05-21T14:40:37.262 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-21T14:40:37.305 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-21T14:40:37.413 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package nvme-cli. 2024-05-21T14:40:37.434 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-21T14:40:37.479 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-21T14:40:37.574 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-21T14:40:37.589 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-21T14:40:37.624 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-21T14:40:37.926 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package pkg-config. 2024-05-21T14:40:37.948 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-21T14:40:37.993 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-21T14:40:38.246 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-21T14:40:38.258 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-21T14:40:38.295 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-21T14:40:38.328 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package radosgw. 2024-05-21T14:40:38.343 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../122-radosgw_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:38.378 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking radosgw (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:38.724 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-21T14:40:38.745 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-21T14:40:38.790 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-21T14:40:39.090 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package rbd-fuse. 2024-05-21T14:40:39.101 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pastescript. 2024-05-21T14:40:39.105 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:39.123 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-21T14:40:39.148 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking rbd-fuse (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:39.167 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-21T14:40:39.433 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-21T14:40:39.513 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pluggy. 2024-05-21T14:40:39.534 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-21T14:40:39.579 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-21T14:40:39.728 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-21T14:40:39.832 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-psutil. 2024-05-21T14:40:39.854 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-21T14:40:39.854 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-21T14:40:39.898 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-21T14:40:40.118 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-21T14:40:40.252 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-py. 2024-05-21T14:40:40.273 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-21T14:40:40.309 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-21T14:40:40.539 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-21T14:40:40.596 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pygments. 2024-05-21T14:40:40.618 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-21T14:40:40.654 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-21T14:40:41.117 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-21T14:40:41.133 INFO:teuthology.orchestra.run.smithi078.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-21T14:40:41.138 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-21T14:40:41.168 INFO:teuthology.orchestra.run.smithi078.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-05-21T14:40:41.183 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-21T14:40:41.248 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephadm (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:41.503 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-toml. 2024-05-21T14:40:41.524 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-21T14:40:41.569 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-21T14:40:41.808 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user cephadm....done 2024-05-21T14:40:41.872 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pytest. 2024-05-21T14:40:41.894 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-21T14:40:41.938 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-21T14:40:41.962 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-21T14:40:42.238 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-21T14:40:42.309 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-simplejson. 2024-05-21T14:40:42.330 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-21T14:40:42.375 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-21T14:40:42.498 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-21T14:40:42.645 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-21T14:40:42.649 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-21T14:40:42.666 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-21T14:40:42.711 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-21T14:40:42.910 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-21T14:40:43.177 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-21T14:40:43.336 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-21T14:40:43.432 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package radosgw. 2024-05-21T14:40:43.454 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../122-radosgw_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:43.498 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking radosgw (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:43.647 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-21T14:40:44.015 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-21T14:40:44.308 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-21T14:40:44.426 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package rbd-fuse. 2024-05-21T14:40:44.439 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2744-gd2b507c7-1jammy_amd64.deb ... 2024-05-21T14:40:44.476 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking rbd-fuse (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:44.568 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-21T14:40:44.795 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-21T14:40:44.877 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-21T14:40:45.048 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-21T14:40:45.157 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-21T14:40:45.162 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-21T14:40:45.420 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-21T14:40:45.438 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-21T14:40:45.715 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-21T14:40:45.764 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-21T14:40:45.991 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-argparse (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:46.244 INFO:teuthology.orchestra.run.smithi084.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-21T14:40:46.266 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-21T14:40:46.359 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up cephadm (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:46.402 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-21T14:40:46.519 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-21T14:40:46.795 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-21T14:40:46.916 INFO:teuthology.orchestra.run.smithi084.stdout:Adding system user cephadm....done 2024-05-21T14:40:46.921 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-21T14:40:47.073 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-21T14:40:47.197 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-21T14:40:47.349 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-21T14:40:47.606 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-21T14:40:47.609 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-21T14:40:47.628 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-21T14:40:47.693 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-21T14:40:47.735 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-21T14:40:47.818 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-21T14:40:47.994 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-21T14:40:48.187 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-21T14:40:48.262 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-21T14:40:48.312 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-21T14:40:48.371 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-21T14:40:48.589 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-21T14:40:48.657 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-21T14:40:48.865 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-21T14:40:49.008 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-21T14:40:49.157 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up zip (3.0-12build2) ... 2024-05-21T14:40:49.268 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-21T14:40:49.275 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-21T14:40:49.594 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-21T14:40:49.861 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-21T14:40:49.960 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-21T14:40:50.130 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-21T14:40:50.254 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-21T14:40:50.364 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-21T14:40:50.379 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-21T14:40:50.497 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-21T14:40:50.615 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-21T14:40:50.807 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-21T14:40:50.991 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-ceph-argparse (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:51.216 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-21T14:40:51.259 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-21T14:40:51.368 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-21T14:40:51.468 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-21T14:40:51.477 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-21T14:40:51.728 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-21T14:40:51.846 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-21T14:40:51.861 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-21T14:40:52.097 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-21T14:40:52.162 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-21T14:40:52.488 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-21T14:40:52.527 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-21T14:40:52.562 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-21T14:40:52.634 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-21T14:40:52.760 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-21T14:40:52.874 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-21T14:40:53.119 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-21T14:40:53.124 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-21T14:40:53.237 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-21T14:40:53.250 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-common (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:53.488 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-21T14:40:53.585 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-idna (3.3-1) ... 2024-05-21T14:40:53.747 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-21T14:40:53.928 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-21T14:40:54.057 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up zip (3.0-12build2) ... 2024-05-21T14:40:54.183 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-21T14:40:54.868 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-21T14:40:55.119 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-21T14:40:55.150 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-21T14:40:55.228 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-21T14:40:55.371 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-21T14:40:55.394 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T14:40:55.537 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-21T14:40:55.672 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-21T14:40:55.838 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-21T14:40:55.964 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-21T14:40:56.065 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-21T14:40:56.090 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-21T14:40:56.333 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-21T14:40:56.425 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-21T14:40:56.693 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-21T14:40:56.701 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-21T14:40:56.954 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T14:40:56.994 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-21T14:40:57.078 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-21T14:40:57.295 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-21T14:40:57.405 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-21T14:40:57.646 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-21T14:40:57.656 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-21T14:40:57.897 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-21T14:40:57.949 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-21T14:40:58.023 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-ceph-common (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:40:58.216 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-21T14:40:58.325 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-idna (3.3-1) ... 2024-05-21T14:40:58.476 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-21T14:40:58.634 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-21T14:40:58.752 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-21T14:40:58.878 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-21T14:40:59.171 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-21T14:40:59.289 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-21T14:40:59.582 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-21T14:40:59.839 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-21T14:40:59.891 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-21T14:41:00.093 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T14:41:00.159 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-21T14:41:00.219 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-21T14:41:00.318 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-21T14:41:00.461 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-21T14:41:00.461 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-21T14:41:00.550 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-21T14:41:00.588 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-21T14:41:00.730 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-21T14:41:00.788 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-21T14:41:00.914 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-21T14:41:01.032 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-21T14:41:01.283 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-21T14:41:01.332 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-21T14:41:01.525 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T14:41:01.600 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-21T14:41:01.643 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-21T14:41:01.726 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-21T14:41:01.953 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-21T14:41:02.018 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T14:41:02.153 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-21T14:41:02.187 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-21T14:41:02.446 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-21T14:41:02.479 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-21T14:41:02.706 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-21T14:41:02.797 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-21T14:41:02.965 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-21T14:41:03.082 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-21T14:41:03.224 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-21T14:41:03.318 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-21T14:41:03.334 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-21T14:41:03.603 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-21T14:41:03.627 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-21T14:41:03.744 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-21T14:41:03.871 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-21T14:41:04.029 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-21T14:41:04.481 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-21T14:41:04.638 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-21T14:41:04.900 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-21T14:41:04.906 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-21T14:41:05.057 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-21T14:41:05.183 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-21T14:41:05.201 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-21T14:41:05.271 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-21T14:41:05.501 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-21T14:41:05.545 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-21T14:41:05.627 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-21T14:41:05.688 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librados2 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:05.806 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:05.932 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-21T14:41:06.020 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-21T14:41:06.269 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs2 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:06.279 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-21T14:41:06.395 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libradosstriper1 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:06.405 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-21T14:41:06.538 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-21T14:41:06.665 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T14:41:06.782 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-21T14:41:06.831 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librbd1 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:06.957 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-modules-core (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:07.083 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-fuse (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:07.100 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-21T14:41:07.285 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-21T14:41:07.285 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-21T14:41:07.418 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-21T14:41:07.702 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-21T14:41:07.922 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-21T14:41:07.985 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs-dev (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:08.110 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rados (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:08.197 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-21T14:41:08.237 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librgw2 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:08.354 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-top (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:08.457 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-21T14:41:08.464 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-21T14:41:08.717 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-21T14:41:09.110 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-21T14:41:09.378 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-21T14:41:09.705 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-21T14:41:09.743 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rbd (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:09.831 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librados2 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:09.852 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up rbd-fuse (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:09.957 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:09.986 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rgw (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:10.058 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-21T14:41:10.112 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cephfs (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:10.238 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-shell (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:10.386 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libcephfs2 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:10.389 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-common (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:10.512 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libradosstriper1 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:10.638 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-21T14:41:10.914 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librbd1 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:10.984 INFO:teuthology.orchestra.run.smithi078.stdout:Adding group ceph....done 2024-05-21T14:41:11.040 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-modules-core (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:11.166 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-fuse (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:11.338 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user ceph....done 2024-05-21T14:41:11.378 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-21T14:41:11.378 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-21T14:41:11.506 INFO:teuthology.orchestra.run.smithi078.stdout:Setting system user ceph properties....done 2024-05-21T14:41:11.528 INFO:teuthology.orchestra.run.smithi078.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-21T14:41:11.669 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-21T14:41:11.917 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libcephfs-dev (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:12.027 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rados (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:12.070 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-21T14:41:12.127 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librgw2 (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:12.253 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up cephfs-top (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:12.379 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-21T14:41:12.810 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-mirror (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:13.009 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-21T14:41:13.009 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-21T14:41:13.574 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rbd (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:13.660 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-test (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:13.725 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up rbd-fuse (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:13.787 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up radosgw (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:13.843 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rgw (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:13.944 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cephfs (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:14.062 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up cephfs-shell (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:14.188 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-common (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:14.308 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-21T14:41:14.308 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-21T14:41:14.713 INFO:teuthology.orchestra.run.smithi084.stdout:Adding group ceph....done 2024-05-21T14:41:15.157 INFO:teuthology.orchestra.run.smithi084.stdout:Adding system user ceph....done 2024-05-21T14:41:15.207 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-base (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:15.325 INFO:teuthology.orchestra.run.smithi084.stdout:Setting system user ceph properties....done 2024-05-21T14:41:15.340 INFO:teuthology.orchestra.run.smithi084.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-21T14:41:15.483 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-21T14:41:15.565 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-21T14:41:15.860 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-21T14:41:16.208 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mds (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:16.422 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up cephfs-mirror (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:16.431 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-21T14:41:16.431 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-21T14:41:16.625 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-21T14:41:16.625 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-21T14:41:17.118 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:17.156 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-test (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:17.257 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up radosgw (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:17.331 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-21T14:41:17.331 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-21T14:41:17.750 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-21T14:41:17.751 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-21T14:41:18.011 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-osd (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:18.234 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-base (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:18.310 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-21T14:41:18.310 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-21T14:41:18.567 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-21T14:41:18.997 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:19.102 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mds (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:19.131 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:19.273 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mon (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:19.319 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-21T14:41:19.319 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-21T14:41:19.482 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-21T14:41:19.482 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-21T14:41:19.829 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:20.116 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-cephadm (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:20.254 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-21T14:41:20.254 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-21T14:41:20.259 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:20.385 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-dashboard (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:20.553 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-volume (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:20.731 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-osd (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:20.906 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-21T14:41:20.998 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-21T14:41:21.047 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-21T14:41:21.047 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-21T14:41:21.150 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-21T14:41:21.574 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:21.692 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:21.826 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mon (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:22.059 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-21T14:41:22.059 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-21T14:41:22.317 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-21T14:41:22.586 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-cephadm (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:22.729 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:22.855 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-dashboard (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:22.997 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-volume (19.0.0-2744-gd2b507c7-1jammy) ... 2024-05-21T14:41:23.038 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-21T14:41:23.043 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-21T14:41:23.118 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-05-21T14:41:23.293 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-05-21T14:41:23.294 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-05-21T14:41:23.325 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-21T14:41:23.426 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-21T14:41:23.466 INFO:teuthology.orchestra.run.smithi078.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-21T14:41:23.466 INFO:teuthology.orchestra.run.smithi078.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-21T14:41:23.466 INFO:teuthology.orchestra.run.smithi078.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-21T14:41:23.466 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-05-21T14:41:23.467 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-21T14:41:23.467 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-21T14:41:23.467 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-21T14:41:23.467 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-21T14:41:23.467 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-21T14:41:23.467 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-21T14:41:23.468 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2024-05-21T14:41:23.468 INFO:teuthology.orchestra.run.smithi078.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-21T14:41:23.468 INFO:teuthology.orchestra.run.smithi078.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-21T14:41:23.469 INFO:teuthology.orchestra.run.smithi078.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-21T14:41:23.469 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-21T14:41:23.469 INFO:teuthology.orchestra.run.smithi078.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-21T14:41:23.470 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2024-05-21T14:41:23.470 INFO:teuthology.orchestra.run.smithi078.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-21T14:41:23.470 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-21T14:41:23.470 INFO:teuthology.orchestra.run.smithi078.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-21T14:41:23.524 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2024-05-21T14:41:23.524 INFO:teuthology.orchestra.run.smithi078.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-21T14:41:23.525 INFO:teuthology.orchestra.run.smithi078.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-21T14:41:23.525 INFO:teuthology.orchestra.run.smithi078.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-21T14:41:23.525 INFO:teuthology.orchestra.run.smithi078.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-21T14:41:23.525 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-21T14:41:23.525 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-21T14:41:23.525 INFO:teuthology.orchestra.run.smithi078.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-21T14:41:23.526 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages will be upgraded: 2024-05-21T14:41:23.527 INFO:teuthology.orchestra.run.smithi078.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-21T14:41:23.578 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-21T14:41:23.733 INFO:teuthology.orchestra.run.smithi078.stdout:4 upgraded, 39 newly installed, 0 to remove and 306 not upgraded. 2024-05-21T14:41:23.733 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 55.7 MB of archives. 2024-05-21T14:41:23.733 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-21T14:41:23.733 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-21T14:41:24.376 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-21T14:41:24.393 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-21T14:41:24.517 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-21T14:41:24.518 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-21T14:41:24.519 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-21T14:41:24.548 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-21T14:41:24.549 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-21T14:41:24.553 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-21T14:41:24.555 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-21T14:41:24.556 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-21T14:41:24.711 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-21T14:41:24.722 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-21T14:41:25.003 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-21T14:41:25.013 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-21T14:41:25.019 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-21T14:41:25.112 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-21T14:41:25.348 INFO:teuthology.orchestra.run.smithi084.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-21T14:41:25.351 DEBUG:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-21T14:41:25.411 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2024-05-21T14:41:25.614 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2024-05-21T14:41:25.615 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2024-05-21T14:41:25.807 INFO:teuthology.orchestra.run.smithi084.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-21T14:41:25.807 INFO:teuthology.orchestra.run.smithi084.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-21T14:41:25.807 INFO:teuthology.orchestra.run.smithi084.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-21T14:41:25.808 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages were automatically installed and are no longer required: 2024-05-21T14:41:25.808 INFO:teuthology.orchestra.run.smithi084.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-21T14:41:25.808 INFO:teuthology.orchestra.run.smithi084.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-21T14:41:25.808 INFO:teuthology.orchestra.run.smithi084.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-21T14:41:25.808 INFO:teuthology.orchestra.run.smithi084.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-21T14:41:25.808 INFO:teuthology.orchestra.run.smithi084.stdout: python2.7-minimal 2024-05-21T14:41:25.808 INFO:teuthology.orchestra.run.smithi084.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-21T14:41:25.809 INFO:teuthology.orchestra.run.smithi084.stdout:The following additional packages will be installed: 2024-05-21T14:41:25.809 INFO:teuthology.orchestra.run.smithi084.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-21T14:41:25.809 INFO:teuthology.orchestra.run.smithi084.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-21T14:41:25.810 INFO:teuthology.orchestra.run.smithi084.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-21T14:41:25.810 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-21T14:41:25.810 INFO:teuthology.orchestra.run.smithi084.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-21T14:41:25.811 INFO:teuthology.orchestra.run.smithi084.stdout:Suggested packages: 2024-05-21T14:41:25.811 INFO:teuthology.orchestra.run.smithi084.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-21T14:41:25.811 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-21T14:41:25.811 INFO:teuthology.orchestra.run.smithi084.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-21T14:41:25.852 INFO:teuthology.orchestra.run.smithi084.stdout:The following NEW packages will be installed: 2024-05-21T14:41:25.853 INFO:teuthology.orchestra.run.smithi084.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-21T14:41:25.853 INFO:teuthology.orchestra.run.smithi084.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-21T14:41:25.853 INFO:teuthology.orchestra.run.smithi084.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-21T14:41:25.853 INFO:teuthology.orchestra.run.smithi084.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-21T14:41:25.853 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-21T14:41:25.854 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-21T14:41:25.854 INFO:teuthology.orchestra.run.smithi084.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-21T14:41:25.855 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages will be upgraded: 2024-05-21T14:41:25.856 INFO:teuthology.orchestra.run.smithi084.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-21T14:41:25.916 INFO:teuthology.orchestra.run.smithi084.stdout:4 upgraded, 39 newly installed, 0 to remove and 306 not upgraded. 2024-05-21T14:41:25.916 INFO:teuthology.orchestra.run.smithi084.stdout:Need to get 55.7 MB of archives. 2024-05-21T14:41:25.916 INFO:teuthology.orchestra.run.smithi084.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-21T14:41:25.916 INFO:teuthology.orchestra.run.smithi084.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-21T14:41:26.076 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-21T14:41:26.080 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-21T14:41:26.082 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-21T14:41:26.082 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-21T14:41:26.083 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-21T14:41:26.109 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-21T14:41:26.109 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-21T14:41:26.113 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-21T14:41:26.121 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-21T14:41:26.122 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-21T14:41:26.122 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-21T14:41:26.133 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-21T14:41:26.134 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-21T14:41:26.136 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-21T14:41:26.138 INFO:teuthology.orchestra.run.smithi084.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-21T14:41:26.138 INFO:teuthology.orchestra.run.smithi084.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-21T14:41:26.140 INFO:teuthology.orchestra.run.smithi084.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-21T14:41:26.143 INFO:teuthology.orchestra.run.smithi084.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-21T14:41:26.162 INFO:teuthology.orchestra.run.smithi084.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-21T14:41:26.163 INFO:teuthology.orchestra.run.smithi084.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-21T14:41:26.164 INFO:teuthology.orchestra.run.smithi084.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-21T14:41:26.280 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-21T14:41:26.597 INFO:teuthology.orchestra.run.smithi084.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-21T14:41:26.599 INFO:teuthology.orchestra.run.smithi084.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-21T14:41:26.599 INFO:teuthology.orchestra.run.smithi084.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-21T14:41:26.603 INFO:teuthology.orchestra.run.smithi084.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-21T14:41:26.603 INFO:teuthology.orchestra.run.smithi084.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-21T14:41:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-21T14:41:26.610 INFO:teuthology.orchestra.run.smithi084.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-21T14:41:26.619 INFO:teuthology.orchestra.run.smithi084.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-21T14:41:26.619 INFO:teuthology.orchestra.run.smithi084.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-21T14:41:26.645 INFO:teuthology.orchestra.run.smithi084.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-21T14:41:26.646 INFO:teuthology.orchestra.run.smithi084.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-21T14:41:26.657 INFO:teuthology.orchestra.run.smithi084.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-21T14:41:26.680 INFO:teuthology.orchestra.run.smithi084.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-21T14:41:26.684 INFO:teuthology.orchestra.run.smithi084.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-21T14:41:26.684 INFO:teuthology.orchestra.run.smithi084.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-21T14:41:26.685 INFO:teuthology.orchestra.run.smithi084.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-21T14:41:26.685 INFO:teuthology.orchestra.run.smithi084.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-21T14:41:26.701 INFO:teuthology.orchestra.run.smithi084.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-21T14:41:26.703 INFO:teuthology.orchestra.run.smithi084.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-21T14:41:26.885 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-21T14:41:26.886 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-21T14:41:26.983 INFO:teuthology.orchestra.run.smithi084.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-21T14:41:26.983 INFO:teuthology.orchestra.run.smithi084.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-21T14:41:26.983 INFO:teuthology.orchestra.run.smithi084.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-21T14:41:26.983 INFO:teuthology.orchestra.run.smithi084.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-21T14:41:26.983 INFO:teuthology.orchestra.run.smithi084.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-21T14:41:26.984 INFO:teuthology.orchestra.run.smithi084.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-21T14:41:26.995 INFO:teuthology.orchestra.run.smithi084.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-21T14:41:26.996 INFO:teuthology.orchestra.run.smithi084.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-21T14:41:27.067 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-21T14:41:27.067 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-21T14:41:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-21T14:41:27.163 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-21T14:41:27.169 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-21T14:41:27.170 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-21T14:41:27.170 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-21T14:41:27.171 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-21T14:41:27.377 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-21T14:41:27.400 INFO:teuthology.orchestra.run.smithi084.stdout:Preconfiguring packages ... 2024-05-21T14:41:27.563 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 55.7 MB in 1s (49.2 MB/s) 2024-05-21T14:41:27.800 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-21T14:41:27.867 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138493 files and directories currently installed.) 2024-05-21T14:41:27.871 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T14:41:28.018 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T14:41:28.562 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-21T14:41:28.562 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-21T14:41:28.562 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-21T14:41:28.562 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-21T14:41:28.563 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-21T14:41:28.563 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-21T14:41:28.600 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-21T14:41:28.601 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-21T14:41:28.635 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-21T14:41:28.986 INFO:teuthology.orchestra.run.smithi078.stdout:Preconfiguring packages ... 2024-05-21T14:41:29.142 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 55.7 MB in 5s (11.0 MB/s) 2024-05-21T14:41:29.432 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140911 files and directories currently installed.) 2024-05-21T14:41:29.435 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T14:41:29.575 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T14:41:29.660 INFO:teuthology.orchestra.run.smithi084.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-21T14:41:29.947 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package flex. 2024-05-21T14:41:30.034 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138493 files and directories currently installed.) 2024-05-21T14:41:30.038 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-21T14:41:30.162 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-21T14:41:30.284 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-21T14:41:30.966 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-21T14:41:31.252 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-21T14:41:31.442 INFO:teuthology.orchestra.run.smithi078.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-21T14:41:31.696 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package flex. 2024-05-21T14:41:31.701 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T14:41:31.767 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140911 files and directories currently installed.) 2024-05-21T14:41:31.771 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-21T14:41:31.812 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-21T14:41:32.237 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138566 files and directories currently installed.) 2024-05-21T14:41:32.241 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T14:41:32.348 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-21T14:41:32.376 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T14:41:32.526 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-21T14:41:32.754 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T14:41:32.874 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T14:41:32.915 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T14:41:33.198 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-21T14:41:33.447 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140984 files and directories currently installed.) 2024-05-21T14:41:33.451 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T14:41:33.583 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package bison. 2024-05-21T14:41:33.598 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T14:41:33.672 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138566 files and directories currently installed.) 2024-05-21T14:41:33.676 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-21T14:41:33.727 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-21T14:41:34.020 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T14:41:34.144 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-21T14:41:34.148 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T14:41:34.165 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-21T14:41:34.295 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-21T14:41:34.462 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-21T14:41:34.613 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package dump. 2024-05-21T14:41:34.635 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-21T14:41:34.679 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking dump (0.4b47-3) ... 2024-05-21T14:41:34.806 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package bison. 2024-05-21T14:41:34.880 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140984 files and directories currently installed.) 2024-05-21T14:41:34.884 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-21T14:41:34.991 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package indent. 2024-05-21T14:41:35.004 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T14:41:35.041 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-21T14:41:35.302 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-21T14:41:35.315 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-21T14:41:35.352 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-21T14:41:35.361 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-21T14:41:35.673 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-21T14:41:35.694 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-21T14:41:35.744 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-21T14:41:35.759 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-21T14:41:35.802 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-21T14:41:35.842 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-21T14:41:36.113 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package dump. 2024-05-21T14:41:36.129 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-21T14:41:36.172 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking dump (0.4b47-3) ... 2024-05-21T14:41:36.509 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package indent. 2024-05-21T14:41:36.524 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T14:41:36.567 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-21T14:41:36.618 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-21T14:41:36.639 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-21T14:41:36.685 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-21T14:41:36.820 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-21T14:41:36.835 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-21T14:41:36.903 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-21T14:41:37.030 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-21T14:41:37.042 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-21T14:41:37.088 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-21T14:41:37.190 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-21T14:41:37.206 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-21T14:41:37.240 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-21T14:41:37.390 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-21T14:41:37.412 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-21T14:41:37.465 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-21T14:41:37.493 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-21T14:41:37.508 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-21T14:41:37.551 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-21T14:41:37.768 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libjson-perl. 2024-05-21T14:41:37.791 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-21T14:41:37.843 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-21T14:41:37.921 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-21T14:41:37.936 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-21T14:41:37.979 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-21T14:41:38.188 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-21T14:41:38.209 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-21T14:41:38.232 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-21T14:41:38.247 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-21T14:41:38.254 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-21T14:41:38.290 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-21T14:41:38.568 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjson-perl. 2024-05-21T14:41:38.583 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-21T14:41:38.626 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-21T14:41:38.921 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-21T14:41:38.936 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-21T14:41:38.971 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-21T14:41:40.007 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-21T14:41:40.031 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-21T14:41:40.082 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T14:41:40.401 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-21T14:41:40.423 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-21T14:41:40.476 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T14:41:40.526 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-21T14:41:40.541 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-21T14:41:40.583 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T14:41:40.869 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-21T14:41:40.870 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-21T14:41:40.885 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-21T14:41:40.892 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-21T14:41:40.928 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T14:41:40.945 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T14:41:41.222 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-21T14:41:41.237 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-21T14:41:41.272 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T14:41:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-21T14:41:41.311 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-21T14:41:41.423 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-21T14:41:41.768 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-21T14:41:41.775 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-21T14:41:41.790 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-21T14:41:41.791 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-21T14:41:41.833 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-21T14:41:41.834 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-21T14:41:42.161 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-21T14:41:42.176 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-21T14:41:42.187 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-21T14:41:42.209 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T14:41:42.211 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-21T14:41:42.254 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T14:41:42.531 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-21T14:41:42.546 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T14:41:42.548 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-21T14:41:42.570 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T14:41:42.580 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T14:41:42.615 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T14:41:42.925 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-21T14:41:42.926 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-21T14:41:42.940 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T14:41:42.948 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T14:41:42.983 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T14:41:42.993 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T14:41:43.253 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-21T14:41:43.266 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-21T14:41:43.303 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T14:41:43.319 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-21T14:41:43.334 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T14:41:43.377 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T14:41:43.622 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-21T14:41:43.636 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-21T14:41:43.680 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T14:41:43.823 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-21T14:41:43.845 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-21T14:41:43.890 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-21T14:41:44.217 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-21T14:41:44.232 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-21T14:41:44.275 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-21T14:41:44.335 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package modemmanager. 2024-05-21T14:41:44.357 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-21T14:41:44.409 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T14:41:44.611 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package modemmanager. 2024-05-21T14:41:44.627 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-21T14:41:44.686 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T14:41:45.100 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package network-manager. 2024-05-21T14:41:45.122 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-21T14:41:45.175 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-21T14:41:45.326 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package network-manager. 2024-05-21T14:41:45.342 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-21T14:41:45.401 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-21T14:41:45.815 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ppp. 2024-05-21T14:41:45.836 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-21T14:41:45.967 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ppp. 2024-05-21T14:41:45.982 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-21T14:41:46.156 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-21T14:41:46.330 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-21T14:41:46.562 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package pptp-linux. 2024-05-21T14:41:46.585 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-21T14:41:46.638 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package pptp-linux. 2024-05-21T14:41:46.652 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-21T14:41:46.704 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-21T14:41:46.728 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-21T14:41:46.991 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-21T14:41:47.005 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-21T14:41:47.031 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-21T14:41:47.044 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-21T14:41:47.049 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-21T14:41:47.081 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-21T14:41:47.352 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-21T14:41:47.366 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-21T14:41:47.377 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-21T14:41:47.399 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-21T14:41:47.410 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client-common (238) ... 2024-05-21T14:41:47.444 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-client-common (238) ... 2024-05-21T14:41:47.705 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-21T14:41:47.719 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T14:41:47.773 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-21T14:41:47.780 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T14:41:47.795 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T14:41:47.839 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T14:41:48.335 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-common. 2024-05-21T14:41:48.349 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-21T14:41:48.411 INFO:teuthology.orchestra.run.smithi078.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-21T14:41:48.442 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-common (238) ... 2024-05-21T14:41:48.461 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-common. 2024-05-21T14:41:48.483 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-21T14:41:48.545 INFO:teuthology.orchestra.run.smithi084.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-21T14:41:48.566 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-common (238) ... 2024-05-21T14:41:48.892 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-14. 2024-05-21T14:41:48.906 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T14:41:48.944 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T14:41:49.017 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-14. 2024-05-21T14:41:49.039 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T14:41:49.096 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T14:41:49.994 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql. 2024-05-21T14:41:50.009 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-21T14:41:50.045 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql (14+238) ... 2024-05-21T14:41:50.288 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client. 2024-05-21T14:41:50.302 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-21T14:41:50.346 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client (14+238) ... 2024-05-21T14:41:50.378 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql. 2024-05-21T14:41:50.398 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-21T14:41:50.436 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql (14+238) ... 2024-05-21T14:41:50.590 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-21T14:41:50.604 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-21T14:41:50.658 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-21T14:41:50.663 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-client. 2024-05-21T14:41:50.676 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-21T14:41:50.713 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-client (14+238) ... 2024-05-21T14:41:50.932 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-21T14:41:50.944 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-21T14:41:50.973 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-21T14:41:51.009 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package tcl8.6. 2024-05-21T14:41:51.024 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-21T14:41:51.067 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-21T14:41:51.318 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package tcl8.6. 2024-05-21T14:41:51.336 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package tcl. 2024-05-21T14:41:51.340 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-21T14:41:51.351 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-21T14:41:51.384 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-21T14:41:51.391 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-21T14:41:51.670 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package tcl. 2024-05-21T14:41:51.692 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-21T14:41:51.739 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package wpasupplicant. 2024-05-21T14:41:51.741 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-21T14:41:51.755 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-21T14:41:51.797 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-21T14:41:52.114 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package wpasupplicant. 2024-05-21T14:41:52.137 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-21T14:41:52.143 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-21T14:41:52.159 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-21T14:41:52.180 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-21T14:41:52.202 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-21T14:41:52.568 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-21T14:41:52.581 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-21T14:41:52.604 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-21T14:41:52.618 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-21T14:41:52.620 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-21T14:41:52.671 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-21T14:41:52.956 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client-common (238) ... 2024-05-21T14:41:52.963 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-21T14:41:52.978 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-21T14:41:53.021 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-21T14:41:53.169 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-21T14:41:53.312 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-client-common (238) ... 2024-05-21T14:41:53.328 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-21T14:41:53.454 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T14:41:53.527 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-21T14:41:53.580 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-21T14:41:53.661 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-21T14:41:53.706 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-21T14:41:53.812 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T14:41:53.840 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T14:41:53.963 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-21T14:41:54.114 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-21T14:41:54.265 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T14:41:54.764 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-21T14:41:54.808 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-21T14:41:54.845 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-21T14:41:54.870 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-21T14:41:55.229 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-21T14:41:55.229 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-21T14:41:55.256 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-21T14:41:55.256 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-21T14:41:55.773 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-21T14:41:55.899 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-21T14:41:56.000 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T14:41:56.074 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-21T14:41:56.126 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-21T14:41:56.225 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-21T14:41:56.285 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-21T14:41:56.401 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T14:41:56.411 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-21T14:41:56.537 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-21T14:41:56.552 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-21T14:41:56.663 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-21T14:41:56.703 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-21T14:41:56.854 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-21T14:41:57.005 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-21T14:41:57.156 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-21T14:41:57.922 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-21T14:41:57.985 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-21T14:41:58.056 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up dump (0.4b47-3) ... 2024-05-21T14:41:58.111 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up dump (0.4b47-3) ... 2024-05-21T14:41:58.151 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-21T14:41:58.205 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-21T14:41:58.225 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T14:41:58.262 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T14:41:58.376 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-21T14:41:58.388 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-21T14:41:58.514 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-21T14:41:58.527 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-21T14:41:58.642 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-21T14:41:58.703 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-21T14:41:58.766 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-21T14:41:58.840 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-21T14:41:58.854 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-21T14:41:58.909 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-21T14:41:58.960 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-21T14:41:59.035 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-21T14:41:59.038 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-21T14:41:59.173 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-21T14:41:59.211 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-21T14:41:59.354 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T14:41:59.374 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-21T14:41:59.475 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T14:41:59.480 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-21T14:41:59.610 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-21T14:41:59.648 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-client (14+238) ... 2024-05-21T14:41:59.774 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-21T14:41:59.778 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client (14+238) ... 2024-05-21T14:41:59.887 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-21T14:42:00.270 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:00.270 INFO:teuthology.orchestra.run.smithi084.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-21T14:42:00.270 INFO:teuthology.orchestra.run.smithi084.stdout:which means they are currently configured by ifupdown: 2024-05-21T14:42:00.271 INFO:teuthology.orchestra.run.smithi084.stdout:- enp3s0f1 2024-05-21T14:42:00.271 INFO:teuthology.orchestra.run.smithi084.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-21T14:42:00.271 INFO:teuthology.orchestra.run.smithi084.stdout:remove their configuration from /etc/network/interfaces. 2024-05-21T14:42:00.271 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:00.395 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-21T14:42:00.468 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:00.469 INFO:teuthology.orchestra.run.smithi078.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-21T14:42:00.469 INFO:teuthology.orchestra.run.smithi078.stdout:which means they are currently configured by ifupdown: 2024-05-21T14:42:00.469 INFO:teuthology.orchestra.run.smithi078.stdout:- enp3s0f1 2024-05-21T14:42:00.469 INFO:teuthology.orchestra.run.smithi078.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-21T14:42:00.469 INFO:teuthology.orchestra.run.smithi078.stdout:remove their configuration from /etc/network/interfaces. 2024-05-21T14:42:00.469 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:00.601 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-21T14:42:00.767 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-21T14:42:01.001 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-21T14:42:01.110 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-21T14:42:01.423 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-21T14:42:01.659 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T14:42:01.827 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-21T14:42:01.978 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-21T14:42:02.146 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-common (238) ... 2024-05-21T14:42:02.148 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T14:42:02.300 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-21T14:42:02.467 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-21T14:42:02.627 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-common (238) ... 2024-05-21T14:42:03.054 INFO:teuthology.orchestra.run.smithi084.stdout:Adding user postgres to group ssl-cert 2024-05-21T14:42:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:03.276 INFO:teuthology.orchestra.run.smithi084.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-21T14:42:03.460 INFO:teuthology.orchestra.run.smithi084.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-21T14:42:03.460 INFO:teuthology.orchestra.run.smithi084.stdout:Removing obsolete dictionary files: 2024-05-21T14:42:03.642 INFO:teuthology.orchestra.run.smithi078.stdout:Adding user postgres to group ssl-cert 2024-05-21T14:42:03.895 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:03.895 INFO:teuthology.orchestra.run.smithi078.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-21T14:42:04.067 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-21T14:42:04.143 INFO:teuthology.orchestra.run.smithi078.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-21T14:42:04.144 INFO:teuthology.orchestra.run.smithi078.stdout:Removing obsolete dictionary files: 2024-05-21T14:42:04.480 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T14:42:04.833 INFO:teuthology.orchestra.run.smithi084.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-21T14:42:04.856 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-21T14:42:04.865 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-21T14:42:04.897 INFO:teuthology.orchestra.run.smithi084.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-21T14:42:04.898 INFO:teuthology.orchestra.run.smithi084.stdout:This user must also own the server process. 2024-05-21T14:42:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:04.898 INFO:teuthology.orchestra.run.smithi084.stdout:The database cluster will be initialized with locale "en_US". 2024-05-21T14:42:04.898 INFO:teuthology.orchestra.run.smithi084.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-21T14:42:04.898 INFO:teuthology.orchestra.run.smithi084.stdout:The default text search configuration will be set to "english". 2024-05-21T14:42:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:04.898 INFO:teuthology.orchestra.run.smithi084.stdout:Data page checksums are disabled. 2024-05-21T14:42:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:04.898 INFO:teuthology.orchestra.run.smithi084.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-21T14:42:04.899 INFO:teuthology.orchestra.run.smithi084.stdout:creating subdirectories ... ok 2024-05-21T14:42:04.899 INFO:teuthology.orchestra.run.smithi084.stdout:selecting dynamic shared memory implementation ... posix 2024-05-21T14:42:04.912 INFO:teuthology.orchestra.run.smithi084.stdout:selecting default max_connections ... 100 2024-05-21T14:42:04.934 INFO:teuthology.orchestra.run.smithi084.stdout:selecting default shared_buffers ... 128MB 2024-05-21T14:42:04.943 INFO:teuthology.orchestra.run.smithi084.stdout:selecting default time zone ... Etc/UTC 2024-05-21T14:42:04.944 INFO:teuthology.orchestra.run.smithi084.stdout:creating configuration files ... ok 2024-05-21T14:42:05.056 INFO:teuthology.orchestra.run.smithi084.stdout:running bootstrap script ... ok 2024-05-21T14:42:05.353 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T14:42:05.686 INFO:teuthology.orchestra.run.smithi078.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-21T14:42:05.724 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-21T14:42:05.772 INFO:teuthology.orchestra.run.smithi078.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-21T14:42:05.772 INFO:teuthology.orchestra.run.smithi078.stdout:This user must also own the server process. 2024-05-21T14:42:05.772 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:05.772 INFO:teuthology.orchestra.run.smithi078.stdout:The database cluster will be initialized with locale "en_US". 2024-05-21T14:42:05.773 INFO:teuthology.orchestra.run.smithi078.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-21T14:42:05.773 INFO:teuthology.orchestra.run.smithi078.stdout:The default text search configuration will be set to "english". 2024-05-21T14:42:05.773 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:05.773 INFO:teuthology.orchestra.run.smithi078.stdout:Data page checksums are disabled. 2024-05-21T14:42:05.773 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:05.773 INFO:teuthology.orchestra.run.smithi078.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-21T14:42:05.773 INFO:teuthology.orchestra.run.smithi078.stdout:creating subdirectories ... ok 2024-05-21T14:42:05.774 INFO:teuthology.orchestra.run.smithi078.stdout:selecting dynamic shared memory implementation ... posix 2024-05-21T14:42:05.776 INFO:teuthology.orchestra.run.smithi084.stdout:performing post-bootstrap initialization ... ok 2024-05-21T14:42:05.798 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default max_connections ... 100 2024-05-21T14:42:05.830 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default shared_buffers ... 128MB 2024-05-21T14:42:05.844 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default time zone ... Etc/UTC 2024-05-21T14:42:05.845 INFO:teuthology.orchestra.run.smithi078.stdout:creating configuration files ... ok 2024-05-21T14:42:06.012 INFO:teuthology.orchestra.run.smithi078.stdout:running bootstrap script ... ok 2024-05-21T14:42:06.618 INFO:teuthology.orchestra.run.smithi084.stdout:syncing data to disk ... ok 2024-05-21T14:42:06.634 INFO:teuthology.orchestra.run.smithi078.stdout:performing post-bootstrap initialization ... ok 2024-05-21T14:42:07.031 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-21T14:42:07.229 INFO:teuthology.orchestra.run.smithi078.stdout:syncing data to disk ... ok 2024-05-21T14:42:07.765 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-21T14:42:09.870 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T14:42:10.021 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-21T14:42:10.172 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql (14+238) ... 2024-05-21T14:42:10.323 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T14:42:10.457 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T14:42:10.712 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-21T14:42:10.712 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-21T14:42:11.161 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T14:42:11.287 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-21T14:42:11.318 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-21T14:42:11.410 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-21T14:42:11.413 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql (14+238) ... 2024-05-21T14:42:11.539 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T14:42:11.640 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T14:42:11.712 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-21T14:42:11.873 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-21T14:42:11.932 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-21T14:42:11.932 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-21T14:42:12.725 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-21T14:42:12.835 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-21T14:42:13.195 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-21T14:42:13.326 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-21T14:42:13.363 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-21T14:42:13.433 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-21T14:42:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-21T14:42:13.987 DEBUG:teuthology.parallel:result is None 2024-05-21T14:42:14.775 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-21T14:42:14.908 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-21T14:42:15.483 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-21T14:42:15.489 DEBUG:teuthology.parallel:result is None 2024-05-21T14:42:15.490 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-21T14:42:15.710 DEBUG:teuthology.orchestra.run.smithi078:> dpkg-query -W -f '${Version}' ceph 2024-05-21T14:42:15.732 INFO:teuthology.orchestra.run.smithi078.stdout:19.0.0-2744-gd2b507c7-1jammy 2024-05-21T14:42:15.733 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2744-gd2b507c7-1jammy 2024-05-21T14:42:15.733 INFO:teuthology.task.install:The correct ceph version 19.0.0-2744-gd2b507c7-1jammy is installed. 2024-05-21T14:42:15.735 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-21T14:42:15.872 DEBUG:teuthology.orchestra.run.smithi084:> dpkg-query -W -f '${Version}' ceph 2024-05-21T14:42:15.892 INFO:teuthology.orchestra.run.smithi084.stdout:19.0.0-2744-gd2b507c7-1jammy 2024-05-21T14:42:15.892 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2744-gd2b507c7-1jammy 2024-05-21T14:42:15.892 INFO:teuthology.task.install:The correct ceph version 19.0.0-2744-gd2b507c7-1jammy is installed. 2024-05-21T14:42:15.894 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-21T14:42:15.894 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:15.895 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-21T14:42:15.915 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:15.915 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-21T14:42:15.945 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-21T14:42:15.946 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:15.946 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2024-05-21T14:42:15.980 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-21T14:42:16.044 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:16.044 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2024-05-21T14:42:16.057 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-21T14:42:16.112 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-21T14:42:16.112 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:16.112 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-21T14:42:16.131 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-21T14:42:16.195 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:16.195 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-21T14:42:16.209 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-21T14:42:16.269 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-21T14:42:16.269 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:16.269 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2024-05-21T14:42:16.288 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-21T14:42:16.352 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:16.352 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2024-05-21T14:42:16.365 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-21T14:42:16.420 INFO:teuthology.run_tasks:Running task ceph... 2024-05-21T14:42:16.492 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-21T14:42:16.492 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2024-05-21T14:42:16.495 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /var/log/ceph 2024-05-21T14:42:16.511 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-21T14:42:16.511 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-21T14:42:16.560 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-21T14:42:16.575 INFO:tasks.ceph:Creating extra log directories... 2024-05-21T14:42:16.576 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-21T14:42:16.625 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-21T14:42:16.646 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-21T14:42:16.646 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-21T14:42:16.646 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-21T14:42:16.646 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:16.647 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-21T14:42:16.693 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-21T14:42:16.782 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:16.782 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-21T14:42:16.787 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-21T14:42:16.865 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-21T14:42:16.865 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'Replacing daemon mds'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-21T14:42:16.865 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7718553', 'branch': 'wip-pdonnell-testing-20240517.203521-squid-debug', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7718553', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240517.203521-squid-debug'}, 'ceph': {'cephfs': {'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'Replacing daemon mds'], 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240517.203521-squid-debug', 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 9749, 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'sleep_before_teardown': 0, 'subset': '272/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240517.203521-squid-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPn9KyXoiqdlMX212cm43NZIIgumn1sh9wo3CxCVcO866TWHepU31Gvg9Nk/esqCqM10Omai7ZLghh9xiwHydAk=', 'smithi084.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHNQEPTlbgn4/F93gLdL4h8XwEQNTjVnBYVOuZkuiDaTTTeYy4AWUJiI6DwAxHIO+zyFKyhLzChmA+m6yXkdF44='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'Replacing daemon mds'], 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['fs/misc/trivial_sync.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a', 'timestamp': '2024-05-21_13:18:14', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-05-21T14:42:16.866 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-21T14:42:16.869 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-21T14:42:16.905 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2024-05-21T14:42:16.920 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/run/ceph 2024-05-21T14:42:16.961 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:16.961 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2024-05-21T14:42:16.985 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-21T14:42:16.985 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2024-05-21T14:42:17.033 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-21T14:42:17.033 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T14:42:17.033 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 888 Links: 1 2024-05-21T14:42:17.033 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T14:42:17.033 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-05-21 14:35:24.135075429 +0000 2024-05-21T14:42:17.033 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-05-21 14:35:24.131075216 +0000 2024-05-21T14:42:17.033 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-05-21 14:35:24.131075216 +0000 2024-05-21T14:42:17.033 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-05-21 14:35:24.131075216 +0000 2024-05-21T14:42:17.034 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-21T14:42:17.090 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-05-21T14:42:17.090 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-05-21T14:42:17.090 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000393117 s, 1.3 MB/s 2024-05-21T14:42:17.092 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-21T14:42:17.143 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2024-05-21T14:42:17.193 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-21T14:42:17.193 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T14:42:17.193 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 904 Links: 1 2024-05-21T14:42:17.193 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T14:42:17.194 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-05-21 14:35:24.643102388 +0000 2024-05-21T14:42:17.194 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-05-21 14:35:24.639102174 +0000 2024-05-21T14:42:17.194 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-05-21 14:35:24.639102174 +0000 2024-05-21T14:42:17.194 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-05-21 14:35:24.639102174 +0000 2024-05-21T14:42:17.194 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-21T14:42:17.250 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-05-21T14:42:17.250 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-05-21T14:42:17.250 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000329548 s, 1.6 MB/s 2024-05-21T14:42:17.252 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-21T14:42:17.303 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2024-05-21T14:42:17.353 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-21T14:42:17.353 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T14:42:17.353 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 922 Links: 1 2024-05-21T14:42:17.353 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T14:42:17.354 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-05-21 14:35:25.455144580 +0000 2024-05-21T14:42:17.354 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-05-21 14:35:25.183130691 +0000 2024-05-21T14:42:17.354 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-05-21 14:35:25.183130691 +0000 2024-05-21T14:42:17.354 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-05-21 14:35:25.183130691 +0000 2024-05-21T14:42:17.354 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-21T14:42:17.410 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-05-21T14:42:17.410 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-05-21T14:42:17.410 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000367113 s, 1.4 MB/s 2024-05-21T14:42:17.412 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-21T14:42:17.467 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2024-05-21T14:42:17.521 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-21T14:42:17.522 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T14:42:17.522 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 938 Links: 1 2024-05-21T14:42:17.522 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T14:42:17.522 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-05-21 14:35:26.047174731 +0000 2024-05-21T14:42:17.522 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-05-21 14:35:25.767160513 +0000 2024-05-21T14:42:17.522 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-05-21 14:35:25.767160513 +0000 2024-05-21T14:42:17.522 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-05-21 14:35:25.767160513 +0000 2024-05-21T14:42:17.522 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-21T14:42:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-05-21T14:42:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-05-21T14:42:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000374556 s, 1.4 MB/s 2024-05-21T14:42:17.584 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-21T14:42:17.639 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-21T14:42:17.639 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:17.639 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2024-05-21T14:42:17.645 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-21T14:42:17.645 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2024-05-21T14:42:17.693 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-21T14:42:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T14:42:17.694 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 880 Links: 1 2024-05-21T14:42:17.694 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T14:42:17.694 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-05-21 14:35:05.702874178 +0000 2024-05-21T14:42:17.694 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-05-21 14:35:05.454876393 +0000 2024-05-21T14:42:17.694 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-05-21 14:35:05.454876393 +0000 2024-05-21T14:42:17.694 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-05-21T14:42:17.694 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-21T14:42:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-05-21T14:42:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-05-21T14:42:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000530623 s, 965 kB/s 2024-05-21T14:42:17.749 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-21T14:42:17.799 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2024-05-21T14:42:17.845 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-21T14:42:17.845 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T14:42:17.845 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-05-21T14:42:17.845 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T14:42:17.845 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-05-21 14:35:06.174869962 +0000 2024-05-21T14:42:17.845 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-05-21 14:35:05.930872141 +0000 2024-05-21T14:42:17.846 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-05-21 14:35:05.930872141 +0000 2024-05-21T14:42:17.846 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-05-21T14:42:17.846 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-21T14:42:17.900 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-05-21T14:42:17.900 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-05-21T14:42:17.900 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000493918 s, 1.0 MB/s 2024-05-21T14:42:17.901 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-21T14:42:17.950 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2024-05-21T14:42:17.997 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-21T14:42:17.998 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T14:42:17.998 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-05-21T14:42:17.998 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T14:42:17.998 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-05-21 14:35:06.690865352 +0000 2024-05-21T14:42:17.998 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-05-21 14:35:06.418867782 +0000 2024-05-21T14:42:17.998 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-05-21 14:35:06.418867782 +0000 2024-05-21T14:42:17.998 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-05-21T14:42:17.998 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-21T14:42:18.051 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-05-21T14:42:18.051 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-05-21T14:42:18.051 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000525528 s, 974 kB/s 2024-05-21T14:42:18.053 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-21T14:42:18.102 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2024-05-21T14:42:18.149 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-21T14:42:18.149 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T14:42:18.149 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-05-21T14:42:18.149 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T14:42:18.149 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-05-21 14:35:07.194860851 +0000 2024-05-21T14:42:18.149 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-05-21 14:35:06.946863066 +0000 2024-05-21T14:42:18.149 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-05-21 14:35:06.946863066 +0000 2024-05-21T14:42:18.149 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-05-21T14:42:18.150 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-21T14:42:18.204 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-05-21T14:42:18.204 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-05-21T14:42:18.204 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000524062 s, 977 kB/s 2024-05-21T14:42:18.205 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-21T14:42:18.255 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-21T14:42:18.255 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-21T14:42:18.255 INFO:tasks.ceph:Generating config... 2024-05-21T14:42:18.256 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-21T14:42:18.256 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-05-21T14:42:18.256 INFO:tasks.ceph:[client] debug client = 20 2024-05-21T14:42:18.256 INFO:tasks.ceph:[client] debug ms = 1 2024-05-21T14:42:18.256 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-21T14:42:18.257 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-21T14:42:18.257 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-21T14:42:18.257 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-21T14:42:18.257 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-21T14:42:18.257 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-21T14:42:18.257 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-05-21T14:42:18.257 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-05-21T14:42:18.257 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-05-21T14:42:18.257 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-05-21T14:42:18.257 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-21T14:42:18.257 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-21T14:42:18.257 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-05-21T14:42:18.257 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-21T14:42:18.257 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-21T14:42:18.258 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-05-21T14:42:18.258 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-05-21T14:42:18.258 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-05-21T14:42:18.258 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-05-21T14:42:18.258 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-05-21T14:42:18.258 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-05-21T14:42:18.258 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-05-21T14:42:18.258 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-21T14:42:18.258 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-21T14:42:18.258 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-21T14:42:18.258 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-21T14:42:18.258 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-21T14:42:18.258 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-21T14:42:18.259 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-21T14:42:18.259 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-21T14:42:18.259 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-21T14:42:18.259 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-21T14:42:18.259 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-21T14:42:18.259 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-21T14:42:18.259 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-05-21T14:42:18.259 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-21T14:42:18.259 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-21T14:42:18.259 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-21T14:42:18.259 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-21T14:42:18.259 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-21T14:42:18.259 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-21T14:42:18.259 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-05-21T14:42:18.260 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-21T14:42:18.260 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-21T14:42:18.260 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-21T14:42:18.260 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-05-21T14:42:18.260 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-05-21T14:42:18.260 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-05-21T14:42:18.260 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-05-21T14:42:18.260 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-21T14:42:18.260 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-21T14:42:18.260 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-21T14:42:18.260 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-21T14:42:18.260 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-21T14:42:18.260 INFO:tasks.ceph:Setting up mon.a... 2024-05-21T14:42:18.261 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-21T14:42:18.317 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.keyring 2024-05-21T14:42:18.331 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-21T14:42:18.387 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-21T14:42:18.406 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.78'), ('mon.b', '172.21.15.84'), ('mon.c', '[v2:172.21.15.84:3301,v1:172.21.15.84:6790]')] 2024-05-21T14:42:18.407 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.78,172.21.15.84,[v2:172.21.15.84:3301,v1:172.21.15.84:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-21T14:42:18.407 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:18.408 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-21T14:42:18.457 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.78 --add b 172.21.15.84 --addv c '[v2:172.21.15.84:3301,v1:172.21.15.84:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-21T14:42:18.552 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-21T14:42:18.552 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: generated fsid 6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa 2024-05-21T14:42:18.552 INFO:teuthology.orchestra.run.smithi078.stdout:setting min_mon_release = quincy 2024-05-21T14:42:18.553 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 0 2024-05-21T14:42:18.553 INFO:teuthology.orchestra.run.smithi078.stdout:fsid 6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa 2024-05-21T14:42:18.553 INFO:teuthology.orchestra.run.smithi078.stdout:last_changed 2024-05-21T14:42:18.548334+0000 2024-05-21T14:42:18.553 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-05-21T14:42:18.548334+0000 2024-05-21T14:42:18.553 INFO:teuthology.orchestra.run.smithi078.stdout:min_mon_release 17 (quincy) 2024-05-21T14:42:18.553 INFO:teuthology.orchestra.run.smithi078.stdout:election_strategy: 1 2024-05-21T14:42:18.553 INFO:teuthology.orchestra.run.smithi078.stdout:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-05-21T14:42:18.553 INFO:teuthology.orchestra.run.smithi078.stdout:1: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.b 2024-05-21T14:42:18.553 INFO:teuthology.orchestra.run.smithi078.stdout:2: [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] mon.c 2024-05-21T14:42:18.553 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-21T14:42:18.556 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-21T14:42:18.563 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa... 2024-05-21T14:42:18.564 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-21T14:42:18.612 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-21T14:42:18.643 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2024-05-21T14:42:18.643 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2024-05-21T14:42:18.643 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-21T14:42:18.643 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2024-05-21T14:42:18.643 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.643 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2024-05-21T14:42:18.643 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.643 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2024-05-21T14:42:18.643 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.644 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2024-05-21T14:42:18.644 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2024-05-21T14:42:18.644 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.644 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2024-05-21T14:42:18.644 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2024-05-21T14:42:18.644 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.644 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-21T14:42:18.644 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2024-05-21T14:42:18.644 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.644 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2024-05-21T14:42:18.644 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-21T14:42:18.644 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.644 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2024-05-21T14:42:18.644 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.645 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2024-05-21T14:42:18.645 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2024-05-21T14:42:18.645 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2024-05-21T14:42:18.645 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2024-05-21T14:42:18.645 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2024-05-21T14:42:18.645 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2024-05-21T14:42:18.645 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2024-05-21T14:42:18.645 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-21T14:42:18.645 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-21T14:42:18.645 INFO:teuthology.orchestra.run.smithi084.stdout: mon_allow_pool_size_one = true 2024-05-21T14:42:18.645 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.645 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-21T14:42:18.645 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.645 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2024-05-21T14:42:18.646 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.646 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2024-05-21T14:42:18.646 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.646 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2024-05-21T14:42:18.646 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2024-05-21T14:42:18.646 INFO:teuthology.orchestra.run.smithi084.stdout: mon health detail to clog = false 2024-05-21T14:42:18.646 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = "172.21.15.78,172.21.15.84,[v2:172.21.15.84:3301,v1:172.21.15.84:6790]" 2024-05-21T14:42:18.646 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on skipped message = False 2024-05-21T14:42:18.646 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa 2024-05-21T14:42:18.646 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.646 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2024-05-21T14:42:18.646 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2024-05-21T14:42:18.646 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.647 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2024-05-21T14:42:18.647 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2024-05-21T14:42:18.647 INFO:teuthology.orchestra.run.smithi084.stdout: osd mclock profile = high_recovery_ops 2024-05-21T14:42:18.647 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.647 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2024-05-21T14:42:18.647 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2024-05-21T14:42:18.647 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.647 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2024-05-21T14:42:18.647 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2024-05-21T14:42:18.647 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2024-05-21T14:42:18.647 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug trim objects = true 2024-05-21T14:42:18.647 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.647 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2024-05-21T14:42:18.647 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2024-05-21T14:42:18.648 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.648 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2024-05-21T14:42:18.648 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.648 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2024-05-21T14:42:18.648 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.648 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2024-05-21T14:42:18.648 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.648 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2024-05-21T14:42:18.648 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2024-05-21T14:42:18.648 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.648 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2024-05-21T14:42:18.648 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2024-05-21T14:42:18.648 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore block size = 96636764160 2024-05-21T14:42:18.649 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore compression mode = aggressive 2024-05-21T14:42:18.649 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore fsck on mount = True 2024-05-21T14:42:18.649 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluefs = 20 2024-05-21T14:42:18.649 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluestore = 20 2024-05-21T14:42:18.649 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-05-21T14:42:18.649 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 20 2024-05-21T14:42:18.649 INFO:teuthology.orchestra.run.smithi084.stdout: debug rocksdb = 10 2024-05-21T14:42:18.649 INFO:teuthology.orchestra.run.smithi084.stdout: mon client directed command retry = 5 2024-05-21T14:42:18.649 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd backfillfull_ratio = 0.85 2024-05-21T14:42:18.649 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd full ratio = 0.9 2024-05-21T14:42:18.649 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd nearfull ratio = 0.8 2024-05-21T14:42:18.649 INFO:teuthology.orchestra.run.smithi084.stdout: ms inject delay max = 1 2024-05-21T14:42:18.649 INFO:teuthology.orchestra.run.smithi084.stdout: ms inject delay probability = 0.005 2024-05-21T14:42:18.649 INFO:teuthology.orchestra.run.smithi084.stdout: ms inject delay type = client mds 2024-05-21T14:42:18.650 INFO:teuthology.orchestra.run.smithi084.stdout: ms inject socket failures = 2500 2024-05-21T14:42:18.650 INFO:teuthology.orchestra.run.smithi084.stdout: osd blocked scrub grace period = 3600 2024-05-21T14:42:18.650 INFO:teuthology.orchestra.run.smithi084.stdout: osd failsafe full ratio = 0.95 2024-05-21T14:42:18.650 INFO:teuthology.orchestra.run.smithi084.stdout: osd max markdown count = 1000 2024-05-21T14:42:18.650 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = bluestore 2024-05-21T14:42:18.650 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2024-05-21T14:42:18.650 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.650 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2024-05-21T14:42:18.650 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-05-21T14:42:18.650 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2024-05-21T14:42:18.650 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2024-05-21T14:42:18.650 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2024-05-21T14:42:18.650 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2024-05-21T14:42:18.650 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2024-05-21T14:42:18.651 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2024-05-21T14:42:18.651 INFO:teuthology.orchestra.run.smithi084.stdout: debug client = 20 2024-05-21T14:42:18.651 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.651 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2024-05-21T14:42:18.651 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-05-21T14:42:18.651 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2024-05-21T14:42:18.651 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2024-05-21T14:42:18.651 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2024-05-21T14:42:18.651 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2024-05-21T14:42:18.651 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2024-05-21T14:42:18.651 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2024-05-21T14:42:18.651 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2024-05-21T14:42:18.651 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2024-05-21T14:42:18.651 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2024-05-21T14:42:18.652 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.652 INFO:teuthology.orchestra.run.smithi084.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-21T14:42:18.652 INFO:teuthology.orchestra.run.smithi084.stdout: auth mon ticket ttl = 660 # 11m 2024-05-21T14:42:18.652 INFO:teuthology.orchestra.run.smithi084.stdout: auth service ticket ttl = 240 # 4m 2024-05-21T14:42:18.652 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.652 INFO:teuthology.orchestra.run.smithi084.stdout: # don't complain about insecure global_id in the test suite 2024-05-21T14:42:18.652 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-21T14:42:18.652 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-21T14:42:18.652 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.652 INFO:teuthology.orchestra.run.smithi084.stdout: # 1m isn't quite enough 2024-05-21T14:42:18.652 INFO:teuthology.orchestra.run.smithi084.stdout: mon_down_mkfs_grace = 2m 2024-05-21T14:42:18.652 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.652 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_filestore_osds = false 2024-05-21T14:42:18.652 INFO:teuthology.orchestra.run.smithi084.stdout: mon down mkfs grace = 300 2024-05-21T14:42:18.652 INFO:teuthology.orchestra.run.smithi084.stdout: mon op complaint time = 120 2024-05-21T14:42:18.653 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-21T14:42:18.653 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2024-05-21T14:42:18.653 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2024-05-21T14:42:18.653 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2024-05-21T14:42:18.653 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2024-05-21T14:42:18.653 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-21T14:42:18.653 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-21T14:42:18.653 INFO:teuthology.orchestra.run.smithi084.stdout: client mount timeout = 600 2024-05-21T14:42:18.653 INFO:teuthology.orchestra.run.smithi084.stdout: client_shutdown_timeout = 120 2024-05-21T14:42:18.653 INFO:teuthology.orchestra.run.smithi084.stdout: debug client = 20 2024-05-21T14:42:18.653 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-05-21T14:42:18.653 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2024-05-21T14:42:18.653 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2024-05-21T14:42:18.653 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2024-05-21T14:42:18.653 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.b] 2024-05-21T14:42:18.654 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.c] 2024-05-21T14:42:18.654 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2024-05-21T14:42:18.654 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2024-05-21T14:42:18.654 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.e] 2024-05-21T14:42:18.654 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2024-05-21T14:42:18.654 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2024-05-21T14:42:18.654 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.f] 2024-05-21T14:42:18.654 INFO:teuthology.orchestra.run.smithi084.stdout:[mds] 2024-05-21T14:42:18.654 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds = 20 2024-05-21T14:42:18.654 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds balancer = 20 2024-05-21T14:42:18.654 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-05-21T14:42:18.654 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal fragment size max = 10000 2024-05-21T14:42:18.654 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal merge size = 5 2024-05-21T14:42:18.655 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal split bits = 3 2024-05-21T14:42:18.655 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal split size = 100 2024-05-21T14:42:18.655 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug frag = True 2024-05-21T14:42:18.655 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug scatterstat = True 2024-05-21T14:42:18.655 INFO:teuthology.orchestra.run.smithi084.stdout: mds oft prefetch dirfrags = True 2024-05-21T14:42:18.655 INFO:teuthology.orchestra.run.smithi084.stdout: mds op complaint time = 180 2024-05-21T14:42:18.655 INFO:teuthology.orchestra.run.smithi084.stdout: mds verify scatter = True 2024-05-21T14:42:18.655 INFO:teuthology.orchestra.run.smithi084.stdout: mds_dir_prefetch = True 2024-05-21T14:42:18.655 INFO:teuthology.orchestra.run.smithi084.stdout: mds_sleep_rank_change = 5000000.0 2024-05-21T14:42:18.655 INFO:teuthology.orchestra.run.smithi084.stdout: mon client directed command retry = 5 2024-05-21T14:42:18.655 INFO:teuthology.orchestra.run.smithi084.stdout: ms inject delay max = 1 2024-05-21T14:42:18.655 INFO:teuthology.orchestra.run.smithi084.stdout: ms inject delay probability = 0.005 2024-05-21T14:42:18.655 INFO:teuthology.orchestra.run.smithi084.stdout: ms inject delay type = client mds osd 2024-05-21T14:42:18.655 INFO:teuthology.orchestra.run.smithi084.stdout: ms inject socket failures = 2500 2024-05-21T14:42:18.655 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2024-05-21T14:42:18.656 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2024-05-21T14:42:18.656 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2024-05-21T14:42:18.656 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2024-05-21T14:42:18.656 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2024-05-21T14:42:18.656 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-21T14:42:18.656 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2024-05-21T14:42:18.657 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.657 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2024-05-21T14:42:18.657 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.657 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2024-05-21T14:42:18.657 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.657 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2024-05-21T14:42:18.657 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2024-05-21T14:42:18.657 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.657 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2024-05-21T14:42:18.657 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2024-05-21T14:42:18.657 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.657 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-21T14:42:18.657 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2024-05-21T14:42:18.657 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.658 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2024-05-21T14:42:18.658 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-21T14:42:18.658 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.658 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2024-05-21T14:42:18.658 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.658 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2024-05-21T14:42:18.658 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2024-05-21T14:42:18.658 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2024-05-21T14:42:18.658 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2024-05-21T14:42:18.658 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2024-05-21T14:42:18.658 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2024-05-21T14:42:18.658 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2024-05-21T14:42:18.658 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-21T14:42:18.659 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-21T14:42:18.659 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2024-05-21T14:42:18.659 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.659 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-21T14:42:18.659 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.659 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2024-05-21T14:42:18.659 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.659 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2024-05-21T14:42:18.659 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.659 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2024-05-21T14:42:18.659 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2024-05-21T14:42:18.659 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2024-05-21T14:42:18.659 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.78,172.21.15.84,[v2:172.21.15.84:3301,v1:172.21.15.84:6790]" 2024-05-21T14:42:18.659 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on skipped message = False 2024-05-21T14:42:18.660 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = 6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa 2024-05-21T14:42:18.660 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.660 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2024-05-21T14:42:18.660 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2024-05-21T14:42:18.660 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.660 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2024-05-21T14:42:18.660 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2024-05-21T14:42:18.660 INFO:teuthology.orchestra.run.smithi078.stdout: osd mclock profile = high_recovery_ops 2024-05-21T14:42:18.660 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.660 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2024-05-21T14:42:18.660 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2024-05-21T14:42:18.660 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.660 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2024-05-21T14:42:18.660 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2024-05-21T14:42:18.661 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2024-05-21T14:42:18.661 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug trim objects = true 2024-05-21T14:42:18.661 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.661 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2024-05-21T14:42:18.661 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2024-05-21T14:42:18.661 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.661 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2024-05-21T14:42:18.661 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.661 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2024-05-21T14:42:18.661 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.661 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2024-05-21T14:42:18.661 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.661 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2024-05-21T14:42:18.661 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2024-05-21T14:42:18.662 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.662 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2024-05-21T14:42:18.662 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2024-05-21T14:42:18.662 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2024-05-21T14:42:18.662 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore compression mode = aggressive 2024-05-21T14:42:18.662 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2024-05-21T14:42:18.662 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 20 2024-05-21T14:42:18.662 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 20 2024-05-21T14:42:18.662 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-05-21T14:42:18.662 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2024-05-21T14:42:18.662 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 10 2024-05-21T14:42:18.662 INFO:teuthology.orchestra.run.smithi078.stdout: mon client directed command retry = 5 2024-05-21T14:42:18.662 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2024-05-21T14:42:18.662 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2024-05-21T14:42:18.663 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2024-05-21T14:42:18.663 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject delay max = 1 2024-05-21T14:42:18.663 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject delay probability = 0.005 2024-05-21T14:42:18.663 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject delay type = client mds 2024-05-21T14:42:18.663 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject socket failures = 2500 2024-05-21T14:42:18.663 INFO:teuthology.orchestra.run.smithi078.stdout: osd blocked scrub grace period = 3600 2024-05-21T14:42:18.663 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2024-05-21T14:42:18.663 INFO:teuthology.orchestra.run.smithi078.stdout: osd max markdown count = 1000 2024-05-21T14:42:18.663 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2024-05-21T14:42:18.663 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2024-05-21T14:42:18.663 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.663 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2024-05-21T14:42:18.663 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-05-21T14:42:18.663 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2024-05-21T14:42:18.664 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-05-21T14:42:18.664 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-05-21T14:42:18.664 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-05-21T14:42:18.664 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-05-21T14:42:18.664 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2024-05-21T14:42:18.664 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2024-05-21T14:42:18.664 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.664 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2024-05-21T14:42:18.664 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-05-21T14:42:18.664 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-05-21T14:42:18.664 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2024-05-21T14:42:18.664 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-05-21T14:42:18.664 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2024-05-21T14:42:18.664 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2024-05-21T14:42:18.664 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-05-21T14:42:18.665 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2024-05-21T14:42:18.665 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2024-05-21T14:42:18.665 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-05-21T14:42:18.665 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.665 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-21T14:42:18.665 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2024-05-21T14:42:18.665 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2024-05-21T14:42:18.665 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.665 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2024-05-21T14:42:18.665 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-21T14:42:18.665 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-21T14:42:18.665 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.665 INFO:teuthology.orchestra.run.smithi078.stdout: # 1m isn't quite enough 2024-05-21T14:42:18.666 INFO:teuthology.orchestra.run.smithi078.stdout: mon_down_mkfs_grace = 2m 2024-05-21T14:42:18.666 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.666 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_filestore_osds = false 2024-05-21T14:42:18.666 INFO:teuthology.orchestra.run.smithi078.stdout: mon down mkfs grace = 300 2024-05-21T14:42:18.666 INFO:teuthology.orchestra.run.smithi078.stdout: mon op complaint time = 120 2024-05-21T14:42:18.666 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:18.666 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2024-05-21T14:42:18.666 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2024-05-21T14:42:18.666 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2024-05-21T14:42:18.666 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2024-05-21T14:42:18.666 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-21T14:42:18.666 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-21T14:42:18.666 INFO:teuthology.orchestra.run.smithi078.stdout: client mount timeout = 600 2024-05-21T14:42:18.666 INFO:teuthology.orchestra.run.smithi078.stdout: client_shutdown_timeout = 120 2024-05-21T14:42:18.667 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2024-05-21T14:42:18.667 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-05-21T14:42:18.667 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2024-05-21T14:42:18.667 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2024-05-21T14:42:18.667 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2024-05-21T14:42:18.667 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2024-05-21T14:42:18.667 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2024-05-21T14:42:18.667 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2024-05-21T14:42:18.667 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2024-05-21T14:42:18.667 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.e] 2024-05-21T14:42:18.667 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2024-05-21T14:42:18.667 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2024-05-21T14:42:18.667 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.f] 2024-05-21T14:42:18.667 INFO:teuthology.orchestra.run.smithi078.stdout:[mds] 2024-05-21T14:42:18.668 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds = 20 2024-05-21T14:42:18.668 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds balancer = 20 2024-05-21T14:42:18.668 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-05-21T14:42:18.668 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal fragment size max = 10000 2024-05-21T14:42:18.668 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal merge size = 5 2024-05-21T14:42:18.668 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal split bits = 3 2024-05-21T14:42:18.668 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal split size = 100 2024-05-21T14:42:18.668 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug frag = True 2024-05-21T14:42:18.668 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug scatterstat = True 2024-05-21T14:42:18.668 INFO:teuthology.orchestra.run.smithi078.stdout: mds oft prefetch dirfrags = True 2024-05-21T14:42:18.668 INFO:teuthology.orchestra.run.smithi078.stdout: mds op complaint time = 180 2024-05-21T14:42:18.668 INFO:teuthology.orchestra.run.smithi078.stdout: mds verify scatter = True 2024-05-21T14:42:18.668 INFO:teuthology.orchestra.run.smithi078.stdout: mds_dir_prefetch = True 2024-05-21T14:42:18.668 INFO:teuthology.orchestra.run.smithi078.stdout: mds_sleep_rank_change = 5000000.0 2024-05-21T14:42:18.669 INFO:teuthology.orchestra.run.smithi078.stdout: mon client directed command retry = 5 2024-05-21T14:42:18.669 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject delay max = 1 2024-05-21T14:42:18.669 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject delay probability = 0.005 2024-05-21T14:42:18.669 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject delay type = client mds osd 2024-05-21T14:42:18.669 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject socket failures = 2500 2024-05-21T14:42:18.669 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2024-05-21T14:42:18.669 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2024-05-21T14:42:18.669 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2024-05-21T14:42:18.670 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-21T14:42:18.670 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-21T14:42:18.783 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-21T14:42:18.783 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:18.783 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-21T14:42:18.791 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:18.791 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-21T14:42:18.845 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2024-05-21T14:42:18.845 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:18.845 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-21T14:42:18.845 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-21T14:42:18.920 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:18.920 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-21T14:42:18.969 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi084.front.sepia.ceph.com 2024-05-21T14:42:18.969 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:18.969 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-21T14:42:18.969 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-21T14:42:18.993 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:18.993 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-21T14:42:19.045 INFO:tasks.ceph:Setting up mon nodes... 2024-05-21T14:42:19.046 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-21T14:42:19.046 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-21T14:42:19.109 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-21T14:42:19.115 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-21T14:42:19.188 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-21T14:42:19.207 INFO:tasks.ceph:Setting up mds nodes... 2024-05-21T14:42:19.207 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-21T14:42:19.271 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-21T14:42:19.276 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-21T14:42:19.295 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-21T14:42:19.404 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-21T14:42:19.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-21T14:42:19.428 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-05-21T14:42:19.532 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-05-21T14:42:19.537 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-05-21T14:42:19.556 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-21T14:42:19.630 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-21T14:42:19.637 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-21T14:42:19.650 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-21T14:42:19.757 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-21T14:42:19.764 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-21T14:42:19.774 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-05-21T14:42:19.879 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-05-21T14:42:19.886 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-05-21T14:42:19.896 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-21T14:42:19.896 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-21T14:42:19.948 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-21T14:42:19.966 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-21T14:42:19.966 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-21T14:42:19.966 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-21T14:42:19.985 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-21T14:42:19.985 INFO:tasks.ceph:role: osd.0 2024-05-21T14:42:19.985 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2024-05-21T14:42:19.985 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-21T14:42:20.055 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T14:42:20.055 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T14:42:20.055 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T14:42:20.056 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T14:42:20.056 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T14:42:20.056 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-05-21T14:42:20.056 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T14:42:20.056 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T14:42:20.056 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T14:42:20.056 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T14:42:20.455 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-05-21T14:42:20.458 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-05-21T14:42:20.458 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-21T14:42:20.557 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-21T14:42:20.573 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T14:42:20.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T14:42:20.574 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-21T14:42:20.640 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-21T14:42:20.641 INFO:tasks.ceph:role: osd.1 2024-05-21T14:42:20.641 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2024-05-21T14:42:20.641 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-21T14:42:20.708 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T14:42:20.708 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T14:42:20.708 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T14:42:20.708 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T14:42:20.708 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T14:42:20.709 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-05-21T14:42:20.709 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T14:42:20.709 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T14:42:20.709 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T14:42:20.709 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T14:42:21.114 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-05-21T14:42:21.116 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-05-21T14:42:21.117 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-21T14:42:21.237 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-21T14:42:21.254 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T14:42:21.254 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T14:42:21.255 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-21T14:42:21.317 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-21T14:42:21.318 INFO:tasks.ceph:role: osd.2 2024-05-21T14:42:21.318 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2024-05-21T14:42:21.318 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-21T14:42:21.389 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T14:42:21.389 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T14:42:21.389 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T14:42:21.389 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T14:42:21.389 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T14:42:21.390 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-05-21T14:42:21.390 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T14:42:21.390 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T14:42:21.390 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T14:42:21.390 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T14:42:21.805 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-05-21T14:42:21.808 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-05-21T14:42:21.808 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-21T14:42:21.922 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-21T14:42:21.941 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T14:42:21.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T14:42:21.943 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-21T14:42:22.009 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-21T14:42:22.010 INFO:tasks.ceph:role: osd.3 2024-05-21T14:42:22.010 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2024-05-21T14:42:22.010 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-21T14:42:22.085 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T14:42:22.085 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T14:42:22.085 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T14:42:22.085 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T14:42:22.085 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T14:42:22.085 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-05-21T14:42:22.085 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T14:42:22.085 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T14:42:22.085 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T14:42:22.086 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T14:42:22.450 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-05-21T14:42:22.453 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-05-21T14:42:22.454 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-21T14:42:22.531 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-21T14:42:22.594 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T14:42:22.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T14:42:22.595 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T14:42:22.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:22.727+0000 7f0b8e42b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-21T14:42:22.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:22.731+0000 7f0b8e42b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-21T14:42:22.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:22.731+0000 7f0b8e42b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-21T14:42:22.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:22.731+0000 7f0b8e42b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-21T14:42:22.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:22.731+0000 7f0b8e42b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-21T14:42:22.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:22.735+0000 7f0b8e42b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-21T14:42:25.807 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-21T14:42:25.827 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T14:42:25.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:25.930+0000 7fe7272fb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-21T14:42:25.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:25.930+0000 7fe7272fb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-21T14:42:25.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:25.930+0000 7fe7272fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-21T14:42:25.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:25.930+0000 7fe7272fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-21T14:42:25.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:25.930+0000 7fe7272fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-21T14:42:25.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:25.930+0000 7fe7272fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-21T14:42:28.990 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-21T14:42:29.011 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T14:42:29.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:29.110+0000 7f548f4697c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-21T14:42:29.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:29.110+0000 7f548f4697c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-21T14:42:29.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:29.110+0000 7f548f4697c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-21T14:42:29.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:29.110+0000 7f548f4697c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-21T14:42:29.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:29.110+0000 7f548f4697c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-21T14:42:29.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:29.110+0000 7f548f4697c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-21T14:42:32.170 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-21T14:42:32.190 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T14:42:32.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:32.294+0000 7f17786727c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-21T14:42:32.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:32.294+0000 7f17786727c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-21T14:42:32.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:32.294+0000 7f17786727c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-21T14:42:32.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:32.294+0000 7f17786727c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-21T14:42:32.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:32.294+0000 7f17786727c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-21T14:42:32.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:32.294+0000 7f17786727c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-21T14:42:35.359 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-21T14:42:35.380 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-21T14:42:35.395 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-21T14:42:35.395 INFO:tasks.ceph:role: osd.4 2024-05-21T14:42:35.395 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com 2024-05-21T14:42:35.395 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-21T14:42:35.458 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T14:42:35.458 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T14:42:35.458 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T14:42:35.458 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T14:42:35.458 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T14:42:35.458 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-05-21T14:42:35.458 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T14:42:35.458 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T14:42:35.458 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T14:42:35.459 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T14:42:35.904 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-05-21T14:42:35.906 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-05-21T14:42:35.906 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-21T14:42:36.005 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-21T14:42:36.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T14:42:36.016 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T14:42:36.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-21T14:42:36.068 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-21T14:42:36.069 INFO:tasks.ceph:role: osd.5 2024-05-21T14:42:36.069 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com 2024-05-21T14:42:36.069 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-21T14:42:36.131 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T14:42:36.131 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T14:42:36.131 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T14:42:36.131 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T14:42:36.131 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T14:42:36.131 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-05-21T14:42:36.131 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T14:42:36.131 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T14:42:36.131 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T14:42:36.131 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T14:42:36.598 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-05-21T14:42:36.601 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-05-21T14:42:36.601 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-21T14:42:36.726 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-21T14:42:36.737 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T14:42:36.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T14:42:36.738 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-21T14:42:36.799 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-21T14:42:36.799 INFO:tasks.ceph:role: osd.6 2024-05-21T14:42:36.799 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com 2024-05-21T14:42:36.799 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-21T14:42:36.862 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T14:42:36.862 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T14:42:36.863 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T14:42:36.863 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T14:42:36.863 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T14:42:36.863 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-05-21T14:42:36.863 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T14:42:36.863 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T14:42:36.863 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T14:42:36.863 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T14:42:37.314 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-05-21T14:42:37.315 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-05-21T14:42:37.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-21T14:42:37.441 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-21T14:42:37.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T14:42:37.454 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T14:42:37.454 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-21T14:42:37.511 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-21T14:42:37.511 INFO:tasks.ceph:role: osd.7 2024-05-21T14:42:37.511 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com 2024-05-21T14:42:37.511 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-21T14:42:37.573 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T14:42:37.573 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T14:42:37.574 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T14:42:37.574 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T14:42:37.574 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T14:42:37.574 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-05-21T14:42:37.574 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T14:42:37.574 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T14:42:37.574 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T14:42:37.574 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T14:42:38.020 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-05-21T14:42:38.022 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-05-21T14:42:38.022 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-21T14:42:38.114 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-21T14:42:38.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T14:42:38.173 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T14:42:38.174 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T14:42:38.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:38.317+0000 7fe2e8f797c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-21T14:42:38.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:38.317+0000 7fe2e8f797c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-21T14:42:38.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:38.317+0000 7fe2e8f797c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-21T14:42:38.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:38.317+0000 7fe2e8f797c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-21T14:42:38.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:38.317+0000 7fe2e8f797c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-21T14:42:38.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:38.321+0000 7fe2e8f797c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-21T14:42:41.302 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-21T14:42:41.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T14:42:41.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:41.420+0000 7f4e0e6fe7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-21T14:42:41.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:41.420+0000 7f4e0e6fe7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-21T14:42:41.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:41.420+0000 7f4e0e6fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-21T14:42:41.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:41.420+0000 7f4e0e6fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-21T14:42:41.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:41.420+0000 7f4e0e6fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-21T14:42:41.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:41.420+0000 7f4e0e6fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-21T14:42:44.409 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-21T14:42:44.421 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T14:42:44.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:44.524+0000 7f1edb29c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-21T14:42:44.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:44.524+0000 7f1edb29c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-21T14:42:44.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:44.524+0000 7f1edb29c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-21T14:42:44.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:44.524+0000 7f1edb29c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-21T14:42:44.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:44.524+0000 7f1edb29c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-21T14:42:44.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:44.524+0000 7f1edb29c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-21T14:42:46.869 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:42:46.873 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:42:47.562 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-21T14:42:47.575 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T14:42:47.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:47.680+0000 7fd55dc2b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-21T14:42:47.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:47.680+0000 7fd55dc2b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-21T14:42:47.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:47.680+0000 7fd55dc2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-21T14:42:47.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:47.680+0000 7fd55dc2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-21T14:42:47.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:47.680+0000 7fd55dc2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-21T14:42:47.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:47.680+0000 7fd55dc2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-21T14:42:50.679 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-21T14:42:50.693 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-21T14:42:50.693 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:50.693 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-21T14:42:50.714 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:50.714 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-21T14:42:50.778 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:50.778 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-21T14:42:50.846 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:50.846 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-05-21T14:42:50.909 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:50.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-21T14:42:50.973 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:50.973 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-21T14:42:51.037 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:51.037 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-21T14:42:51.097 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:51.097 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-21T14:42:51.161 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:51.161 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-21T14:42:51.175 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:51.175 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-21T14:42:51.231 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:51.231 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-21T14:42:51.286 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:51.287 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-05-21T14:42:51.342 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:51.342 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-21T14:42:51.398 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:51.398 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-21T14:42:51.454 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:51.454 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-21T14:42:51.506 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:51.506 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-21T14:42:51.563 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:51.563 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-21T14:42:51.571 INFO:tasks.ceph:Adding keys to all mons... 2024-05-21T14:42:51.571 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-21T14:42:51.621 DEBUG:teuthology.orchestra.run.smithi084:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-21T14:42:51.633 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.y] 2024-05-21T14:42:51.633 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDLskxm/QFHBhAAi+BfyjdCei/L+Z3/Yc8eEg== 2024-05-21T14:42:51.633 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2024-05-21T14:42:51.633 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDLskxmPxD1DxAAmzMzY6PUPQsLoiaVgGGwjg== 2024-05-21T14:42:51.633 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2024-05-21T14:42:51.633 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDLskxmINHiFxAAGGEFMUs1oMVo0L8sl9SUxg== 2024-05-21T14:42:51.633 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.e] 2024-05-21T14:42:51.633 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDLskxmf9l+HxAAha6NGtEqzjQhygBt7xMfTw== 2024-05-21T14:42:51.633 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.0] 2024-05-21T14:42:51.634 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDOskxm27SiKxAAXeUzpKvsxKRc79HShHxgzQ== 2024-05-21T14:42:51.634 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.1] 2024-05-21T14:42:51.634 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDRskxmNSy5NxAANyZaTuMilSL8EC4i++BEFg== 2024-05-21T14:42:51.634 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.2] 2024-05-21T14:42:51.634 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDVskxm5N/SBhAA1r9wjb21ERfWjm2SFH0JRA== 2024-05-21T14:42:51.634 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.3] 2024-05-21T14:42:51.634 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDYskxm7KjTERAA/TORFS8OfvrW9gOHD2iPFw== 2024-05-21T14:42:51.634 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.x] 2024-05-21T14:42:51.634 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDLskxm55cICxAAGdnRpuB80/oEfM523+L24w== 2024-05-21T14:42:51.634 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2024-05-21T14:42:51.634 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDLskxmPjxeJRAA8qXa2t48tnbLu1SSWL/AeA== 2024-05-21T14:42:51.635 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2024-05-21T14:42:51.635 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDLskxmdUrqLBAAJ81s0rRW1MAGddlYZ17vBQ== 2024-05-21T14:42:51.635 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.f] 2024-05-21T14:42:51.635 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDLskxm3OEvNBAAEKEV1db+go0srBobixxH0A== 2024-05-21T14:42:51.635 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.4] 2024-05-21T14:42:51.635 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDeskxmJX3vEhAA8cJotT8JoxebS2CSmbzV+Q== 2024-05-21T14:42:51.635 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.5] 2024-05-21T14:42:51.635 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDhskxmWFhBGRAAJp9FQo9h6HTpcDU1WMNcGQ== 2024-05-21T14:42:51.635 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.6] 2024-05-21T14:42:51.635 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDkskxmhRRyHxAAS6ViaCw8vf2VYZW0bqDK8A== 2024-05-21T14:42:51.635 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.7] 2024-05-21T14:42:51.635 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDnskxmNo+/KBAAwhwndQupYqZZA1CcwvY1VQ== 2024-05-21T14:42:51.635 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2024-05-21T14:42:51.635 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDLskxmTYZIOBAAZnanBgjSImYhwMtrYb52dA== 2024-05-21T14:42:51.636 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2024-05-21T14:42:51.636 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDLskxm/QFHBhAAi+BfyjdCei/L+Z3/Yc8eEg== 2024-05-21T14:42:51.636 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2024-05-21T14:42:51.636 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDLskxmPxD1DxAAmzMzY6PUPQsLoiaVgGGwjg== 2024-05-21T14:42:51.637 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2024-05-21T14:42:51.637 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDLskxmINHiFxAAGGEFMUs1oMVo0L8sl9SUxg== 2024-05-21T14:42:51.637 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.e] 2024-05-21T14:42:51.637 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDLskxmf9l+HxAAha6NGtEqzjQhygBt7xMfTw== 2024-05-21T14:42:51.637 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2024-05-21T14:42:51.637 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDOskxm27SiKxAAXeUzpKvsxKRc79HShHxgzQ== 2024-05-21T14:42:51.638 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2024-05-21T14:42:51.638 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDRskxmNSy5NxAANyZaTuMilSL8EC4i++BEFg== 2024-05-21T14:42:51.638 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2024-05-21T14:42:51.638 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDVskxm5N/SBhAA1r9wjb21ERfWjm2SFH0JRA== 2024-05-21T14:42:51.638 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2024-05-21T14:42:51.638 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDYskxm7KjTERAA/TORFS8OfvrW9gOHD2iPFw== 2024-05-21T14:42:51.638 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2024-05-21T14:42:51.638 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDLskxm55cICxAAGdnRpuB80/oEfM523+L24w== 2024-05-21T14:42:51.638 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2024-05-21T14:42:51.638 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDLskxmPjxeJRAA8qXa2t48tnbLu1SSWL/AeA== 2024-05-21T14:42:51.638 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2024-05-21T14:42:51.638 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDLskxmdUrqLBAAJ81s0rRW1MAGddlYZ17vBQ== 2024-05-21T14:42:51.639 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.f] 2024-05-21T14:42:51.639 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDLskxm3OEvNBAAEKEV1db+go0srBobixxH0A== 2024-05-21T14:42:51.639 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.4] 2024-05-21T14:42:51.639 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDeskxmJX3vEhAA8cJotT8JoxebS2CSmbzV+Q== 2024-05-21T14:42:51.639 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.5] 2024-05-21T14:42:51.639 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDhskxmWFhBGRAAJp9FQo9h6HTpcDU1WMNcGQ== 2024-05-21T14:42:51.639 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.6] 2024-05-21T14:42:51.639 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDkskxmhRRyHxAAS6ViaCw8vf2VYZW0bqDK8A== 2024-05-21T14:42:51.639 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.7] 2024-05-21T14:42:51.639 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDnskxmNo+/KBAAwhwndQupYqZZA1CcwvY1VQ== 2024-05-21T14:42:51.639 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-05-21T14:42:51.639 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDLskxmTYZIOBAAZnanBgjSImYhwMtrYb52dA== 2024-05-21T14:42:51.641 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-21T14:42:51.685 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-21T14:42:51.764 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T14:42:51.768 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T14:42:51.841 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T14:42:51.845 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T14:42:51.916 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T14:42:51.920 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T14:42:51.995 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T14:42:51.999 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T14:42:52.066 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T14:42:52.070 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T14:42:52.137 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T14:42:52.140 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T14:42:52.209 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T14:42:52.212 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T14:42:52.281 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-21T14:42:52.285 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-21T14:42:52.359 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T14:42:52.362 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T14:42:52.432 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T14:42:52.436 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T14:42:52.507 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T14:42:52.510 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T14:42:52.582 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T14:42:52.586 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T14:42:52.655 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T14:42:52.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T14:42:52.726 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T14:42:52.729 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T14:42:52.803 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T14:42:52.807 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T14:42:52.879 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-21T14:42:52.883 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-21T14:42:52.953 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-21T14:42:52.954 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-21T14:42:52.973 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-21T14:42:53.089 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-21T14:42:53.108 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-21T14:42:53.122 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-21T14:42:53.247 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-21T14:42:53.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-21T14:42:53.311 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-21T14:42:53.433 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-21T14:42:53.444 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-21T14:42:53.447 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-21T14:42:53.491 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-21T14:42:53.491 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-21T14:42:53.491 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-21T14:42:53.496 INFO:tasks.ceph.mon.a:Started 2024-05-21T14:42:53.496 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-21T14:42:53.497 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-21T14:42:53.536 INFO:tasks.ceph.mon.b:Started 2024-05-21T14:42:53.536 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-21T14:42:53.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-21T14:42:53.539 INFO:tasks.ceph.mon.c:Started 2024-05-21T14:42:53.539 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-21T14:42:53.539 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-21T14:42:53.539 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-21T14:42:53.543 INFO:tasks.ceph.mgr.y:Started 2024-05-21T14:42:53.543 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-21T14:42:53.543 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-21T14:42:53.545 INFO:tasks.ceph.mgr.x:Started 2024-05-21T14:42:53.545 INFO:tasks.ceph:Setting crush tunables to default 2024-05-21T14:42:53.545 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd crush tunables default 2024-05-21T14:42:53.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.690+0000 7f8f18a00640 1 Processor -- start 2024-05-21T14:42:53.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f18a00640 1 -- start start 2024-05-21T14:42:53.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f18a00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f140c8480 0x7f8f140c0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:53.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f18a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8f14072ba0 0x7f8f14072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:53.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f18a00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f140c0e60 con 0x7f8f1415ba20 2024-05-21T14:42:53.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f18a00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f8f14074fc0 con 0x7f8f140c8480 2024-05-21T14:42:53.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f18a00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f8f14071c50 con 0x7f8f14072ba0 2024-05-21T14:42:53.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f12a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8f14072ba0 0x7f8f14072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f12a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8f14072ba0 0x7f8f14072fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:42900/0 (socket says 172.21.15.78:42900) 2024-05-21T14:42:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f12a00640 1 -- 172.21.15.78:0/2901032492 learned_addr learned my addr 172.21.15.78:0/2901032492 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:42:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f13400640 1 --2- 172.21.15.78:0/2901032492 >> v2:172.21.15.78:3300/0 conn(0x7f8f140c8480 0x7f8f140c0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f12a00640 1 -- 172.21.15.78:0/2901032492 >> v2:172.21.15.84:3300/0 conn(0x7f8f14072ba0 msgr2=0x7f8f14072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-21T14:42:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f12a00640 1 -- 172.21.15.78:0/2901032492 >> v2:172.21.15.84:3300/0 conn(0x7f8f14072ba0 msgr2=0x7f8f14072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T14:42:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f12a00640 1 --2- 172.21.15.78:0/2901032492 >> v2:172.21.15.84:3300/0 conn(0x7f8f14072ba0 0x7f8f14072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T14:42:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f12a00640 1 --2- 172.21.15.78:0/2901032492 >> v2:172.21.15.84:3300/0 conn(0x7f8f14072ba0 0x7f8f14072fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-21T14:42:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f13400640 1 -- 172.21.15.78:0/2901032492 >> v2:172.21.15.78:3300/0 conn(0x7f8f140c8480 msgr2=0x7f8f140c0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-21T14:42:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f13400640 1 -- 172.21.15.78:0/2901032492 >> v2:172.21.15.78:3300/0 conn(0x7f8f140c8480 msgr2=0x7f8f140c0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T14:42:53.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f13400640 1 --2- 172.21.15.78:0/2901032492 >> v2:172.21.15.78:3300/0 conn(0x7f8f140c8480 0x7f8f140c0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T14:42:53.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.694+0000 7f8f13400640 1 --2- 172.21.15.78:0/2901032492 >> v2:172.21.15.78:3300/0 conn(0x7f8f140c8480 0x7f8f140c0920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-21T14:42:53.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.898+0000 7f8f13400640 1 --2- 172.21.15.78:0/2901032492 >> v2:172.21.15.78:3300/0 conn(0x7f8f140c8480 0x7f8f140c0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:53.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.898+0000 7f8f13400640 1 -- 172.21.15.78:0/2901032492 >> v2:172.21.15.78:3300/0 conn(0x7f8f140c8480 msgr2=0x7f8f140c0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-21T14:42:53.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.898+0000 7f8f13400640 1 -- 172.21.15.78:0/2901032492 >> v2:172.21.15.78:3300/0 conn(0x7f8f140c8480 msgr2=0x7f8f140c0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T14:42:53.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.898+0000 7f8f13400640 1 --2- 172.21.15.78:0/2901032492 >> v2:172.21.15.78:3300/0 conn(0x7f8f140c8480 0x7f8f140c0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T14:42:53.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.898+0000 7f8f12a00640 1 --2- 172.21.15.78:0/2901032492 >> v2:172.21.15.84:3300/0 conn(0x7f8f14072ba0 0x7f8f14072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:53.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.898+0000 7f8f13400640 1 --2- 172.21.15.78:0/2901032492 >> v2:172.21.15.78:3300/0 conn(0x7f8f140c8480 0x7f8f140c0920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-21T14:42:53.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.898+0000 7f8f12a00640 1 -- 172.21.15.78:0/2901032492 >> v2:172.21.15.84:3300/0 conn(0x7f8f14072ba0 msgr2=0x7f8f14072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-21T14:42:53.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.898+0000 7f8f12a00640 1 -- 172.21.15.78:0/2901032492 >> v2:172.21.15.84:3300/0 conn(0x7f8f14072ba0 msgr2=0x7f8f14072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T14:42:53.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.898+0000 7f8f12a00640 1 --2- 172.21.15.78:0/2901032492 >> v2:172.21.15.84:3300/0 conn(0x7f8f14072ba0 0x7f8f14072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T14:42:53.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.898+0000 7f8f12a00640 1 --2- 172.21.15.78:0/2901032492 >> v2:172.21.15.84:3300/0 conn(0x7f8f14072ba0 0x7f8f14072fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-21T14:42:53.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f12000640 1 -- 172.21.15.78:0/2901032492 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3495687300 0 0) 0x7f8f140c0e60 con 0x7f8f1415ba20 2024-05-21T14:42:53.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f12000640 1 -- 172.21.15.78:0/2901032492 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ef8003530 con 0x7f8f1415ba20 2024-05-21T14:42:53.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f12000640 1 -- 172.21.15.78:0/2901032492 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1595063641 0 0) 0x7f8ef8003530 con 0x7f8f1415ba20 2024-05-21T14:42:53.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f12000640 1 -- 172.21.15.78:0/2901032492 >> v2:172.21.15.84:3300/0 conn(0x7f8f14072ba0 msgr2=0x7f8f14072fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-21T14:42:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f12000640 1 --2- 172.21.15.78:0/2901032492 >> v2:172.21.15.84:3300/0 conn(0x7f8f14072ba0 0x7f8f14072fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f12000640 1 -- 172.21.15.78:0/2901032492 >> v2:172.21.15.78:3300/0 conn(0x7f8f140c8480 msgr2=0x7f8f140c0920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-21T14:42:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f12000640 1 --2- 172.21.15.78:0/2901032492 >> v2:172.21.15.78:3300/0 conn(0x7f8f140c8480 0x7f8f140c0920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f12000640 1 -- 172.21.15.78:0/2901032492 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f14071f30 con 0x7f8f1415ba20 2024-05-21T14:42:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f12000640 1 -- 172.21.15.78:0/2901032492 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7f8f0c001a00 con 0x7f8f1415ba20 2024-05-21T14:42:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f12000640 1 -- 172.21.15.78:0/2901032492 >> v1:172.21.15.78:6789/0 conn(0x7f8f1415ba20 legacy=0x7f8f1415be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f12000640 1 --2- 172.21.15.78:0/2901032492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef80039c0 0x7f8ef8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f12000640 1 --2- 172.21.15.78:0/2901032492 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ef8004810 0x7f8ef8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f12000640 1 --2- 172.21.15.78:0/2901032492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ef80051b0 0x7f8ef800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f12000640 1 -- 172.21.15.78:0/2901032492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8f14074fc0 con 0x7f8ef80039c0 2024-05-21T14:42:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f12000640 1 -- 172.21.15.78:0/2901032492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8f14071c50 con 0x7f8ef80051b0 2024-05-21T14:42:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f12000640 1 -- 172.21.15.78:0/2901032492 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8ef800c1b0 con 0x7f8ef8004810 2024-05-21T14:42:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f13400640 1 --2- 172.21.15.78:0/2901032492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef80039c0 0x7f8ef8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:53.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f12a00640 1 --2- 172.21.15.78:0/2901032492 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ef8004810 0x7f8ef8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:53.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f13e00640 1 --2- 172.21.15.78:0/2901032492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ef80051b0 0x7f8ef800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:53.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f13400640 1 -- 172.21.15.78:0/2901032492 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ef8004810 msgr2=0x7f8ef8004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:42:53.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f13400640 1 --2- 172.21.15.78:0/2901032492 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ef8004810 0x7f8ef8004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:53.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f13400640 1 -- 172.21.15.78:0/2901032492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ef80051b0 msgr2=0x7f8ef800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:42:53.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f13400640 1 --2- 172.21.15.78:0/2901032492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ef80051b0 0x7f8ef800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:53.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f13e00640 1 -- 172.21.15.78:0/2901032492 reap_dead start 2024-05-21T14:42:53.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.918+0000 7f8f13400640 1 -- 172.21.15.78:0/2901032492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef8003530 con 0x7f8ef80039c0 2024-05-21T14:42:53.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.922+0000 7f8f13400640 1 --2- 172.21.15.78:0/2901032492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef80039c0 0x7f8ef8003e30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400e8d0 tx=0x7f8f0401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0343101043e524 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:53.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.922+0000 7f8f12000640 1 -- 172.21.15.78:0/2901032492 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f040ab070 con 0x7f8ef80039c0 2024-05-21T14:42:53.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.922+0000 7f8f12000640 1 -- 172.21.15.78:0/2901032492 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f040a5770 con 0x7f8ef80039c0 2024-05-21T14:42:53.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.922+0000 7f8f12000640 1 -- 172.21.15.78:0/2901032492 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0400f040 con 0x7f8ef80039c0 2024-05-21T14:42:53.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.922+0000 7f8f18a00640 1 -- 172.21.15.78:0/2901032492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef80039c0 msgr2=0x7f8ef8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:53.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.922+0000 7f8f18a00640 1 --2- 172.21.15.78:0/2901032492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef80039c0 0x7f8ef8003e30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400e8d0 tx=0x7f8f0401c870 comp rx=0 tx=0).stop 2024-05-21T14:42:53.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.922+0000 7f8f18a00640 1 -- 172.21.15.78:0/2901032492 shutdown_connections 2024-05-21T14:42:53.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.922+0000 7f8f18a00640 1 --2- 172.21.15.78:0/2901032492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef80039c0 0x7f8ef8003e30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:53.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.922+0000 7f8f18a00640 1 -- 172.21.15.78:0/2901032492 >> 172.21.15.78:0/2901032492 conn(0x7f8f14070220 msgr2=0x7f8f1406b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:53.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.926+0000 7f8f18a00640 1 -- 172.21.15.78:0/2901032492 shutdown_connections 2024-05-21T14:42:53.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.926+0000 7f8f18a00640 1 -- 172.21.15.78:0/2901032492 wait complete. 2024-05-21T14:42:53.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.926+0000 7f8f18a00640 1 Processor -- start 2024-05-21T14:42:53.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.926+0000 7f8f18a00640 1 -- start start 2024-05-21T14:42:53.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f18a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef80039c0 0x7f8f141f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:53.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f18a00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8f14158ec0 0x7f8f140cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:53.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f13400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef80039c0 0x7f8f141f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:53.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f18a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f14154790 0x7f8f14149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:53.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f18a00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8f140c8c50 con 0x7f8ef80039c0 2024-05-21T14:42:53.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f18a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8f140724f0 con 0x7f8f14154790 2024-05-21T14:42:53.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f18a00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8f140c8890 con 0x7f8f14158ec0 2024-05-21T14:42:53.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f13400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef80039c0 0x7f8f141f2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38972/0 (socket says 172.21.15.78:38972) 2024-05-21T14:42:53.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f13400640 1 -- 172.21.15.78:0/3326675910 learned_addr learned my addr 172.21.15.78:0/3326675910 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:42:53.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f13e00640 1 --2- 172.21.15.78:0/3326675910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f14154790 0x7f8f14149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:53.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f12a00640 1 --2- 172.21.15.78:0/3326675910 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8f14158ec0 0x7f8f140cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:53.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f13400640 1 -- 172.21.15.78:0/3326675910 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8f14158ec0 msgr2=0x7f8f140cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:53.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f13400640 1 --2- 172.21.15.78:0/3326675910 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8f14158ec0 0x7f8f140cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:53.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f13400640 1 -- 172.21.15.78:0/3326675910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f14154790 msgr2=0x7f8f14149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:53.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f13400640 1 --2- 172.21.15.78:0/3326675910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f14154790 0x7f8f14149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:53.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f13400640 1 -- 172.21.15.78:0/3326675910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f141f2f80 con 0x7f8ef80039c0 2024-05-21T14:42:53.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f12a00640 1 --2- 172.21.15.78:0/3326675910 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8f14158ec0 0x7f8f140cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:42:53.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f13400640 1 --2- 172.21.15.78:0/3326675910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef80039c0 0x7f8f141f2a40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f040b1040 tx=0x7f8ef8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:53.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f0b400640 1 -- 172.21.15.78:0/3326675910 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f040be070 con 0x7f8ef80039c0 2024-05-21T14:42:53.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f0b400640 1 -- 172.21.15.78:0/3326675910 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f040af610 con 0x7f8ef80039c0 2024-05-21T14:42:53.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f18a00640 1 -- 172.21.15.78:0/3326675910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f141f61e0 con 0x7f8ef80039c0 2024-05-21T14:42:53.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f0b400640 1 -- 172.21.15.78:0/3326675910 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f040ab040 con 0x7f8ef80039c0 2024-05-21T14:42:53.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f18a00640 1 -- 172.21.15.78:0/3326675910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f141f2520 con 0x7f8ef80039c0 2024-05-21T14:42:53.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f0b400640 1 -- 172.21.15.78:0/3326675910 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8f040c1070 con 0x7f8ef80039c0 2024-05-21T14:42:53.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.930+0000 7f8f0b400640 1 -- 172.21.15.78:0/3326675910 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8f040c39b0 con 0x7f8ef80039c0 2024-05-21T14:42:53.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.934+0000 7f8f18a00640 1 -- 172.21.15.78:0/3326675910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f1404f730 con 0x7f8ef80039c0 2024-05-21T14:42:53.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:53.942+0000 7f8f0b400640 1 -- 172.21.15.78:0/3326675910 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8f040dadd0 con 0x7f8ef80039c0 2024-05-21T14:42:54.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:54.002+0000 7f8f18a00640 1 -- 172.21.15.78:0/3326675910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8f140ca4d0 con 0x7f8ef80039c0 2024-05-21T14:42:54.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:54.002+0000 7f8f0b400640 1 -- 172.21.15.78:0/3326675910 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f8f040c9070 con 0x7f8ef80039c0 2024-05-21T14:42:54.010 INFO:teuthology.orchestra.run.smithi078.stderr:adjusted tunables profile to default 2024-05-21T14:42:54.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:54.006+0000 7f8f18a00640 1 -- 172.21.15.78:0/3326675910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef80039c0 msgr2=0x7f8f141f2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:54.006+0000 7f8f18a00640 1 --2- 172.21.15.78:0/3326675910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef80039c0 0x7f8f141f2a40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f040b1040 tx=0x7f8ef8005840 comp rx=0 tx=0).stop 2024-05-21T14:42:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:54.006+0000 7f8f18a00640 1 -- 172.21.15.78:0/3326675910 shutdown_connections 2024-05-21T14:42:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:54.006+0000 7f8f18a00640 1 --2- 172.21.15.78:0/3326675910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f14154790 0x7f8f14149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:54.006+0000 7f8f18a00640 1 --2- 172.21.15.78:0/3326675910 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8f14158ec0 0x7f8f140cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:54.006+0000 7f8f18a00640 1 --2- 172.21.15.78:0/3326675910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ef80039c0 0x7f8f141f2a40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:54.006+0000 7f8f18a00640 1 -- 172.21.15.78:0/3326675910 >> 172.21.15.78:0/3326675910 conn(0x7f8f14070220 msgr2=0x7f8f1406db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:54.006+0000 7f8f18a00640 1 -- 172.21.15.78:0/3326675910 shutdown_connections 2024-05-21T14:42:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:54.006+0000 7f8f18a00640 1 -- 172.21.15.78:0/3326675910 wait complete. 2024-05-21T14:42:54.032 INFO:tasks.ceph:check_enable_crimson: False 2024-05-21T14:42:54.033 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-21T14:42:54.033 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:54.033 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-21T14:42:54.052 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:54.052 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-21T14:42:54.113 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:54.113 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-21T14:42:54.123 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:54.116+0000 7fb5815d3180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-21T14:42:54.164 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:54.158+0000 7feaaae49180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-21T14:42:54.174 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:42:54.174 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-21T14:42:54.233 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:54.234 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-21T14:42:54.246 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:54.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-21T14:42:54.301 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:54.301 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-21T14:42:54.358 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-21T14:42:54.358 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-21T14:42:54.413 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 29c2e728-8789-46bd-8f2d-d6d00fefbdbd 0 2024-05-21T14:42:54.594 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:54.588+0000 7fb5815d3180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-21T14:42:54.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.596+0000 7f7ec2818640 1 Processor -- start 2024-05-21T14:42:54.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.596+0000 7f7ec2818640 1 -- start start 2024-05-21T14:42:54.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.596+0000 7f7ec2818640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7ebc158620 0x7f7ebc1527c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:54.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.596+0000 7f7ec2818640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7ebc073450 0x7f7ebc0c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:54.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.596+0000 7f7ec2818640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ebc072580 con 0x7f7ebc0c90a0 2024-05-21T14:42:54.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.596+0000 7f7ec2818640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f7ebc158a30 con 0x7f7ebc073450 2024-05-21T14:42:54.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.596+0000 7f7ec2818640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f7ebc158c60 con 0x7f7ebc158620 2024-05-21T14:42:54.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.596+0000 7f7ec0db5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7ebc073450 0x7f7ebc0c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:54.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.596+0000 7f7ebb7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7ebc0c90a0 0x7f7ebc072d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40472/0 (socket says 172.21.15.84:40472) 2024-05-21T14:42:54.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.596+0000 7f7ebb7fe640 1 -- 172.21.15.84:0/1030080328 learned_addr learned my addr 172.21.15.84:0/1030080328 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-05-21T14:42:54.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.596+0000 7f7ebbfff640 1 --2- 172.21.15.84:0/1030080328 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7ebc158620 0x7f7ebc1527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:54.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.596+0000 7f7ebbfff640 1 -- 172.21.15.84:0/1030080328 >> v2:172.21.15.84:3300/0 conn(0x7f7ebc073450 msgr2=0x7f7ebc0c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:42:54.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.596+0000 7f7ebbfff640 1 --2- 172.21.15.84:0/1030080328 >> v2:172.21.15.84:3300/0 conn(0x7f7ebc073450 0x7f7ebc0c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.596+0000 7f7ebbfff640 1 -- 172.21.15.84:0/1030080328 >> v1:172.21.15.84:6789/0 conn(0x7f7ebc0c90a0 legacy=0x7f7ebc072d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:54.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.596+0000 7f7ebaffd640 1 -- 172.21.15.84:0/1030080328 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692084574 0 0) 0x7f7ebc072580 con 0x7f7ebc0c90a0 2024-05-21T14:42:54.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.596+0000 7f7ebbfff640 1 -- 172.21.15.84:0/1030080328 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ebc158f40 con 0x7f7ebc158620 2024-05-21T14:42:54.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.596+0000 7f7ec0db5640 1 --2- 172.21.15.84:0/1030080328 >> v2:172.21.15.84:3300/0 conn(0x7f7ebc073450 0x7f7ebc0c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:42:54.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.600+0000 7f7ebbfff640 1 --2- 172.21.15.84:0/1030080328 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7ebc158620 0x7f7ebc1527c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0097c0 tx=0x7f7eac01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b29c3d5b94925359 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:54.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.600+0000 7f7ebaffd640 1 -- 172.21.15.84:0/1030080328 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0b5070 con 0x7f7ebc158620 2024-05-21T14:42:54.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.600+0000 7f7ebaffd640 1 -- 172.21.15.84:0/1030080328 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eac0a8990 con 0x7f7ebc158620 2024-05-21T14:42:54.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.600+0000 7f7ebaffd640 1 -- 172.21.15.84:0/1030080328 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0a8d60 con 0x7f7ebc158620 2024-05-21T14:42:54.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.600+0000 7f7ec2818640 1 -- 172.21.15.84:0/1030080328 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7ebc158620 msgr2=0x7f7ebc1527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.600+0000 7f7ec2818640 1 --2- 172.21.15.84:0/1030080328 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7ebc158620 0x7f7ebc1527c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0097c0 tx=0x7f7eac01ec90 comp rx=0 tx=0).stop 2024-05-21T14:42:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.600+0000 7f7ec2818640 1 -- 172.21.15.84:0/1030080328 shutdown_connections 2024-05-21T14:42:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.600+0000 7f7ec2818640 1 --2- 172.21.15.84:0/1030080328 >> v2:172.21.15.84:3300/0 conn(0x7f7ebc073450 0x7f7ebc0c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.600+0000 7f7ec2818640 1 --2- 172.21.15.84:0/1030080328 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7ebc158620 0x7f7ebc1527c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.600+0000 7f7ec2818640 1 -- 172.21.15.84:0/1030080328 >> 172.21.15.84:0/1030080328 conn(0x7f7ebc0ca3d0 msgr2=0x7f7ebc0ca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.600+0000 7f7ec2818640 1 -- 172.21.15.84:0/1030080328 shutdown_connections 2024-05-21T14:42:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.600+0000 7f7ec2818640 1 -- 172.21.15.84:0/1030080328 wait complete. 2024-05-21T14:42:54.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.600+0000 7f7ec2818640 1 Processor -- start 2024-05-21T14:42:54.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.600+0000 7f7ec2818640 1 -- start start 2024-05-21T14:42:54.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ec2818640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ebc073450 0x7f7ebc157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:54.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ec2818640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7ebc0c90a0 0x7f7ebc146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:54.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ec2818640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ebc158620 0x7f7ebc0c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:54.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ec2818640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7ebc159500 con 0x7f7ebc158620 2024-05-21T14:42:54.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ec2818640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7ebc072820 con 0x7f7ebc073450 2024-05-21T14:42:54.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ec2818640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f7ebc152d00 con 0x7f7ebc0c90a0 2024-05-21T14:42:54.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ebbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ebc073450 0x7f7ebc157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:54.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ebbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ebc073450 0x7f7ebc157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57588/0 (socket says 172.21.15.84:57588) 2024-05-21T14:42:54.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ebbfff640 1 -- 172.21.15.84:0/3942711811 learned_addr learned my addr 172.21.15.84:0/3942711811 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-21T14:42:54.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ebb7fe640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7ebc0c90a0 0x7f7ebc146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:54.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ec0db5640 1 --2- 172.21.15.84:0/3942711811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ebc158620 0x7f7ebc0c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:54.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ebbfff640 1 -- 172.21.15.84:0/3942711811 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7ebc0c90a0 msgr2=0x7f7ebc146570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:54.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ebbfff640 1 --2- 172.21.15.84:0/3942711811 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7ebc0c90a0 0x7f7ebc146570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ebbfff640 1 -- 172.21.15.84:0/3942711811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ebc158620 msgr2=0x7f7ebc0c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:54.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ebbfff640 1 --2- 172.21.15.84:0/3942711811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ebc158620 0x7f7ebc0c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ebbfff640 1 -- 172.21.15.84:0/3942711811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ebc149bc0 con 0x7f7ebc073450 2024-05-21T14:42:54.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ec0db5640 1 --2- 172.21.15.84:0/3942711811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ebc158620 0x7f7ebc0c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:42:54.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ebbfff640 1 --2- 172.21.15.84:0/3942711811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ebc073450 0x7f7ebc157fa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7eac01d340 tx=0x7f7eac01ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:54.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7eb8ff9640 1 -- 172.21.15.84:0/3942711811 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0c1070 con 0x7f7ebc073450 2024-05-21T14:42:54.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7eb8ff9640 1 -- 172.21.15.84:0/3942711811 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eac0b0700 con 0x7f7ebc073450 2024-05-21T14:42:54.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ec2818640 1 -- 172.21.15.84:0/3942711811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ebc147d50 con 0x7f7ebc073450 2024-05-21T14:42:54.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7eb8ff9640 1 -- 172.21.15.84:0/3942711811 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0b5040 con 0x7f7ebc073450 2024-05-21T14:42:54.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ec2818640 1 -- 172.21.15.84:0/3942711811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ebc1482b0 con 0x7f7ebc073450 2024-05-21T14:42:54.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7eb8ff9640 1 -- 172.21.15.84:0/3942711811 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7eac0c4070 con 0x7f7ebc073450 2024-05-21T14:42:54.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7eb8ff9640 1 -- 172.21.15.84:0/3942711811 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f7eac0c6b20 con 0x7f7ebc073450 2024-05-21T14:42:54.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.604+0000 7f7ec2818640 1 -- 172.21.15.84:0/3942711811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ebc0c9c30 con 0x7f7ebc073450 2024-05-21T14:42:54.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.608+0000 7f7eb8ff9640 1 -- 172.21.15.84:0/3942711811 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7eac0dddd0 con 0x7f7ebc073450 2024-05-21T14:42:54.662 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:54.654+0000 7feaaae49180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-21T14:42:54.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.676+0000 7f7ec2818640 1 -- 172.21.15.84:0/3942711811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "29c2e728-8789-46bd-8f2d-d6d00fefbdbd", "id": 0} v 0) -- 0x7f7ebc14f4a0 con 0x7f7ebc073450 2024-05-21T14:42:54.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.684+0000 7f7eb8ff9640 1 -- 172.21.15.84:0/3942711811 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "29c2e728-8789-46bd-8f2d-d6d00fefbdbd", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f7eac0cc030 con 0x7f7ebc073450 2024-05-21T14:42:54.693 INFO:teuthology.orchestra.run.smithi084.stdout:0 2024-05-21T14:42:54.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.684+0000 7f7ec2818640 1 -- 172.21.15.84:0/3942711811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ebc073450 msgr2=0x7f7ebc157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:54.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.684+0000 7f7ec2818640 1 --2- 172.21.15.84:0/3942711811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ebc073450 0x7f7ebc157fa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7eac01d340 tx=0x7f7eac01ba30 comp rx=0 tx=0).stop 2024-05-21T14:42:54.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.684+0000 7f7ec2818640 1 -- 172.21.15.84:0/3942711811 shutdown_connections 2024-05-21T14:42:54.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.684+0000 7f7ec2818640 1 --2- 172.21.15.84:0/3942711811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ebc158620 0x7f7ebc0c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.684+0000 7f7ec2818640 1 --2- 172.21.15.84:0/3942711811 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7ebc0c90a0 0x7f7ebc146570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.684+0000 7f7ec2818640 1 --2- 172.21.15.84:0/3942711811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ebc073450 0x7f7ebc157fa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.684+0000 7f7ec2818640 1 -- 172.21.15.84:0/3942711811 >> 172.21.15.84:0/3942711811 conn(0x7f7ebc0ca3d0 msgr2=0x7f7ebc0c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:54.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.684+0000 7f7ec2818640 1 -- 172.21.15.84:0/3942711811 shutdown_connections 2024-05-21T14:42:54.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.684+0000 7f7ec2818640 1 -- 172.21.15.84:0/3942711811 wait complete. 2024-05-21T14:42:54.711 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 906a2733-8b89-43ef-b744-39fc9e74955b 1 2024-05-21T14:42:54.789 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:54.780+0000 7fb5815d3180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-21T14:42:54.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.840+0000 7efc46d6a640 1 Processor -- start 2024-05-21T14:42:54.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.840+0000 7efc46d6a640 1 -- start start 2024-05-21T14:42:54.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc46d6a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efc4015cdc0 0x7efc4015d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:54.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc46d6a640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc4015d710 0x7efc401640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:54.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc46d6a640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc40070ed0 con 0x7efc400c3eb0 2024-05-21T14:42:54.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc46d6a640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7efc400cb220 con 0x7efc4015cdc0 2024-05-21T14:42:54.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc46d6a640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7efc40071790 con 0x7efc4015d710 2024-05-21T14:42:54.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc3ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efc4015cdc0 0x7efc4015d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:54.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc45307640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc4015d710 0x7efc401640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:54.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc44b06640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7efc400c3eb0 0x7efc400cab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40480/0 (socket says 172.21.15.84:40480) 2024-05-21T14:42:54.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc44b06640 1 -- 172.21.15.84:0/564947539 learned_addr learned my addr 172.21.15.84:0/564947539 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-05-21T14:42:54.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc3ffff640 1 -- 172.21.15.84:0/564947539 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc4015d710 msgr2=0x7efc401640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:42:54.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc3ffff640 1 --2- 172.21.15.84:0/564947539 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc4015d710 0x7efc401640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc3ffff640 1 -- 172.21.15.84:0/564947539 >> v1:172.21.15.84:6789/0 conn(0x7efc400c3eb0 legacy=0x7efc400cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:54.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc3ffff640 1 -- 172.21.15.84:0/564947539 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4015db20 con 0x7efc4015cdc0 2024-05-21T14:42:54.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc3f7fe640 1 -- 172.21.15.84:0/564947539 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2856736586 0 0) 0x7efc40070ed0 con 0x7efc400c3eb0 2024-05-21T14:42:54.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc3ffff640 1 --2- 172.21.15.84:0/564947539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc4015cdc0 0x7efc4015d1d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0097c0 tx=0x7efc2c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad07ded50b4fa40 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:54.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc3f7fe640 1 -- 172.21.15.84:0/564947539 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c0a7070 con 0x7efc4015cdc0 2024-05-21T14:42:54.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc3f7fe640 1 -- 172.21.15.84:0/564947539 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2c0b0070 con 0x7efc4015cdc0 2024-05-21T14:42:54.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.844+0000 7efc3f7fe640 1 -- 172.21.15.84:0/564947539 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c0ab890 con 0x7efc4015cdc0 2024-05-21T14:42:54.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc46d6a640 1 -- 172.21.15.84:0/564947539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc4015cdc0 msgr2=0x7efc4015d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:54.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc46d6a640 1 --2- 172.21.15.84:0/564947539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc4015cdc0 0x7efc4015d1d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0097c0 tx=0x7efc2c01c470 comp rx=0 tx=0).stop 2024-05-21T14:42:54.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc46d6a640 1 -- 172.21.15.84:0/564947539 shutdown_connections 2024-05-21T14:42:54.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc46d6a640 1 --2- 172.21.15.84:0/564947539 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc4015d710 0x7efc401640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc46d6a640 1 --2- 172.21.15.84:0/564947539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc4015cdc0 0x7efc4015d1d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc46d6a640 1 -- 172.21.15.84:0/564947539 >> 172.21.15.84:0/564947539 conn(0x7efc400752c0 msgr2=0x7efc400736c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:54.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc46d6a640 1 -- 172.21.15.84:0/564947539 shutdown_connections 2024-05-21T14:42:54.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc46d6a640 1 -- 172.21.15.84:0/564947539 wait complete. 2024-05-21T14:42:54.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc46d6a640 1 Processor -- start 2024-05-21T14:42:54.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc46d6a640 1 -- start start 2024-05-21T14:42:54.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc46d6a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc400c3eb0 0x7efc40150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:54.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc46d6a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc4015cdc0 0x7efc40144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:54.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc46d6a640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc4015d710 0x7efc40144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:54.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc46d6a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efc400c9c00 con 0x7efc4015cdc0 2024-05-21T14:42:54.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc46d6a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efc400cbef0 con 0x7efc400c3eb0 2024-05-21T14:42:54.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc46d6a640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7efc400c95c0 con 0x7efc4015d710 2024-05-21T14:42:54.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc44b06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc400c3eb0 0x7efc40150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:54.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc45307640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc4015d710 0x7efc40144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:54.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc44b06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc400c3eb0 0x7efc40150290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57600/0 (socket says 172.21.15.84:57600) 2024-05-21T14:42:54.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.848+0000 7efc44b06640 1 -- 172.21.15.84:0/872988425 learned_addr learned my addr 172.21.15.84:0/872988425 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-21T14:42:54.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.852+0000 7efc3ffff640 1 --2- 172.21.15.84:0/872988425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc4015cdc0 0x7efc40144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:54.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.852+0000 7efc45307640 1 -- 172.21.15.84:0/872988425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc400c3eb0 msgr2=0x7efc40150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:54.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.852+0000 7efc45307640 1 --2- 172.21.15.84:0/872988425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc400c3eb0 0x7efc40150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.852+0000 7efc45307640 1 -- 172.21.15.84:0/872988425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc4015cdc0 msgr2=0x7efc40144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:54.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.852+0000 7efc45307640 1 --2- 172.21.15.84:0/872988425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc4015cdc0 0x7efc40144530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.852+0000 7efc45307640 1 -- 172.21.15.84:0/872988425 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc401456e0 con 0x7efc4015d710 2024-05-21T14:42:54.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.852+0000 7efc3ffff640 1 --2- 172.21.15.84:0/872988425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc4015cdc0 0x7efc40144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:42:54.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.852+0000 7efc44b06640 1 --2- 172.21.15.84:0/872988425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc400c3eb0 0x7efc40150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:42:54.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.852+0000 7efc45307640 1 --2- 172.21.15.84:0/872988425 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc4015d710 0x7efc40144a70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efc3800eb70 tx=0x7efc3800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:54.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.852+0000 7efc3d7fa640 1 -- 172.21.15.84:0/872988425 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38018020 con 0x7efc4015d710 2024-05-21T14:42:54.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.852+0000 7efc3d7fa640 1 -- 172.21.15.84:0/872988425 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc3800ccc0 con 0x7efc4015d710 2024-05-21T14:42:54.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.852+0000 7efc3d7fa640 1 -- 172.21.15.84:0/872988425 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc380146c0 con 0x7efc4015d710 2024-05-21T14:42:54.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.852+0000 7efc46d6a640 1 -- 172.21.15.84:0/872988425 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc401463b0 con 0x7efc4015d710 2024-05-21T14:42:54.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.852+0000 7efc46d6a640 1 -- 172.21.15.84:0/872988425 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efc40146650 con 0x7efc4015d710 2024-05-21T14:42:54.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.852+0000 7efc3d7fa640 1 -- 172.21.15.84:0/872988425 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efc3801b020 con 0x7efc4015d710 2024-05-21T14:42:54.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.852+0000 7efc3d7fa640 1 -- 172.21.15.84:0/872988425 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7efc38013790 con 0x7efc4015d710 2024-05-21T14:42:54.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.852+0000 7efc46d6a640 1 -- 172.21.15.84:0/872988425 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc4004f730 con 0x7efc4015d710 2024-05-21T14:42:54.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.856+0000 7efc3d7fa640 1 -- 172.21.15.84:0/872988425 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7efc38022030 con 0x7efc4015d710 2024-05-21T14:42:54.891 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:54.886+0000 7feaaae49180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-21T14:42:54.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.924+0000 7efc46d6a640 1 -- 172.21.15.84:0/872988425 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd new", "uuid": "906a2733-8b89-43ef-b744-39fc9e74955b", "id": 1} v 0) -- 0x7efc400ca6e0 con 0x7efc4015d710 2024-05-21T14:42:54.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.932+0000 7efc3d7fa640 1 -- 172.21.15.84:0/872988425 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "906a2733-8b89-43ef-b744-39fc9e74955b", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7efc38010040 con 0x7efc4015d710 2024-05-21T14:42:54.939 INFO:teuthology.orchestra.run.smithi084.stdout:1 2024-05-21T14:42:54.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.932+0000 7efc46d6a640 1 -- 172.21.15.84:0/872988425 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc4015d710 msgr2=0x7efc40144a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:54.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.932+0000 7efc46d6a640 1 --2- 172.21.15.84:0/872988425 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc4015d710 0x7efc40144a70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efc3800eb70 tx=0x7efc3800c490 comp rx=0 tx=0).stop 2024-05-21T14:42:54.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.932+0000 7efc46d6a640 1 -- 172.21.15.84:0/872988425 shutdown_connections 2024-05-21T14:42:54.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.932+0000 7efc46d6a640 1 --2- 172.21.15.84:0/872988425 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc4015d710 0x7efc40144a70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.932+0000 7efc46d6a640 1 --2- 172.21.15.84:0/872988425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc4015cdc0 0x7efc40144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.932+0000 7efc46d6a640 1 --2- 172.21.15.84:0/872988425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc400c3eb0 0x7efc40150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:54.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.932+0000 7efc46d6a640 1 -- 172.21.15.84:0/872988425 >> 172.21.15.84:0/872988425 conn(0x7efc400752c0 msgr2=0x7efc400c8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:54.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.932+0000 7efc46d6a640 1 -- 172.21.15.84:0/872988425 shutdown_connections 2024-05-21T14:42:54.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:54.932+0000 7efc46d6a640 1 -- 172.21.15.84:0/872988425 wait complete. 2024-05-21T14:42:54.956 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new cde17f1c-3cee-47a4-ac9c-a3419d285ae8 2 2024-05-21T14:42:55.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.088+0000 7fe88d600640 1 Processor -- start 2024-05-21T14:42:55.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.088+0000 7fe88d600640 1 -- start start 2024-05-21T14:42:55.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.092+0000 7fe88d600640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe8880c3eb0 0x7fe8880cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.092+0000 7fe88d600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe88815d8e0 0x7fe8881640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.092+0000 7fe88d600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe888070ed0 con 0x7fe88815cdc0 2024-05-21T14:42:55.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.092+0000 7fe88d600640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fe888071790 con 0x7fe8880c3eb0 2024-05-21T14:42:55.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.092+0000 7fe88d600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fe8880c9920 con 0x7fe88815d8e0 2024-05-21T14:42:55.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.092+0000 7fe87ffff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe88815cdc0 0x7fe88815d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40484/0 (socket says 172.21.15.84:40484) 2024-05-21T14:42:55.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.092+0000 7fe87ffff640 1 -- 172.21.15.84:0/450669427 learned_addr learned my addr 172.21.15.84:0/450669427 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-05-21T14:42:55.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.092+0000 7fe8877fe640 1 --2- 172.21.15.84:0/450669427 >> v2:172.21.15.84:3300/0 conn(0x7fe88815d8e0 0x7fe8881640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.092+0000 7fe886ffd640 1 --2- 172.21.15.84:0/450669427 >> v2:172.21.15.78:3300/0 conn(0x7fe8880c3eb0 0x7fe8880cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.092+0000 7fe8867fc640 1 -- 172.21.15.84:0/450669427 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 425045365 0 0) 0x7fe888070ed0 con 0x7fe88815cdc0 2024-05-21T14:42:55.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.092+0000 7fe8867fc640 1 -- 172.21.15.84:0/450669427 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe874003530 con 0x7fe88815cdc0 2024-05-21T14:42:55.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.092+0000 7fe8877fe640 1 -- 172.21.15.84:0/450669427 >> v2:172.21.15.78:3300/0 conn(0x7fe8880c3eb0 msgr2=0x7fe8880cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:42:55.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.092+0000 7fe8877fe640 1 --2- 172.21.15.84:0/450669427 >> v2:172.21.15.78:3300/0 conn(0x7fe8880c3eb0 0x7fe8880cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.092+0000 7fe8877fe640 1 -- 172.21.15.84:0/450669427 >> v1:172.21.15.84:6789/0 conn(0x7fe88815cdc0 legacy=0x7fe88815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.092+0000 7fe8877fe640 1 -- 172.21.15.84:0/450669427 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe888071140 con 0x7fe88815d8e0 2024-05-21T14:42:55.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.092+0000 7fe8877fe640 1 --2- 172.21.15.84:0/450669427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe88815d8e0 0x7fe8881640f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe8880cc700 tx=0x7fe88001c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=899075912fed8790 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:55.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.096+0000 7fe8867fc640 1 -- 172.21.15.84:0/450669427 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8800b2070 con 0x7fe88815d8e0 2024-05-21T14:42:55.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.096+0000 7fe8867fc640 1 -- 172.21.15.84:0/450669427 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8800a59e0 con 0x7fe88815d8e0 2024-05-21T14:42:55.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.096+0000 7fe8867fc640 1 -- 172.21.15.84:0/450669427 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8800a5d90 con 0x7fe88815d8e0 2024-05-21T14:42:55.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.096+0000 7fe88d600640 1 -- 172.21.15.84:0/450669427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe88815d8e0 msgr2=0x7fe8881640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.096+0000 7fe88d600640 1 --2- 172.21.15.84:0/450669427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe88815d8e0 0x7fe8881640f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe8880cc700 tx=0x7fe88001c900 comp rx=0 tx=0).stop 2024-05-21T14:42:55.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.096+0000 7fe88d600640 1 -- 172.21.15.84:0/450669427 shutdown_connections 2024-05-21T14:42:55.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.096+0000 7fe88d600640 1 --2- 172.21.15.84:0/450669427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe88815d8e0 0x7fe8881640f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.096+0000 7fe88d600640 1 --2- 172.21.15.84:0/450669427 >> v2:172.21.15.78:3300/0 conn(0x7fe8880c3eb0 0x7fe8880cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.096+0000 7fe88d600640 1 -- 172.21.15.84:0/450669427 >> 172.21.15.84:0/450669427 conn(0x7fe8880752c0 msgr2=0x7fe8880736c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:55.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.096+0000 7fe88d600640 1 -- 172.21.15.84:0/450669427 shutdown_connections 2024-05-21T14:42:55.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.096+0000 7fe88d600640 1 -- 172.21.15.84:0/450669427 wait complete. 2024-05-21T14:42:55.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.096+0000 7fe88d600640 1 Processor -- start 2024-05-21T14:42:55.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.096+0000 7fe88d600640 1 -- start start 2024-05-21T14:42:55.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.096+0000 7fe88d600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8880c3eb0 0x7fe8881457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe88d600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe88815cdc0 0x7fe888147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe88d600640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe88815d8e0 0x7fe8881425f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe88d600640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe888071c20 con 0x7fe88815cdc0 2024-05-21T14:42:55.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe88d600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe8880c95c0 con 0x7fe8880c3eb0 2024-05-21T14:42:55.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe88d600640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe888071da0 con 0x7fe88815d8e0 2024-05-21T14:42:55.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe886ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8880c3eb0 0x7fe8881457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe886ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8880c3eb0 0x7fe8881457b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57614/0 (socket says 172.21.15.84:57614) 2024-05-21T14:42:55.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe886ffd640 1 -- 172.21.15.84:0/4177025525 learned_addr learned my addr 172.21.15.84:0/4177025525 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-21T14:42:55.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe8877fe640 1 --2- 172.21.15.84:0/4177025525 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe88815d8e0 0x7fe8881425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe87ffff640 1 --2- 172.21.15.84:0/4177025525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe88815cdc0 0x7fe888147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe886ffd640 1 -- 172.21.15.84:0/4177025525 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe88815d8e0 msgr2=0x7fe8881425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe886ffd640 1 --2- 172.21.15.84:0/4177025525 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe88815d8e0 0x7fe8881425f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe886ffd640 1 -- 172.21.15.84:0/4177025525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe88815cdc0 msgr2=0x7fe888147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe886ffd640 1 --2- 172.21.15.84:0/4177025525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe88815cdc0 0x7fe888147b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe886ffd640 1 -- 172.21.15.84:0/4177025525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe888145cf0 con 0x7fe8880c3eb0 2024-05-21T14:42:55.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe8877fe640 1 --2- 172.21.15.84:0/4177025525 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe88815d8e0 0x7fe8881425f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:42:55.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe886ffd640 1 --2- 172.21.15.84:0/4177025525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8880c3eb0 0x7fe8881457b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe87800e870 tx=0x7fe87800ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:55.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe87f7fe640 1 -- 172.21.15.84:0/4177025525 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878017070 con 0x7fe8880c3eb0 2024-05-21T14:42:55.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe87f7fe640 1 -- 172.21.15.84:0/4177025525 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe87800c940 con 0x7fe8880c3eb0 2024-05-21T14:42:55.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe88d600640 1 -- 172.21.15.84:0/4177025525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8881464c0 con 0x7fe8880c3eb0 2024-05-21T14:42:55.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe87f7fe640 1 -- 172.21.15.84:0/4177025525 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87800ccf0 con 0x7fe8880c3eb0 2024-05-21T14:42:55.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe88d600640 1 -- 172.21.15.84:0/4177025525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe888146a40 con 0x7fe8880c3eb0 2024-05-21T14:42:55.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe87f7fe640 1 -- 172.21.15.84:0/4177025525 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe87801a070 con 0x7fe8880c3eb0 2024-05-21T14:42:55.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe87f7fe640 1 -- 172.21.15.84:0/4177025525 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fe878013470 con 0x7fe8880c3eb0 2024-05-21T14:42:55.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.100+0000 7fe88d600640 1 -- 172.21.15.84:0/4177025525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe88804f730 con 0x7fe8880c3eb0 2024-05-21T14:42:55.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.104+0000 7fe87f7fe640 1 -- 172.21.15.84:0/4177025525 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe878006020 con 0x7fe8880c3eb0 2024-05-21T14:42:55.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.168+0000 7fe88d600640 1 -- 172.21.15.84:0/4177025525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cde17f1c-3cee-47a4-ac9c-a3419d285ae8", "id": 2} v 0) -- 0x7fe8880ca6e0 con 0x7fe8880c3eb0 2024-05-21T14:42:55.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.172+0000 7fe87f7fe640 1 -- 172.21.15.84:0/4177025525 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cde17f1c-3cee-47a4-ac9c-a3419d285ae8", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fe878006550 con 0x7fe8880c3eb0 2024-05-21T14:42:55.183 INFO:teuthology.orchestra.run.smithi084.stdout:2 2024-05-21T14:42:55.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.176+0000 7fe88d600640 1 -- 172.21.15.84:0/4177025525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8880c3eb0 msgr2=0x7fe8881457b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.176+0000 7fe88d600640 1 --2- 172.21.15.84:0/4177025525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8880c3eb0 0x7fe8881457b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe87800e870 tx=0x7fe87800ec70 comp rx=0 tx=0).stop 2024-05-21T14:42:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.176+0000 7fe88d600640 1 -- 172.21.15.84:0/4177025525 shutdown_connections 2024-05-21T14:42:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.176+0000 7fe88d600640 1 --2- 172.21.15.84:0/4177025525 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe88815d8e0 0x7fe8881425f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.176+0000 7fe88d600640 1 --2- 172.21.15.84:0/4177025525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe88815cdc0 0x7fe888147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.176+0000 7fe88d600640 1 --2- 172.21.15.84:0/4177025525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8880c3eb0 0x7fe8881457b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.176+0000 7fe88d600640 1 -- 172.21.15.84:0/4177025525 >> 172.21.15.84:0/4177025525 conn(0x7fe8880752c0 msgr2=0x7fe88815c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.176+0000 7fe88d600640 1 -- 172.21.15.84:0/4177025525 shutdown_connections 2024-05-21T14:42:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.176+0000 7fe88d600640 1 -- 172.21.15.84:0/4177025525 wait complete. 2024-05-21T14:42:55.201 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new b2863049-8ee1-4960-8471-9453c3b5cf2b 3 2024-05-21T14:42:55.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.328+0000 7f482d037640 1 Processor -- start 2024-05-21T14:42:55.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.328+0000 7f482d037640 1 -- start start 2024-05-21T14:42:55.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f482d037640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48280c3eb0 0x7f48280cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f482d037640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f482815d8e0 0x7f48281640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f482d037640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4828070ed0 con 0x7f482815cdc0 2024-05-21T14:42:55.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f482d037640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f4828071790 con 0x7f482815d8e0 2024-05-21T14:42:55.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f482d037640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f48280c9920 con 0x7f48280c3eb0 2024-05-21T14:42:55.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f4826d9d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48280c3eb0 0x7f48280cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f4826d9d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48280c3eb0 0x7f48280cab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.84:46970/0 (socket says 172.21.15.84:46970) 2024-05-21T14:42:55.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f4826d9d640 1 -- 172.21.15.84:0/1715081539 learned_addr learned my addr 172.21.15.84:0/1715081539 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-21T14:42:55.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f482759e640 1 --2- 172.21.15.84:0/1715081539 >> v2:172.21.15.78:3300/0 conn(0x7f482815d8e0 0x7f48281640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f4826d9d640 1 -- 172.21.15.84:0/1715081539 >> v2:172.21.15.78:3300/0 conn(0x7f482815d8e0 msgr2=0x7f48281640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:42:55.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f4826d9d640 1 --2- 172.21.15.84:0/1715081539 >> v2:172.21.15.78:3300/0 conn(0x7f482815d8e0 0x7f48281640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f4826d9d640 1 -- 172.21.15.84:0/1715081539 >> v1:172.21.15.78:6789/0 conn(0x7f482815cdc0 legacy=0x7f482815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f4826d9d640 1 -- 172.21.15.84:0/1715081539 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4828071140 con 0x7f48280c3eb0 2024-05-21T14:42:55.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f482759e640 1 --2- 172.21.15.84:0/1715081539 >> v2:172.21.15.78:3300/0 conn(0x7f482815d8e0 0x7f48281640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:42:55.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f4826d9d640 1 --2- 172.21.15.84:0/1715081539 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48280c3eb0 0x7f48280cab10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4818009870 tx=0x7f481801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2333be11a76259b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:55.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f482659c640 1 -- 172.21.15.84:0/1715081539 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48180a9610 con 0x7f48280c3eb0 2024-05-21T14:42:55.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f482659c640 1 -- 172.21.15.84:0/1715081539 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48180a97b0 con 0x7f48280c3eb0 2024-05-21T14:42:55.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.332+0000 7f482659c640 1 -- 172.21.15.84:0/1715081539 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48180a9b80 con 0x7f48280c3eb0 2024-05-21T14:42:55.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482d037640 1 -- 172.21.15.84:0/1715081539 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48280c3eb0 msgr2=0x7f48280cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482d037640 1 --2- 172.21.15.84:0/1715081539 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48280c3eb0 0x7f48280cab10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4818009870 tx=0x7f481801c530 comp rx=0 tx=0).stop 2024-05-21T14:42:55.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482d037640 1 -- 172.21.15.84:0/1715081539 shutdown_connections 2024-05-21T14:42:55.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482d037640 1 --2- 172.21.15.84:0/1715081539 >> v2:172.21.15.78:3300/0 conn(0x7f482815d8e0 0x7f48281640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482d037640 1 --2- 172.21.15.84:0/1715081539 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48280c3eb0 0x7f48280cab10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482d037640 1 -- 172.21.15.84:0/1715081539 >> 172.21.15.84:0/1715081539 conn(0x7f48280752c0 msgr2=0x7f48280736c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:55.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482d037640 1 -- 172.21.15.84:0/1715081539 shutdown_connections 2024-05-21T14:42:55.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482d037640 1 -- 172.21.15.84:0/1715081539 wait complete. 2024-05-21T14:42:55.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482d037640 1 Processor -- start 2024-05-21T14:42:55.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482d037640 1 -- start start 2024-05-21T14:42:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482d037640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48280c3eb0 0x7f4828158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482d037640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f482815cdc0 0x7f48280cf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482d037640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f482815d8e0 0x7f48281f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482d037640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4828071c20 con 0x7f482815cdc0 2024-05-21T14:42:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482d037640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f48280c95c0 con 0x7f48280c3eb0 2024-05-21T14:42:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482d037640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f4828071da0 con 0x7f482815d8e0 2024-05-21T14:42:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482759e640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f482815d8e0 0x7f48281f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f4826d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48280c3eb0 0x7f4828158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482759e640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f482815d8e0 0x7f48281f6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.84:46984/0 (socket says 172.21.15.84:46984) 2024-05-21T14:42:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482759e640 1 -- 172.21.15.84:0/619278323 learned_addr learned my addr 172.21.15.84:0/619278323 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-21T14:42:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f481ffff640 1 --2- 172.21.15.84:0/619278323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f482815cdc0 0x7f48280cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f4826d9d640 1 -- 172.21.15.84:0/619278323 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f482815d8e0 msgr2=0x7f48281f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f4826d9d640 1 --2- 172.21.15.84:0/619278323 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f482815d8e0 0x7f48281f6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f4826d9d640 1 -- 172.21.15.84:0/619278323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f482815cdc0 msgr2=0x7f48280cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f4826d9d640 1 --2- 172.21.15.84:0/619278323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f482815cdc0 0x7f48280cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f4826d9d640 1 -- 172.21.15.84:0/619278323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4828158bc0 con 0x7f48280c3eb0 2024-05-21T14:42:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.336+0000 7f482759e640 1 --2- 172.21.15.84:0/619278323 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f482815d8e0 0x7f48281f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:42:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.340+0000 7f4826d9d640 1 --2- 172.21.15.84:0/619278323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48280c3eb0 0x7f4828158680 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f48180aa000 tx=0x7f48180192d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.340+0000 7f481f7fe640 1 -- 172.21.15.84:0/619278323 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48180be070 con 0x7f48280c3eb0 2024-05-21T14:42:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.340+0000 7f481f7fe640 1 -- 172.21.15.84:0/619278323 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48180b9610 con 0x7f48280c3eb0 2024-05-21T14:42:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.340+0000 7f482d037640 1 -- 172.21.15.84:0/619278323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4828157590 con 0x7f48280c3eb0 2024-05-21T14:42:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.340+0000 7f481f7fe640 1 -- 172.21.15.84:0/619278323 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48180b9a00 con 0x7f48280c3eb0 2024-05-21T14:42:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.340+0000 7f482d037640 1 -- 172.21.15.84:0/619278323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4828152fb0 con 0x7f48280c3eb0 2024-05-21T14:42:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.340+0000 7f481f7fe640 1 -- 172.21.15.84:0/619278323 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f48180c1070 con 0x7f48280c3eb0 2024-05-21T14:42:55.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.340+0000 7f481f7fe640 1 -- 172.21.15.84:0/619278323 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f48180b1880 con 0x7f48280c3eb0 2024-05-21T14:42:55.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.340+0000 7f482d037640 1 -- 172.21.15.84:0/619278323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f482804f730 con 0x7f48280c3eb0 2024-05-21T14:42:55.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.340+0000 7f481f7fe640 1 -- 172.21.15.84:0/619278323 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f48180dadd0 con 0x7f48280c3eb0 2024-05-21T14:42:55.359 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:55.352+0000 7fb5815d3180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-21T14:42:55.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.404+0000 7f482d037640 1 -- 172.21.15.84:0/619278323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b2863049-8ee1-4960-8471-9453c3b5cf2b", "id": 3} v 0) -- 0x7f48280ca6e0 con 0x7f48280c3eb0 2024-05-21T14:42:55.415 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:55.404+0000 7fb5815d3180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-21T14:42:55.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.412+0000 7f481f7fe640 1 -- 172.21.15.84:0/619278323 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b2863049-8ee1-4960-8471-9453c3b5cf2b", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f48180c9070 con 0x7f48280c3eb0 2024-05-21T14:42:55.421 INFO:teuthology.orchestra.run.smithi084.stdout:3 2024-05-21T14:42:55.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.412+0000 7f482d037640 1 -- 172.21.15.84:0/619278323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48280c3eb0 msgr2=0x7f4828158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.412+0000 7f482d037640 1 --2- 172.21.15.84:0/619278323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48280c3eb0 0x7f4828158680 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f48180aa000 tx=0x7f48180192d0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.412+0000 7f482d037640 1 -- 172.21.15.84:0/619278323 shutdown_connections 2024-05-21T14:42:55.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.412+0000 7f482d037640 1 --2- 172.21.15.84:0/619278323 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f482815d8e0 0x7f48281f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.412+0000 7f482d037640 1 --2- 172.21.15.84:0/619278323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f482815cdc0 0x7f48280cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.412+0000 7f482d037640 1 --2- 172.21.15.84:0/619278323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48280c3eb0 0x7f4828158680 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.416+0000 7f482d037640 1 -- 172.21.15.84:0/619278323 >> 172.21.15.84:0/619278323 conn(0x7f48280752c0 msgr2=0x7f48280c7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:55.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.416+0000 7f482d037640 1 -- 172.21.15.84:0/619278323 shutdown_connections 2024-05-21T14:42:55.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.416+0000 7f482d037640 1 -- 172.21.15.84:0/619278323 wait complete. 2024-05-21T14:42:55.439 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 278ccf0a-20cd-4fc3-b405-d291376b898c 4 2024-05-21T14:42:55.471 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:55.464+0000 7fb5815d3180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-21T14:42:55.522 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:55.514+0000 7feaaae49180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-21T14:42:55.551 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:55.544+0000 7fb5815d3180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-21T14:42:55.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad5407a640 1 Processor -- start 2024-05-21T14:42:55.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad5407a640 1 -- start start 2024-05-21T14:42:55.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad5407a640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fad4c158910 0x7fad4c151e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad5407a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad4c0c9890 0x7fad4c15bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad5407a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fad4c15c080 0x7fad4c0ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad5407a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fad4c158e70 con 0x7fad4c15c080 2024-05-21T14:42:55.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad5407a640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fad4c152350 con 0x7fad4c0c9890 2024-05-21T14:42:55.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad5407a640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fad4c0c8c80 con 0x7fad4c158910 2024-05-21T14:42:55.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad51e16640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fad4c158910 0x7fad4c151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad51615640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad4c0c9890 0x7fad4c15bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad51615640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad4c0c9890 0x7fad4c15bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57630/0 (socket says 172.21.15.84:57630) 2024-05-21T14:42:55.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad51e16640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fad4c158910 0x7fad4c151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.84:46986/0 (socket says 172.21.15.84:46986) 2024-05-21T14:42:55.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad51615640 1 -- 172.21.15.84:0/2708015528 learned_addr learned my addr 172.21.15.84:0/2708015528 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-21T14:42:55.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad52617640 1 --2- 172.21.15.84:0/2708015528 >> v2:172.21.15.78:3300/0 conn(0x7fad4c15c080 0x7fad4c0ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad51615640 1 -- 172.21.15.84:0/2708015528 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fad4c158910 msgr2=0x7fad4c151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:42:55.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad51615640 1 --2- 172.21.15.84:0/2708015528 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fad4c158910 0x7fad4c151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad51615640 1 -- 172.21.15.84:0/2708015528 >> v2:172.21.15.78:3300/0 conn(0x7fad4c15c080 msgr2=0x7fad4c0ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:42:55.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad51615640 1 --2- 172.21.15.84:0/2708015528 >> v2:172.21.15.78:3300/0 conn(0x7fad4c15c080 0x7fad4c0ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad51615640 1 -- 172.21.15.84:0/2708015528 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4c0c8f60 con 0x7fad4c0c9890 2024-05-21T14:42:55.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad51e16640 1 --2- 172.21.15.84:0/2708015528 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fad4c158910 0x7fad4c151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:42:55.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.568+0000 7fad52617640 1 --2- 172.21.15.84:0/2708015528 >> v2:172.21.15.78:3300/0 conn(0x7fad4c15c080 0x7fad4c0ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:42:55.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.572+0000 7fad51615640 1 --2- 172.21.15.84:0/2708015528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad4c0c9890 0x7fad4c15bb40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fad4c06c6e0 tx=0x7fad3c01c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d75ec263bef0b09 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:55.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.572+0000 7fad50e14640 1 -- 172.21.15.84:0/2708015528 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0b0070 con 0x7fad4c0c9890 2024-05-21T14:42:55.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.572+0000 7fad50e14640 1 -- 172.21.15.84:0/2708015528 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad3c0ab600 con 0x7fad4c0c9890 2024-05-21T14:42:55.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.572+0000 7fad50e14640 1 -- 172.21.15.84:0/2708015528 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0ab9d0 con 0x7fad4c0c9890 2024-05-21T14:42:55.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.572+0000 7fad5407a640 1 -- 172.21.15.84:0/2708015528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad4c0c9890 msgr2=0x7fad4c15bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.572+0000 7fad5407a640 1 --2- 172.21.15.84:0/2708015528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad4c0c9890 0x7fad4c15bb40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fad4c06c6e0 tx=0x7fad3c01c520 comp rx=0 tx=0).stop 2024-05-21T14:42:55.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.572+0000 7fad5407a640 1 -- 172.21.15.84:0/2708015528 shutdown_connections 2024-05-21T14:42:55.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.572+0000 7fad5407a640 1 --2- 172.21.15.84:0/2708015528 >> v2:172.21.15.78:3300/0 conn(0x7fad4c15c080 0x7fad4c0ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.572+0000 7fad5407a640 1 --2- 172.21.15.84:0/2708015528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad4c0c9890 0x7fad4c15bb40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.572+0000 7fad5407a640 1 --2- 172.21.15.84:0/2708015528 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fad4c158910 0x7fad4c151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.572+0000 7fad5407a640 1 -- 172.21.15.84:0/2708015528 >> 172.21.15.84:0/2708015528 conn(0x7fad4c06fcc0 msgr2=0x7fad4c0700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:55.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.572+0000 7fad5407a640 1 -- 172.21.15.84:0/2708015528 shutdown_connections 2024-05-21T14:42:55.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.572+0000 7fad5407a640 1 -- 172.21.15.84:0/2708015528 wait complete. 2024-05-21T14:42:55.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad5407a640 1 Processor -- start 2024-05-21T14:42:55.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad5407a640 1 -- start start 2024-05-21T14:42:55.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad5407a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad4c0c9890 0x7fad4c162040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad5407a640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fad4c158910 0x7fad4c1f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad5407a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad4c15c080 0x7fad4c14a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad5407a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c0cd470 con 0x7fad4c15c080 2024-05-21T14:42:55.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad5407a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c0cd2f0 con 0x7fad4c0c9890 2024-05-21T14:42:55.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad5407a640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fad4c0cd5f0 con 0x7fad4c158910 2024-05-21T14:42:55.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad51615640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fad4c158910 0x7fad4c1f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad51e16640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad4c0c9890 0x7fad4c162040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad51e16640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad4c0c9890 0x7fad4c162040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57644/0 (socket says 172.21.15.84:57644) 2024-05-21T14:42:55.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad51e16640 1 -- 172.21.15.84:0/2741857861 learned_addr learned my addr 172.21.15.84:0/2741857861 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-21T14:42:55.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad52617640 1 --2- 172.21.15.84:0/2741857861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad4c15c080 0x7fad4c14a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad51e16640 1 -- 172.21.15.84:0/2741857861 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fad4c158910 msgr2=0x7fad4c1f89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad51e16640 1 --2- 172.21.15.84:0/2741857861 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fad4c158910 0x7fad4c1f89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad51e16640 1 -- 172.21.15.84:0/2741857861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad4c15c080 msgr2=0x7fad4c14a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad51e16640 1 --2- 172.21.15.84:0/2741857861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad4c15c080 0x7fad4c14a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad51e16640 1 -- 172.21.15.84:0/2741857861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4c1f8230 con 0x7fad4c0c9890 2024-05-21T14:42:55.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad51e16640 1 --2- 172.21.15.84:0/2741857861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad4c0c9890 0x7fad4c162040 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fad4800e930 tx=0x7fad4800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:55.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad427fc640 1 -- 172.21.15.84:0/2741857861 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48017070 con 0x7fad4c0c9890 2024-05-21T14:42:55.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad427fc640 1 -- 172.21.15.84:0/2741857861 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad4800ca00 con 0x7fad4c0c9890 2024-05-21T14:42:55.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad5407a640 1 -- 172.21.15.84:0/2741857861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad4c1f8f00 con 0x7fad4c0c9890 2024-05-21T14:42:55.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad427fc640 1 -- 172.21.15.84:0/2741857861 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4800cdd0 con 0x7fad4c0c9890 2024-05-21T14:42:55.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad5407a640 1 -- 172.21.15.84:0/2741857861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad4c160e20 con 0x7fad4c0c9890 2024-05-21T14:42:55.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad427fc640 1 -- 172.21.15.84:0/2741857861 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fad4801a070 con 0x7fad4c0c9890 2024-05-21T14:42:55.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad427fc640 1 -- 172.21.15.84:0/2741857861 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fad48013470 con 0x7fad4c0c9890 2024-05-21T14:42:55.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.576+0000 7fad5407a640 1 -- 172.21.15.84:0/2741857861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad4c04f730 con 0x7fad4c0c9890 2024-05-21T14:42:55.588 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:55.578+0000 7feaaae49180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-21T14:42:55.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.580+0000 7fad427fc640 1 -- 172.21.15.84:0/2741857861 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fad48006020 con 0x7fad4c0c9890 2024-05-21T14:42:55.608 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:55.600+0000 7fb5815d3180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-21T14:42:55.646 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:55.638+0000 7feaaae49180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-21T14:42:55.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.644+0000 7fad5407a640 1 -- 172.21.15.84:0/2741857861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "278ccf0a-20cd-4fc3-b405-d291376b898c", "id": 4} v 0) -- 0x7fad4c0c9670 con 0x7fad4c0c9890 2024-05-21T14:42:55.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.648+0000 7fad427fc640 1 -- 172.21.15.84:0/2741857861 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "278ccf0a-20cd-4fc3-b405-d291376b898c", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fad48006520 con 0x7fad4c0c9890 2024-05-21T14:42:55.658 INFO:teuthology.orchestra.run.smithi084.stdout:4 2024-05-21T14:42:55.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.652+0000 7fad5407a640 1 -- 172.21.15.84:0/2741857861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad4c0c9890 msgr2=0x7fad4c162040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.652+0000 7fad5407a640 1 --2- 172.21.15.84:0/2741857861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad4c0c9890 0x7fad4c162040 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fad4800e930 tx=0x7fad4800edf0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.652+0000 7fad5407a640 1 -- 172.21.15.84:0/2741857861 shutdown_connections 2024-05-21T14:42:55.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.652+0000 7fad5407a640 1 --2- 172.21.15.84:0/2741857861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad4c15c080 0x7fad4c14a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.652+0000 7fad5407a640 1 --2- 172.21.15.84:0/2741857861 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fad4c158910 0x7fad4c1f89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.652+0000 7fad5407a640 1 --2- 172.21.15.84:0/2741857861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad4c0c9890 0x7fad4c162040 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.652+0000 7fad5407a640 1 -- 172.21.15.84:0/2741857861 >> 172.21.15.84:0/2741857861 conn(0x7fad4c06fcc0 msgr2=0x7fad4c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:55.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.652+0000 7fad5407a640 1 -- 172.21.15.84:0/2741857861 shutdown_connections 2024-05-21T14:42:55.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.652+0000 7fad5407a640 1 -- 172.21.15.84:0/2741857861 wait complete. 2024-05-21T14:42:55.678 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 4f88be08-f0c2-47a3-9291-b127f56d92cc 5 2024-05-21T14:42:55.688 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:55.680+0000 7fb5815d3180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-21T14:42:55.735 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:55.730+0000 7feaaae49180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-21T14:42:55.743 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:55.736+0000 7fb5815d3180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-21T14:42:55.795 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:55.790+0000 7feaaae49180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-21T14:42:55.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.820+0000 7f63bc52d640 1 Processor -- start 2024-05-21T14:42:55.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.820+0000 7f63bc52d640 1 -- start start 2024-05-21T14:42:55.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.820+0000 7f63bc52d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b40c4d90 0x7f63b4159090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.820+0000 7f63bc52d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f63b4152b30 0x7f63b406c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.820+0000 7f63bc52d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b41595d0 con 0x7f63b406cc70 2024-05-21T14:42:55.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.820+0000 7f63bc52d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f63b4073ba0 con 0x7f63b4152b30 2024-05-21T14:42:55.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.820+0000 7f63bc52d640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f63b4073e80 con 0x7f63b40c4d90 2024-05-21T14:42:55.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.820+0000 7f63ba2c9640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b40c4d90 0x7f63b4159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.820+0000 7f63b9ac8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f63b4152b30 0x7f63b406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.820+0000 7f63ba2c9640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b40c4d90 0x7f63b4159090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.84:47008/0 (socket says 172.21.15.84:47008) 2024-05-21T14:42:55.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.820+0000 7f63ba2c9640 1 -- 172.21.15.84:0/2000892069 learned_addr learned my addr 172.21.15.84:0/2000892069 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-21T14:42:55.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.820+0000 7f63ba2c9640 1 -- 172.21.15.84:0/2000892069 >> v2:172.21.15.84:3300/0 conn(0x7f63b4152b30 msgr2=0x7f63b406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:42:55.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.820+0000 7f63ba2c9640 1 --2- 172.21.15.84:0/2000892069 >> v2:172.21.15.84:3300/0 conn(0x7f63b4152b30 0x7f63b406c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.820+0000 7f63ba2c9640 1 -- 172.21.15.84:0/2000892069 >> v1:172.21.15.78:6789/0 conn(0x7f63b406cc70 legacy=0x7f63b4072c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.820+0000 7f63ba2c9640 1 -- 172.21.15.84:0/2000892069 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b4074160 con 0x7f63b40c4d90 2024-05-21T14:42:55.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.820+0000 7f63b9ac8640 1 --2- 172.21.15.84:0/2000892069 >> v2:172.21.15.84:3300/0 conn(0x7f63b4152b30 0x7f63b406c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:42:55.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.824+0000 7f63ba2c9640 1 --2- 172.21.15.84:0/2000892069 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b40c4d90 0x7f63b4159090 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009870 tx=0x7f63b001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfaa112c6df58e27 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:55.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.824+0000 7f63b92c7640 1 -- 172.21.15.84:0/2000892069 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b00b1070 con 0x7f63b40c4d90 2024-05-21T14:42:55.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.824+0000 7f63b92c7640 1 -- 172.21.15.84:0/2000892069 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63b00a8050 con 0x7f63b40c4d90 2024-05-21T14:42:55.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.824+0000 7f63b92c7640 1 -- 172.21.15.84:0/2000892069 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b00ac860 con 0x7f63b40c4d90 2024-05-21T14:42:55.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.824+0000 7f63bc52d640 1 -- 172.21.15.84:0/2000892069 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b40c4d90 msgr2=0x7f63b4159090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.824+0000 7f63bc52d640 1 --2- 172.21.15.84:0/2000892069 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b40c4d90 0x7f63b4159090 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009870 tx=0x7f63b001c4d0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.824+0000 7f63bc52d640 1 -- 172.21.15.84:0/2000892069 shutdown_connections 2024-05-21T14:42:55.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.824+0000 7f63bc52d640 1 --2- 172.21.15.84:0/2000892069 >> v2:172.21.15.84:3300/0 conn(0x7f63b4152b30 0x7f63b406c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.824+0000 7f63bc52d640 1 --2- 172.21.15.84:0/2000892069 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b40c4d90 0x7f63b4159090 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.824+0000 7f63bc52d640 1 -- 172.21.15.84:0/2000892069 >> 172.21.15.84:0/2000892069 conn(0x7f63b40ce370 msgr2=0x7f63b40ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:55.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.824+0000 7f63bc52d640 1 -- 172.21.15.84:0/2000892069 shutdown_connections 2024-05-21T14:42:55.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.824+0000 7f63bc52d640 1 -- 172.21.15.84:0/2000892069 wait complete. 2024-05-21T14:42:55.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.824+0000 7f63bc52d640 1 Processor -- start 2024-05-21T14:42:55.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.824+0000 7f63bc52d640 1 -- start start 2024-05-21T14:42:55.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63bc52d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b406cc70 0x7f63b4153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63bc52d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b40c4d90 0x7f63b41f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63bc52d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b4152b30 0x7f63b414b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:55.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63bc52d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f63b4165a90 con 0x7f63b406cc70 2024-05-21T14:42:55.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63bc52d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f63b4165910 con 0x7f63b4152b30 2024-05-21T14:42:55.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63bc52d640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f63b4165c10 con 0x7f63b40c4d90 2024-05-21T14:42:55.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63b9ac8640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b40c4d90 0x7f63b41f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63b9ac8640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b40c4d90 0x7f63b41f6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.84:47020/0 (socket says 172.21.15.84:47020) 2024-05-21T14:42:55.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63b9ac8640 1 -- 172.21.15.84:0/300973761 learned_addr learned my addr 172.21.15.84:0/300973761 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-21T14:42:55.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63baaca640 1 --2- 172.21.15.84:0/300973761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b4152b30 0x7f63b414b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63ba2c9640 1 --2- 172.21.15.84:0/300973761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b406cc70 0x7f63b4153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:55.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63b9ac8640 1 -- 172.21.15.84:0/300973761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b4152b30 msgr2=0x7f63b414b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63b9ac8640 1 --2- 172.21.15.84:0/300973761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b4152b30 0x7f63b414b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63b9ac8640 1 -- 172.21.15.84:0/300973761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b406cc70 msgr2=0x7f63b4153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63b9ac8640 1 --2- 172.21.15.84:0/300973761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b406cc70 0x7f63b4153fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63b9ac8640 1 -- 172.21.15.84:0/300973761 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b41544f0 con 0x7f63b40c4d90 2024-05-21T14:42:55.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63ba2c9640 1 --2- 172.21.15.84:0/300973761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b406cc70 0x7f63b4153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:42:55.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63baaca640 1 --2- 172.21.15.84:0/300973761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b4152b30 0x7f63b414b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:42:55.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63b9ac8640 1 --2- 172.21.15.84:0/300973761 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b40c4d90 0x7f63b41f6310 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f63a4010b90 tx=0x7f63a400e730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:55.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63aaffd640 1 -- 172.21.15.84:0/300973761 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a401e070 con 0x7f63b40c4d90 2024-05-21T14:42:55.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63aaffd640 1 -- 172.21.15.84:0/300973761 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a4010e90 con 0x7f63b40c4d90 2024-05-21T14:42:55.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63aaffd640 1 -- 172.21.15.84:0/300973761 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a4011890 con 0x7f63b40c4d90 2024-05-21T14:42:55.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63bc52d640 1 -- 172.21.15.84:0/300973761 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b41537f0 con 0x7f63b40c4d90 2024-05-21T14:42:55.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63bc52d640 1 -- 172.21.15.84:0/300973761 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b406c980 con 0x7f63b40c4d90 2024-05-21T14:42:55.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63aaffd640 1 -- 172.21.15.84:0/300973761 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f63a4021070 con 0x7f63b40c4d90 2024-05-21T14:42:55.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63aaffd640 1 -- 172.21.15.84:0/300973761 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f63a4003ba0 con 0x7f63b40c4d90 2024-05-21T14:42:55.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.828+0000 7f63bc52d640 1 -- 172.21.15.84:0/300973761 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b4157b70 con 0x7f63b40c4d90 2024-05-21T14:42:55.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.832+0000 7f63aaffd640 1 -- 172.21.15.84:0/300973761 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f63a4003ec0 con 0x7f63b40c4d90 2024-05-21T14:42:55.885 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:55.878+0000 7feaaae49180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-21T14:42:55.900 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:55.892+0000 7fb5815d3180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-21T14:42:55.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.896+0000 7f63bc52d640 1 -- 172.21.15.84:0/300973761 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4f88be08-f0c2-47a3-9291-b127f56d92cc", "id": 5} v 0) -- 0x7f63b404f730 con 0x7f63b40c4d90 2024-05-21T14:42:55.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.900+0000 7f63aaffd640 1 -- 172.21.15.84:0/300973761 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4f88be08-f0c2-47a3-9291-b127f56d92cc", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f63a40040a0 con 0x7f63b40c4d90 2024-05-21T14:42:55.910 INFO:teuthology.orchestra.run.smithi084.stdout:5 2024-05-21T14:42:55.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.904+0000 7f63bc52d640 1 -- 172.21.15.84:0/300973761 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b40c4d90 msgr2=0x7f63b41f6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:55.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.904+0000 7f63bc52d640 1 --2- 172.21.15.84:0/300973761 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b40c4d90 0x7f63b41f6310 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f63a4010b90 tx=0x7f63a400e730 comp rx=0 tx=0).stop 2024-05-21T14:42:55.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.904+0000 7f63bc52d640 1 -- 172.21.15.84:0/300973761 shutdown_connections 2024-05-21T14:42:55.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.904+0000 7f63bc52d640 1 --2- 172.21.15.84:0/300973761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b4152b30 0x7f63b414b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.904+0000 7f63bc52d640 1 --2- 172.21.15.84:0/300973761 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b40c4d90 0x7f63b41f6310 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.904+0000 7f63bc52d640 1 --2- 172.21.15.84:0/300973761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b406cc70 0x7f63b4153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:55.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.904+0000 7f63bc52d640 1 -- 172.21.15.84:0/300973761 >> 172.21.15.84:0/300973761 conn(0x7f63b40ce370 msgr2=0x7f63b40cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:55.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.904+0000 7f63bc52d640 1 -- 172.21.15.84:0/300973761 shutdown_connections 2024-05-21T14:42:55.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:55.904+0000 7f63bc52d640 1 -- 172.21.15.84:0/300973761 wait complete. 2024-05-21T14:42:55.929 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 7a6fc449-1be1-4654-82ac-596df6f939c3 6 2024-05-21T14:42:55.950 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:55.942+0000 7feaaae49180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-21T14:42:55.967 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:55.960+0000 7fb5815d3180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-21T14:42:56.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.060+0000 7f32aa1b0640 1 Processor -- start 2024-05-21T14:42:56.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.060+0000 7f32aa1b0640 1 -- start start 2024-05-21T14:42:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32aa1b0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f32a40c4d90 0x7f32a4159090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32aa1b0640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a4152b30 0x7f32a406c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32aa1b0640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a41595d0 con 0x7f32a406cc70 2024-05-21T14:42:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32aa1b0640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f32a4073ba0 con 0x7f32a40c4d90 2024-05-21T14:42:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32aa1b0640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f32a4073e80 con 0x7f32a4152b30 2024-05-21T14:42:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32a37fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f32a40c4d90 0x7f32a4159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f329bfff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a4152b30 0x7f32a406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32a37fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f32a40c4d90 0x7f32a4159090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57676/0 (socket says 172.21.15.84:57676) 2024-05-21T14:42:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f329bfff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a4152b30 0x7f32a406c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.84:47024/0 (socket says 172.21.15.84:47024) 2024-05-21T14:42:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32a37fe640 1 -- 172.21.15.84:0/561087429 learned_addr learned my addr 172.21.15.84:0/561087429 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-21T14:42:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32a3fff640 1 --1- 172.21.15.84:0/561087429 >> v1:172.21.15.84:6789/0 conn(0x7f32a406cc70 0x7f32a4072c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40492/0 (socket says 172.21.15.84:40492) 2024-05-21T14:42:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32a37fe640 1 -- 172.21.15.84:0/561087429 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a4152b30 msgr2=0x7f32a406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:42:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32a37fe640 1 --2- 172.21.15.84:0/561087429 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a4152b30 0x7f32a406c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32a37fe640 1 -- 172.21.15.84:0/561087429 >> v1:172.21.15.84:6789/0 conn(0x7f32a406cc70 legacy=0x7f32a4072c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32a37fe640 1 -- 172.21.15.84:0/561087429 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a4074160 con 0x7f32a40c4d90 2024-05-21T14:42:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32a2ffd640 1 -- 172.21.15.84:0/561087429 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3076293020 0 0) 0x7f32a41595d0 con 0x7f32a406cc70 2024-05-21T14:42:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f329bfff640 1 --2- 172.21.15.84:0/561087429 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a4152b30 0x7f32a406c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:42:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32a37fe640 1 --2- 172.21.15.84:0/561087429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a40c4d90 0x7f32a4159090 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3294009870 tx=0x7f329401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f720db6b3fcb3f34 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32a2ffd640 1 -- 172.21.15.84:0/561087429 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32940b1070 con 0x7f32a40c4d90 2024-05-21T14:42:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32a2ffd640 1 -- 172.21.15.84:0/561087429 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32940a8050 con 0x7f32a40c4d90 2024-05-21T14:42:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.064+0000 7f32a2ffd640 1 -- 172.21.15.84:0/561087429 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32940ac860 con 0x7f32a40c4d90 2024-05-21T14:42:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32aa1b0640 1 -- 172.21.15.84:0/561087429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a40c4d90 msgr2=0x7f32a4159090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32aa1b0640 1 --2- 172.21.15.84:0/561087429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a40c4d90 0x7f32a4159090 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3294009870 tx=0x7f329401c4d0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32aa1b0640 1 -- 172.21.15.84:0/561087429 shutdown_connections 2024-05-21T14:42:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32aa1b0640 1 --2- 172.21.15.84:0/561087429 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a4152b30 0x7f32a406c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32aa1b0640 1 --2- 172.21.15.84:0/561087429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a40c4d90 0x7f32a4159090 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32aa1b0640 1 -- 172.21.15.84:0/561087429 >> 172.21.15.84:0/561087429 conn(0x7f32a40ce370 msgr2=0x7f32a40ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32aa1b0640 1 -- 172.21.15.84:0/561087429 shutdown_connections 2024-05-21T14:42:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32aa1b0640 1 -- 172.21.15.84:0/561087429 wait complete. 2024-05-21T14:42:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32aa1b0640 1 Processor -- start 2024-05-21T14:42:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32aa1b0640 1 -- start start 2024-05-21T14:42:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32aa1b0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32a406cc70 0x7f32a414cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32aa1b0640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a40c4d90 0x7f32a414e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32aa1b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a4152b30 0x7f32a414ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32aa1b0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f32a4165a90 con 0x7f32a406cc70 2024-05-21T14:42:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32aa1b0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f32a4165910 con 0x7f32a4152b30 2024-05-21T14:42:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32aa1b0640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f32a4165c10 con 0x7f32a40c4d90 2024-05-21T14:42:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32a3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a4152b30 0x7f32a414ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32a3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a4152b30 0x7f32a414ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57690/0 (socket says 172.21.15.84:57690) 2024-05-21T14:42:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f329bfff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a40c4d90 0x7f32a414e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32a3fff640 1 -- 172.21.15.84:0/76226871 learned_addr learned my addr 172.21.15.84:0/76226871 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-21T14:42:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32a37fe640 1 --2- 172.21.15.84:0/76226871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32a406cc70 0x7f32a414cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32a3fff640 1 -- 172.21.15.84:0/76226871 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a40c4d90 msgr2=0x7f32a414e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32a3fff640 1 --2- 172.21.15.84:0/76226871 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a40c4d90 0x7f32a414e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32a3fff640 1 -- 172.21.15.84:0/76226871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32a406cc70 msgr2=0x7f32a414cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32a3fff640 1 --2- 172.21.15.84:0/76226871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32a406cc70 0x7f32a414cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32a3fff640 1 -- 172.21.15.84:0/76226871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a414e5a0 con 0x7f32a4152b30 2024-05-21T14:42:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f329bfff640 1 --2- 172.21.15.84:0/76226871 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a40c4d90 0x7f32a414e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:42:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.068+0000 7f32a3fff640 1 --2- 172.21.15.84:0/76226871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a4152b30 0x7f32a414ac60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f329c00c6a0 tx=0x7f329c00cb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.072+0000 7f32a0ff9640 1 -- 172.21.15.84:0/76226871 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c018070 con 0x7f32a4152b30 2024-05-21T14:42:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.072+0000 7f32a0ff9640 1 -- 172.21.15.84:0/76226871 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c004d70 con 0x7f32a4152b30 2024-05-21T14:42:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.072+0000 7f32aa1b0640 1 -- 172.21.15.84:0/76226871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a41f53c0 con 0x7f32a4152b30 2024-05-21T14:42:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.072+0000 7f32aa1b0640 1 -- 172.21.15.84:0/76226871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a41f5980 con 0x7f32a4152b30 2024-05-21T14:42:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.072+0000 7f32a0ff9640 1 -- 172.21.15.84:0/76226871 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c00a880 con 0x7f32a4152b30 2024-05-21T14:42:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.072+0000 7f32a0ff9640 1 -- 172.21.15.84:0/76226871 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f329c01b070 con 0x7f32a4152b30 2024-05-21T14:42:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.072+0000 7f32a0ff9640 1 -- 172.21.15.84:0/76226871 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f329c007800 con 0x7f32a4152b30 2024-05-21T14:42:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.072+0000 7f32aa1b0640 1 -- 172.21.15.84:0/76226871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a404f730 con 0x7f32a4152b30 2024-05-21T14:42:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.072+0000 7f32a0ff9640 1 -- 172.21.15.84:0/76226871 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f329c022080 con 0x7f32a4152b30 2024-05-21T14:42:56.115 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:56.110+0000 7feaaae49180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-21T14:42:56.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.136+0000 7f32aa1b0640 1 -- 172.21.15.84:0/76226871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7a6fc449-1be1-4654-82ac-596df6f939c3", "id": 6} v 0) -- 0x7f32a40c7d80 con 0x7f32a4152b30 2024-05-21T14:42:56.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.144+0000 7f32a0ff9640 1 -- 172.21.15.84:0/76226871 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7a6fc449-1be1-4654-82ac-596df6f939c3", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f329c0070d0 con 0x7f32a4152b30 2024-05-21T14:42:56.151 INFO:teuthology.orchestra.run.smithi084.stdout:6 2024-05-21T14:42:56.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.144+0000 7f32aa1b0640 1 -- 172.21.15.84:0/76226871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a4152b30 msgr2=0x7f32a414ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:56.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.144+0000 7f32aa1b0640 1 --2- 172.21.15.84:0/76226871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a4152b30 0x7f32a414ac60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f329c00c6a0 tx=0x7f329c00cb60 comp rx=0 tx=0).stop 2024-05-21T14:42:56.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.144+0000 7f32aa1b0640 1 -- 172.21.15.84:0/76226871 shutdown_connections 2024-05-21T14:42:56.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.144+0000 7f32aa1b0640 1 --2- 172.21.15.84:0/76226871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a4152b30 0x7f32a414ac60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.144+0000 7f32aa1b0640 1 --2- 172.21.15.84:0/76226871 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a40c4d90 0x7f32a414e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.144+0000 7f32aa1b0640 1 --2- 172.21.15.84:0/76226871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32a406cc70 0x7f32a414cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.144+0000 7f32aa1b0640 1 -- 172.21.15.84:0/76226871 >> 172.21.15.84:0/76226871 conn(0x7f32a40ce370 msgr2=0x7f32a414f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:56.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.144+0000 7f32aa1b0640 1 -- 172.21.15.84:0/76226871 shutdown_connections 2024-05-21T14:42:56.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.144+0000 7f32aa1b0640 1 -- 172.21.15.84:0/76226871 wait complete. 2024-05-21T14:42:56.168 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new b4b56151-6eb0-413e-9ecc-436b8af9e735 7 2024-05-21T14:42:56.212 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:56.182+0000 7feaaae49180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-21T14:42:56.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.384+0000 7f8d3a288640 1 Processor -- start 2024-05-21T14:42:56.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.384+0000 7f8d3a288640 1 -- start start 2024-05-21T14:42:56.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.384+0000 7f8d3a288640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d340c8540 0x7f8d3415f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:56.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.384+0000 7f8d3a288640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8d3415fb20 0x7f8d34166300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.384+0000 7f8d3a288640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d340c9820 con 0x7f8d340c8950 2024-05-21T14:42:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.384+0000 7f8d3a288640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f8d340c95d0 con 0x7f8d3415fb20 2024-05-21T14:42:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.384+0000 7f8d3a288640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8d340ca3a0 con 0x7f8d340c8540 2024-05-21T14:42:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.384+0000 7f8d33fff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d340c8540 0x7f8d3415f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.384+0000 7f8d38825640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8d3415fb20 0x7f8d34166300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.384+0000 7f8d38825640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8d3415fb20 0x7f8d34166300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57706/0 (socket says 172.21.15.84:57706) 2024-05-21T14:42:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.384+0000 7f8d33fff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d340c8540 0x7f8d3415f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.84:47052/0 (socket says 172.21.15.84:47052) 2024-05-21T14:42:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.384+0000 7f8d38825640 1 -- 172.21.15.84:0/2086607787 learned_addr learned my addr 172.21.15.84:0/2086607787 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-21T14:42:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.384+0000 7f8d33fff640 1 -- 172.21.15.84:0/2086607787 >> v2:172.21.15.84:3300/0 conn(0x7f8d3415fb20 msgr2=0x7f8d34166300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:42:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.384+0000 7f8d33fff640 1 --2- 172.21.15.84:0/2086607787 >> v2:172.21.15.84:3300/0 conn(0x7f8d3415fb20 0x7f8d34166300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.384+0000 7f8d33fff640 1 -- 172.21.15.84:0/2086607787 >> v1:172.21.15.78:6789/0 conn(0x7f8d340c8950 legacy=0x7f8d340c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:42:56.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.384+0000 7f8d33fff640 1 -- 172.21.15.84:0/2086607787 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d340c9b00 con 0x7f8d340c8540 2024-05-21T14:42:56.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.388+0000 7f8d33fff640 1 --2- 172.21.15.84:0/2086607787 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d340c8540 0x7f8d3415f5e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0097c0 tx=0x7f8d1c01c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64641ebac0ac00a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:56.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.388+0000 7f8d32ffd640 1 -- 172.21.15.84:0/2086607787 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0b1070 con 0x7f8d340c8540 2024-05-21T14:42:56.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.388+0000 7f8d32ffd640 1 -- 172.21.15.84:0/2086607787 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1c0ac640 con 0x7f8d340c8540 2024-05-21T14:42:56.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.388+0000 7f8d32ffd640 1 -- 172.21.15.84:0/2086607787 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0aca10 con 0x7f8d340c8540 2024-05-21T14:42:56.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.388+0000 7f8d3a288640 1 -- 172.21.15.84:0/2086607787 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d340c8540 msgr2=0x7f8d3415f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:56.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.388+0000 7f8d3a288640 1 --2- 172.21.15.84:0/2086607787 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d340c8540 0x7f8d3415f5e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0097c0 tx=0x7f8d1c01c460 comp rx=0 tx=0).stop 2024-05-21T14:42:56.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.388+0000 7f8d3a288640 1 -- 172.21.15.84:0/2086607787 shutdown_connections 2024-05-21T14:42:56.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.388+0000 7f8d3a288640 1 --2- 172.21.15.84:0/2086607787 >> v2:172.21.15.84:3300/0 conn(0x7f8d3415fb20 0x7f8d34166300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.388+0000 7f8d3a288640 1 --2- 172.21.15.84:0/2086607787 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d340c8540 0x7f8d3415f5e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.388+0000 7f8d3a288640 1 -- 172.21.15.84:0/2086607787 >> 172.21.15.84:0/2086607787 conn(0x7f8d3406c960 msgr2=0x7f8d3406cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:56.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.388+0000 7f8d3a288640 1 -- 172.21.15.84:0/2086607787 shutdown_connections 2024-05-21T14:42:56.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.388+0000 7f8d3a288640 1 -- 172.21.15.84:0/2086607787 wait complete. 2024-05-21T14:42:56.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.388+0000 7f8d3a288640 1 Processor -- start 2024-05-21T14:42:56.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.388+0000 7f8d3a288640 1 -- start start 2024-05-21T14:42:56.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d3a288640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d340c8540 0x7f8d3414da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:56.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d3a288640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d340c8950 0x7f8d34148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:56.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d3a288640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d3415fb20 0x7f8d3414c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:56.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d3a288640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3415c8c0 con 0x7f8d3415fb20 2024-05-21T14:42:56.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d3a288640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3406c470 con 0x7f8d340c8950 2024-05-21T14:42:56.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d3a288640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8d340c3ea0 con 0x7f8d340c8540 2024-05-21T14:42:56.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d33fff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d340c8540 0x7f8d3414da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:56.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d33fff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d340c8540 0x7f8d3414da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.84:47062/0 (socket says 172.21.15.84:47062) 2024-05-21T14:42:56.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d337fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d340c8950 0x7f8d34148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:56.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d33fff640 1 -- 172.21.15.84:0/1839793128 learned_addr learned my addr 172.21.15.84:0/1839793128 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-21T14:42:56.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d38825640 1 --2- 172.21.15.84:0/1839793128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d3415fb20 0x7f8d3414c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:56.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d33fff640 1 -- 172.21.15.84:0/1839793128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d340c8950 msgr2=0x7f8d34148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:56.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d33fff640 1 --2- 172.21.15.84:0/1839793128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d340c8950 0x7f8d34148430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d33fff640 1 -- 172.21.15.84:0/1839793128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d3415fb20 msgr2=0x7f8d3414c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:56.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d33fff640 1 --2- 172.21.15.84:0/1839793128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d3415fb20 0x7f8d3414c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d33fff640 1 -- 172.21.15.84:0/1839793128 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d340ccb60 con 0x7f8d340c8540 2024-05-21T14:42:56.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d33fff640 1 --2- 172.21.15.84:0/1839793128 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d340c8540 0x7f8d3414da10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0097c0 tx=0x7f8d1c019200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:56.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d30ff9640 1 -- 172.21.15.84:0/1839793128 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0b9020 con 0x7f8d340c8540 2024-05-21T14:42:56.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d30ff9640 1 -- 172.21.15.84:0/1839793128 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1c0b5410 con 0x7f8d340c8540 2024-05-21T14:42:56.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d3a288640 1 -- 172.21.15.84:0/1839793128 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d34147390 con 0x7f8d340c8540 2024-05-21T14:42:56.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d30ff9640 1 -- 172.21.15.84:0/1839793128 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0b1040 con 0x7f8d340c8540 2024-05-21T14:42:56.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d3a288640 1 -- 172.21.15.84:0/1839793128 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d340cbcb0 con 0x7f8d340c8540 2024-05-21T14:42:56.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d30ff9640 1 -- 172.21.15.84:0/1839793128 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8d1c0bc020 con 0x7f8d340c8540 2024-05-21T14:42:56.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d30ff9640 1 -- 172.21.15.84:0/1839793128 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f8d1c0bd3b0 con 0x7f8d340c8540 2024-05-21T14:42:56.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.392+0000 7f8d3a288640 1 -- 172.21.15.84:0/1839793128 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d34147180 con 0x7f8d340c8540 2024-05-21T14:42:56.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.396+0000 7f8d30ff9640 1 -- 172.21.15.84:0/1839793128 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8d1c0c3030 con 0x7f8d340c8540 2024-05-21T14:42:56.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.464+0000 7f8d3a288640 1 -- 172.21.15.84:0/1839793128 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b4b56151-6eb0-413e-9ecc-436b8af9e735", "id": 7} v 0) -- 0x7f8d3404f730 con 0x7f8d340c8540 2024-05-21T14:42:56.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.476+0000 7f8d30ff9640 1 -- 172.21.15.84:0/1839793128 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b4b56151-6eb0-413e-9ecc-436b8af9e735", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f8d1c016050 con 0x7f8d340c8540 2024-05-21T14:42:56.483 INFO:teuthology.orchestra.run.smithi084.stdout:7 2024-05-21T14:42:56.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.476+0000 7f8d3a288640 1 -- 172.21.15.84:0/1839793128 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d340c8540 msgr2=0x7f8d3414da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:56.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.476+0000 7f8d3a288640 1 --2- 172.21.15.84:0/1839793128 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d340c8540 0x7f8d3414da10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0097c0 tx=0x7f8d1c019200 comp rx=0 tx=0).stop 2024-05-21T14:42:56.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.476+0000 7f8d3a288640 1 -- 172.21.15.84:0/1839793128 shutdown_connections 2024-05-21T14:42:56.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.476+0000 7f8d3a288640 1 --2- 172.21.15.84:0/1839793128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d3415fb20 0x7f8d3414c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.476+0000 7f8d3a288640 1 --2- 172.21.15.84:0/1839793128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d340c8950 0x7f8d34148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.476+0000 7f8d3a288640 1 --2- 172.21.15.84:0/1839793128 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d340c8540 0x7f8d3414da10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.476+0000 7f8d3a288640 1 -- 172.21.15.84:0/1839793128 >> 172.21.15.84:0/1839793128 conn(0x7f8d3406c960 msgr2=0x7f8d340c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:56.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.476+0000 7f8d3a288640 1 -- 172.21.15.84:0/1839793128 shutdown_connections 2024-05-21T14:42:56.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-21T14:42:56.476+0000 7f8d3a288640 1 -- 172.21.15.84:0/1839793128 wait complete. 2024-05-21T14:42:56.502 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-21T14:42:56.502 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-21T14:42:56.507 INFO:tasks.ceph.osd.0:Started 2024-05-21T14:42:56.507 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-21T14:42:56.507 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-21T14:42:56.518 INFO:tasks.ceph.osd.1:Started 2024-05-21T14:42:56.519 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-21T14:42:56.519 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-21T14:42:56.524 INFO:tasks.ceph.osd.2:Started 2024-05-21T14:42:56.524 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-21T14:42:56.524 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-21T14:42:56.533 INFO:tasks.ceph.osd.3:Started 2024-05-21T14:42:56.534 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-21T14:42:56.534 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-21T14:42:56.536 INFO:tasks.ceph.osd.4:Started 2024-05-21T14:42:56.536 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-21T14:42:56.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-21T14:42:56.538 INFO:tasks.ceph.osd.5:Started 2024-05-21T14:42:56.538 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-21T14:42:56.539 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-21T14:42:56.540 INFO:tasks.ceph.osd.6:Started 2024-05-21T14:42:56.541 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-21T14:42:56.541 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-21T14:42:56.543 INFO:tasks.ceph.osd.7:Started 2024-05-21T14:42:56.543 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:42:56.563 INFO:tasks.ceph.mgr.x.smithi084.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-21T14:42:56.563 INFO:tasks.ceph.mgr.x.smithi084.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-21T14:42:56.563 INFO:tasks.ceph.mgr.x.smithi084.stderr: from numpy import show_config as show_numpy_config 2024-05-21T14:42:56.629 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:56.620+0000 7fb5815d3180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-21T14:42:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.734+0000 7f6c8e400640 1 Processor -- start 2024-05-21T14:42:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.734+0000 7f6c8e400640 1 -- start start 2024-05-21T14:42:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.738+0000 7f6c8e400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6c8815d730 0x7f6c880cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.738+0000 7f6c8e400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c880cbab0 0x7f6c88164000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.738+0000 7f6c8e400640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c880c3eb0 con 0x7f6c880c9550 2024-05-21T14:42:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.738+0000 7f6c8e400640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f6c88071010 con 0x7f6c880cbab0 2024-05-21T14:42:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.738+0000 7f6c8e400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f6c880cbec0 con 0x7f6c8815d730 2024-05-21T14:42:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.738+0000 7f6c87400640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6c880c9550 0x7f6c880714a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34104/0 (socket says 172.21.15.78:34104) 2024-05-21T14:42:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.738+0000 7f6c87400640 1 -- 172.21.15.78:0/734806363 learned_addr learned my addr 172.21.15.78:0/734806363 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:42:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.738+0000 7f6c87e00640 1 --2- 172.21.15.78:0/734806363 >> v2:172.21.15.78:3300/0 conn(0x7f6c880cbab0 0x7f6c88164000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.738+0000 7f6c7fe00640 1 --2- 172.21.15.78:0/734806363 >> v2:172.21.15.84:3300/0 conn(0x7f6c8815d730 0x7f6c880cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.738+0000 7f6c87e00640 1 -- 172.21.15.78:0/734806363 >> v2:172.21.15.84:3300/0 conn(0x7f6c8815d730 msgr2=0x7f6c880cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:42:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.738+0000 7f6c87e00640 1 --2- 172.21.15.78:0/734806363 >> v2:172.21.15.84:3300/0 conn(0x7f6c8815d730 0x7f6c880cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.738+0000 7f6c87e00640 1 -- 172.21.15.78:0/734806363 >> v1:172.21.15.78:6789/0 conn(0x7f6c880c9550 legacy=0x7f6c880714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.738+0000 7f6c87e00640 1 -- 172.21.15.78:0/734806363 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8815cc70 con 0x7f6c880cbab0 2024-05-21T14:42:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.738+0000 7f6c86a00640 1 -- 172.21.15.78:0/734806363 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3661465748 0 0) 0x7f6c880c3eb0 con 0x7f6c880c9550 2024-05-21T14:42:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.742+0000 7f6c87e00640 1 --2- 172.21.15.78:0/734806363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c880cbab0 0x7f6c88164000 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6c880c9050 tx=0x7f6c8001f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b815365a1211b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:56.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.742+0000 7f6c86a00640 1 -- 172.21.15.78:0/734806363 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c800b4070 con 0x7f6c880cbab0 2024-05-21T14:42:56.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.742+0000 7f6c86a00640 1 -- 172.21.15.78:0/734806363 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c800af600 con 0x7f6c880cbab0 2024-05-21T14:42:56.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.742+0000 7f6c86a00640 1 -- 172.21.15.78:0/734806363 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c800af9d0 con 0x7f6c880cbab0 2024-05-21T14:42:56.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.742+0000 7f6c8e400640 1 -- 172.21.15.78:0/734806363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c880cbab0 msgr2=0x7f6c88164000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:56.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.742+0000 7f6c8e400640 1 --2- 172.21.15.78:0/734806363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c880cbab0 0x7f6c88164000 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6c880c9050 tx=0x7f6c8001f110 comp rx=0 tx=0).stop 2024-05-21T14:42:56.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.742+0000 7f6c8e400640 1 -- 172.21.15.78:0/734806363 shutdown_connections 2024-05-21T14:42:56.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.742+0000 7f6c8e400640 1 --2- 172.21.15.78:0/734806363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c880cbab0 0x7f6c88164000 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.742+0000 7f6c8e400640 1 --2- 172.21.15.78:0/734806363 >> v2:172.21.15.84:3300/0 conn(0x7f6c8815d730 0x7f6c880cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.742+0000 7f6c8e400640 1 -- 172.21.15.78:0/734806363 >> 172.21.15.78:0/734806363 conn(0x7f6c880752c0 msgr2=0x7f6c880ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:56.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.742+0000 7f6c8e400640 1 -- 172.21.15.78:0/734806363 shutdown_connections 2024-05-21T14:42:56.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.742+0000 7f6c8e400640 1 -- 172.21.15.78:0/734806363 wait complete. 2024-05-21T14:42:56.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.746+0000 7f6c8e400640 1 Processor -- start 2024-05-21T14:42:56.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.746+0000 7f6c8e400640 1 -- start start 2024-05-21T14:42:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.746+0000 7f6c8e400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c880c9550 0x7f6c88141510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.746+0000 7f6c8e400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6c880cbab0 0x7f6c881584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.746+0000 7f6c8e400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8815d730 0x7f6c881e4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.746+0000 7f6c8e400640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6c880c4430 con 0x7f6c880c9550 2024-05-21T14:42:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.746+0000 7f6c8e400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6c880c4150 con 0x7f6c8815d730 2024-05-21T14:42:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.746+0000 7f6c8e400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8815db40 con 0x7f6c880cbab0 2024-05-21T14:42:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.746+0000 7f6c87400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c880c9550 0x7f6c88141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.746+0000 7f6c87400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c880c9550 0x7f6c88141510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39014/0 (socket says 172.21.15.78:39014) 2024-05-21T14:42:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.746+0000 7f6c87400640 1 -- 172.21.15.78:0/1954146173 learned_addr learned my addr 172.21.15.78:0/1954146173 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:42:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.746+0000 7f6c7fe00640 1 --2- 172.21.15.78:0/1954146173 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6c880cbab0 0x7f6c881584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.746+0000 7f6c87e00640 1 --2- 172.21.15.78:0/1954146173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8815d730 0x7f6c881e4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.750+0000 7f6c87400640 1 -- 172.21.15.78:0/1954146173 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6c880cbab0 msgr2=0x7f6c881584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.750+0000 7f6c87400640 1 --2- 172.21.15.78:0/1954146173 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6c880cbab0 0x7f6c881584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.750+0000 7f6c87400640 1 -- 172.21.15.78:0/1954146173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8815d730 msgr2=0x7f6c881e4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.750+0000 7f6c87400640 1 --2- 172.21.15.78:0/1954146173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8815d730 0x7f6c881e4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.750+0000 7f6c87400640 1 -- 172.21.15.78:0/1954146173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c880ce600 con 0x7f6c880c9550 2024-05-21T14:42:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.750+0000 7f6c87400640 1 --2- 172.21.15.78:0/1954146173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c880c9550 0x7f6c88141510 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6c78007fd0 tx=0x7f6c7800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.750+0000 7f6c7f400640 1 -- 172.21.15.78:0/1954146173 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78017070 con 0x7f6c880c9550 2024-05-21T14:42:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.750+0000 7f6c7f400640 1 -- 172.21.15.78:0/1954146173 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c78005d10 con 0x7f6c880c9550 2024-05-21T14:42:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.750+0000 7f6c8e400640 1 -- 172.21.15.78:0/1954146173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c88157b60 con 0x7f6c880c9550 2024-05-21T14:42:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.750+0000 7f6c7f400640 1 -- 172.21.15.78:0/1954146173 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78007310 con 0x7f6c880c9550 2024-05-21T14:42:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.750+0000 7f6c8e400640 1 -- 172.21.15.78:0/1954146173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c880c6bd0 con 0x7f6c880c9550 2024-05-21T14:42:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.750+0000 7f6c7f400640 1 -- 172.21.15.78:0/1954146173 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6c7801a070 con 0x7f6c880c9550 2024-05-21T14:42:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.750+0000 7f6c7f400640 1 -- 172.21.15.78:0/1954146173 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6c780074b0 con 0x7f6c880c9550 2024-05-21T14:42:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.750+0000 7f6c8e400640 1 -- 172.21.15.78:0/1954146173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c8804f730 con 0x7f6c880c9550 2024-05-21T14:42:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.754+0000 7f6c7f400640 1 -- 172.21.15.78:0/1954146173 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6c78021020 con 0x7f6c880c9550 2024-05-21T14:42:56.776 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:56.768+0000 7fb5815d3180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-21T14:42:56.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.810+0000 7f6c8e400640 1 -- 172.21.15.78:0/1954146173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c880c9dc0 con 0x7f6c880c9550 2024-05-21T14:42:56.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.810+0000 7f6c7f400640 1 -- 172.21.15.78:0/1954146173 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6c7801c440 con 0x7f6c880c9550 2024-05-21T14:42:56.816 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:42:56.817 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":10,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:42:56.469635+0000","last_up_change":"0.000000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:42:56.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.810+0000 7f6c8e400640 1 -- 172.21.15.78:0/1954146173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c880c9550 msgr2=0x7f6c88141510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:56.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.810+0000 7f6c8e400640 1 --2- 172.21.15.78:0/1954146173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c880c9550 0x7f6c88141510 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6c78007fd0 tx=0x7f6c7800c8e0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.810+0000 7f6c8e400640 1 -- 172.21.15.78:0/1954146173 shutdown_connections 2024-05-21T14:42:56.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.810+0000 7f6c8e400640 1 --2- 172.21.15.78:0/1954146173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c8815d730 0x7f6c881e4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.810+0000 7f6c8e400640 1 --2- 172.21.15.78:0/1954146173 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6c880cbab0 0x7f6c881584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.810+0000 7f6c8e400640 1 --2- 172.21.15.78:0/1954146173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c880c9550 0x7f6c88141510 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:56.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.810+0000 7f6c8e400640 1 -- 172.21.15.78:0/1954146173 >> 172.21.15.78:0/1954146173 conn(0x7f6c880752c0 msgr2=0x7f6c880c9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:56.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.810+0000 7f6c8e400640 1 -- 172.21.15.78:0/1954146173 shutdown_connections 2024-05-21T14:42:56.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:42:56.810+0000 7f6c8e400640 1 -- 172.21.15.78:0/1954146173 wait complete. 2024-05-21T14:42:56.836 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-21T14:42:56.836 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-21T14:42:56.851 INFO:tasks.ceph.mgr.y.smithi078.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-21T14:42:56.851 INFO:tasks.ceph.mgr.y.smithi078.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-21T14:42:56.851 INFO:tasks.ceph.mgr.y.smithi078.stderr: from numpy import show_config as show_numpy_config 2024-05-21T14:42:56.889 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:56.882+0000 7feaaae49180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-21T14:42:56.942 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:56.932+0000 7fb5815d3180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-21T14:42:57.006 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:56.996+0000 7fb5815d3180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-21T14:42:57.039 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:57.034+0000 7feaaae49180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-21T14:42:57.140 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:57.132+0000 7fb5815d3180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-21T14:42:57.188 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-05-21T14:42:57.180+0000 7f5395df87c0 -1 Falling back to public interface 2024-05-21T14:42:57.188 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-05-21T14:42:57.180+0000 7f7a02ce57c0 -1 Falling back to public interface 2024-05-21T14:42:57.189 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-05-21T14:42:57.180+0000 7f5394db8640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-05-21T14:42:57.189 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-05-21T14:42:57.180+0000 7f87f01b57c0 -1 Falling back to public interface 2024-05-21T14:42:57.189 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-05-21T14:42:57.180+0000 7f5394db8640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-05-21T14:42:57.190 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-05-21T14:42:57.180+0000 7f7a01ca5640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6805/0: (98) Address already in use 2024-05-21T14:42:57.203 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-05-21T14:42:57.196+0000 7f6b5930b7c0 -1 Falling back to public interface 2024-05-21T14:42:57.220 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-05-21T14:42:57.214+0000 7f903be547c0 -1 Falling back to public interface 2024-05-21T14:42:57.229 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-05-21T14:42:57.222+0000 7f6f7f8ec7c0 -1 Falling back to public interface 2024-05-21T14:42:57.229 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-05-21T14:42:57.222+0000 7f61576d67c0 -1 Falling back to public interface 2024-05-21T14:42:57.229 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:57.222+0000 7feaaae49180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-21T14:42:57.239 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-05-21T14:42:57.234+0000 7f094d7c67c0 -1 Falling back to public interface 2024-05-21T14:42:57.310 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:57.302+0000 7feaaae49180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-21T14:42:57.460 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:57.454+0000 7feaaae49180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-21T14:42:57.641 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-21T14:42:57.769 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:57.760+0000 7fb5815d3180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-21T14:42:57.777 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.770+0000 7fa687e00640 1 Processor -- start 2024-05-21T14:42:57.777 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.770+0000 7fa687e00640 1 -- start start 2024-05-21T14:42:57.779 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.774+0000 7fa687e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa68006fc10 0x7fa680165160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:57.779 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.774+0000 7fa687e00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6800caea0 con 0x7fa68006f800 2024-05-21T14:42:57.779 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.774+0000 7fa687e00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6800cb180 con 0x7fa680156c40 2024-05-21T14:42:57.779 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.774+0000 7fa687e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa68015cf80 con 0x7fa68006fc10 2024-05-21T14:42:57.779 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.774+0000 7fa684a00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa68006f800 0x7fa68015d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34118/0 (socket says 172.21.15.78:34118) 2024-05-21T14:42:57.779 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.774+0000 7fa684a00640 1 -- 172.21.15.78:0/1715063641 learned_addr learned my addr 172.21.15.78:0/1715063641 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:42:57.779 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.774+0000 7fa685e00640 1 --2- 172.21.15.78:0/1715063641 >> v2:172.21.15.84:3300/0 conn(0x7fa68006fc10 0x7fa680165160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:57.780 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.774+0000 7fa67fe00640 1 -- 172.21.15.78:0/1715063641 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1332161298 0 0) 0x7fa6800caea0 con 0x7fa68006f800 2024-05-21T14:42:57.780 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.774+0000 7fa67fe00640 1 -- 172.21.15.78:0/1715063641 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa668003530 con 0x7fa68006f800 2024-05-21T14:42:57.780 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.774+0000 7fa67fe00640 1 -- 172.21.15.78:0/1715063641 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 307482254 0 0) 0x7fa6800cb180 con 0x7fa680156c40 2024-05-21T14:42:57.780 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.774+0000 7fa67fe00640 1 -- 172.21.15.78:0/1715063641 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6800caea0 con 0x7fa680156c40 2024-05-21T14:42:57.780 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.774+0000 7fa685e00640 1 -- 172.21.15.78:0/1715063641 >> v1:172.21.15.84:6789/0 conn(0x7fa680156c40 legacy=0x7fa6800c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:57.780 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.774+0000 7fa67fe00640 1 -- 172.21.15.78:0/1715063641 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 481304763 0 0) 0x7fa668003530 con 0x7fa68006f800 2024-05-21T14:42:57.780 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.774+0000 7fa685e00640 1 -- 172.21.15.78:0/1715063641 >> v1:172.21.15.78:6789/0 conn(0x7fa68006f800 legacy=0x7fa68015d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:57.780 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.774+0000 7fa685e00640 1 -- 172.21.15.78:0/1715063641 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6800cb460 con 0x7fa68006fc10 2024-05-21T14:42:57.782 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.778+0000 7fa685e00640 1 --2- 172.21.15.78:0/1715063641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa68006fc10 0x7fa680165160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa678009d90 tx=0x7fa67801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba03191c5ac1a3bb server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:57.783 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.778+0000 7fa67fe00640 1 -- 172.21.15.78:0/1715063641 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c001680 con 0x7fa68006fc10 2024-05-21T14:42:57.783 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.778+0000 7fa67fe00640 1 -- 172.21.15.78:0/1715063641 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6780a64e0 con 0x7fa68006fc10 2024-05-21T14:42:57.783 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.778+0000 7fa67fe00640 1 -- 172.21.15.78:0/1715063641 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6780a6890 con 0x7fa68006fc10 2024-05-21T14:42:57.784 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.778+0000 7fa687e00640 1 -- 172.21.15.78:0/1715063641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa68006fc10 msgr2=0x7fa680165160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:57.784 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.778+0000 7fa687e00640 1 --2- 172.21.15.78:0/1715063641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa68006fc10 0x7fa680165160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa678009d90 tx=0x7fa67801c890 comp rx=0 tx=0).stop 2024-05-21T14:42:57.784 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.778+0000 7fa687e00640 1 -- 172.21.15.78:0/1715063641 shutdown_connections 2024-05-21T14:42:57.784 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.778+0000 7fa687e00640 1 --2- 172.21.15.78:0/1715063641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa68006fc10 0x7fa680165160 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:57.784 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.778+0000 7fa687e00640 1 -- 172.21.15.78:0/1715063641 >> 172.21.15.78:0/1715063641 conn(0x7fa680073d80 msgr2=0x7fa6800cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:57.784 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.778+0000 7fa687e00640 1 -- 172.21.15.78:0/1715063641 shutdown_connections 2024-05-21T14:42:57.784 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.778+0000 7fa687e00640 1 -- 172.21.15.78:0/1715063641 wait complete. 2024-05-21T14:42:57.786 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.778+0000 7fa687e00640 1 Processor -- start 2024-05-21T14:42:57.786 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.778+0000 7fa687e00640 1 -- start start 2024-05-21T14:42:57.790 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa687e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68006f800 0x7fa680151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:57.790 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa687e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa68006fc10 0x7fa6801f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:57.790 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa687e00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa680156c40 0x7fa68014e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:42:57.790 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa687e00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa68015db20 con 0x7fa68006f800 2024-05-21T14:42:57.790 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa687e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa6800cb740 con 0x7fa68006fc10 2024-05-21T14:42:57.790 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa687e00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa68015dca0 con 0x7fa680156c40 2024-05-21T14:42:57.790 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa685400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68006f800 0x7fa680151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:57.790 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa685400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68006f800 0x7fa680151590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39020/0 (socket says 172.21.15.78:39020) 2024-05-21T14:42:57.790 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa685400640 1 -- 172.21.15.78:0/3313320398 learned_addr learned my addr 172.21.15.78:0/3313320398 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:42:57.791 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa684a00640 1 --2- 172.21.15.78:0/3313320398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa68006fc10 0x7fa6801f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:57.791 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa685e00640 1 --2- 172.21.15.78:0/3313320398 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa680156c40 0x7fa68014e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:42:57.791 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa685400640 1 -- 172.21.15.78:0/3313320398 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa680156c40 msgr2=0x7fa68014e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:57.791 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa685400640 1 --2- 172.21.15.78:0/3313320398 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa680156c40 0x7fa68014e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:57.791 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa685400640 1 -- 172.21.15.78:0/3313320398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa68006fc10 msgr2=0x7fa6801f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:57.791 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa685400640 1 --2- 172.21.15.78:0/3313320398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa68006fc10 0x7fa6801f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:57.791 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa685400640 1 -- 172.21.15.78:0/3313320398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa680151ad0 con 0x7fa68006f800 2024-05-21T14:42:57.791 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa685400640 1 --2- 172.21.15.78:0/3313320398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68006f800 0x7fa680151590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c460 tx=0x7fa67400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:42:57.791 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa67d600640 1 -- 172.21.15.78:0/3313320398 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6740052d0 con 0x7fa68006f800 2024-05-21T14:42:57.791 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa67d600640 1 -- 172.21.15.78:0/3313320398 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa674005490 con 0x7fa68006f800 2024-05-21T14:42:57.791 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa687e00640 1 -- 172.21.15.78:0/3313320398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6801649d0 con 0x7fa68006f800 2024-05-21T14:42:57.791 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa67d600640 1 -- 172.21.15.78:0/3313320398 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa674012850 con 0x7fa68006f800 2024-05-21T14:42:57.791 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa687e00640 1 -- 172.21.15.78:0/3313320398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6801f6fc0 con 0x7fa68006f800 2024-05-21T14:42:57.791 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa67d600640 1 -- 172.21.15.78:0/3313320398 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa6740129f0 con 0x7fa68006f800 2024-05-21T14:42:57.791 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa67d600640 1 -- 172.21.15.78:0/3313320398 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fa674012ce0 con 0x7fa68006f800 2024-05-21T14:42:57.792 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.782+0000 7fa687e00640 1 -- 172.21.15.78:0/3313320398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6800ca240 con 0x7fa68006f800 2024-05-21T14:42:57.792 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.786+0000 7fa67d600640 1 -- 172.21.15.78:0/3313320398 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa674003600 con 0x7fa68006f800 2024-05-21T14:42:57.846 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:57.836+0000 7fb5815d3180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-21T14:42:57.849 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.842+0000 7fa687e00640 1 -- 172.21.15.78:0/3313320398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa680071900 con 0x7fa68006f800 2024-05-21T14:42:57.850 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.842+0000 7fa67d600640 1 -- 172.21.15.78:0/3313320398 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fa6740037e0 con 0x7fa68006f800 2024-05-21T14:42:57.850 INFO:teuthology.misc.health.smithi078.stdout: 2024-05-21T14:42:57.850 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":10,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:42:56.469635+0000","last_up_change":"0.000000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:42:57.851 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.846+0000 7fa687e00640 1 -- 172.21.15.78:0/3313320398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68006f800 msgr2=0x7fa680151590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:42:57.851 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.846+0000 7fa687e00640 1 --2- 172.21.15.78:0/3313320398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68006f800 0x7fa680151590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c460 tx=0x7fa67400c920 comp rx=0 tx=0).stop 2024-05-21T14:42:57.851 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.846+0000 7fa687e00640 1 -- 172.21.15.78:0/3313320398 shutdown_connections 2024-05-21T14:42:57.852 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.846+0000 7fa687e00640 1 --2- 172.21.15.78:0/3313320398 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa680156c40 0x7fa68014e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:57.852 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.846+0000 7fa687e00640 1 --2- 172.21.15.78:0/3313320398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa68006fc10 0x7fa6801f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:57.852 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.846+0000 7fa687e00640 1 --2- 172.21.15.78:0/3313320398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68006f800 0x7fa680151590 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:42:57.852 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.846+0000 7fa687e00640 1 -- 172.21.15.78:0/3313320398 >> 172.21.15.78:0/3313320398 conn(0x7fa680073d80 msgr2=0x7fa680158a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:42:57.852 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.846+0000 7fa687e00640 1 -- 172.21.15.78:0/3313320398 shutdown_connections 2024-05-21T14:42:57.852 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:42:57.846+0000 7fa687e00640 1 -- 172.21.15.78:0/3313320398 wait complete. 2024-05-21T14:42:57.868 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-21T14:42:58.029 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:58.020+0000 7fb5815d3180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-21T14:42:58.103 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:58.096+0000 7fb5815d3180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-21T14:42:58.159 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:58.154+0000 7feaaae49180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-21T14:42:58.246 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:58.238+0000 7feaaae49180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-21T14:42:58.395 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:58.388+0000 7fb5815d3180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-21T14:42:58.449 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:58.442+0000 7feaaae49180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-21T14:42:58.457 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:58.448+0000 7fb5815d3180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-21T14:42:58.538 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:58.530+0000 7feaaae49180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-21T14:42:58.869 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:58.862+0000 7feaaae49180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-21T14:42:58.941 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-05-21T14:42:58.934+0000 7feaaae49180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-21T14:42:59.506 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:59.495+0000 7fb528881640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-21T14:42:59.506 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-21T14:42:59.495+0000 7fb528881640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-21T14:43:00.833 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-05-21T14:43:00.823+0000 7f7a02ce57c0 -1 osd.7 0 log_to_monitors true 2024-05-21T14:43:01.060 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-05-21T14:43:01.051+0000 7f87f01b57c0 -1 osd.4 0 log_to_monitors true 2024-05-21T14:43:01.060 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-05-21T14:43:01.051+0000 7f6b5930b7c0 -1 osd.5 0 log_to_monitors true 2024-05-21T14:43:01.093 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-05-21T14:43:01.086+0000 7f61576d67c0 -1 osd.3 0 log_to_monitors true 2024-05-21T14:43:01.095 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-05-21T14:43:01.087+0000 7f5395df87c0 -1 osd.6 0 log_to_monitors true 2024-05-21T14:43:01.262 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-05-21T14:43:01.254+0000 7f094d7c67c0 -1 osd.1 0 log_to_monitors true 2024-05-21T14:43:01.290 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-05-21T14:43:01.282+0000 7f6f7f8ec7c0 -1 osd.2 0 log_to_monitors true 2024-05-21T14:43:01.310 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-05-21T14:43:01.302+0000 7f903be547c0 -1 osd.0 0 log_to_monitors true 2024-05-21T14:43:02.627 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-05-21T14:43:02.619+0000 7f79fec8c640 -1 osd.7 0 waiting for initial osdmap 2024-05-21T14:43:02.650 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-05-21T14:43:02.639+0000 7f79f6a8d640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T14:43:04.004 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-05-21T14:43:03.995+0000 7f6b552b2640 -1 osd.5 0 waiting for initial osdmap 2024-05-21T14:43:04.027 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-05-21T14:43:04.019+0000 7f6b4d0b3640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T14:43:04.038 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-05-21T14:43:04.027+0000 7f87ec15c640 -1 osd.4 0 waiting for initial osdmap 2024-05-21T14:43:04.039 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-05-21T14:43:04.031+0000 7f5391d9f640 -1 osd.6 0 waiting for initial osdmap 2024-05-21T14:43:04.067 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-05-21T14:43:04.059+0000 7f87e3f5d640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T14:43:04.070 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-05-21T14:43:04.059+0000 7f5389ba0640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T14:43:04.442 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-05-21T14:43:04.434+0000 7f9036e00640 -1 osd.0 0 waiting for initial osdmap 2024-05-21T14:43:04.457 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-05-21T14:43:04.450+0000 7f6153000640 -1 osd.3 0 waiting for initial osdmap 2024-05-21T14:43:04.468 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-05-21T14:43:04.462+0000 7f902ce00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T14:43:04.480 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-05-21T14:43:04.474+0000 7f6148600640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T14:43:04.485 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-05-21T14:43:04.478+0000 7f0948600640 -1 osd.1 0 waiting for initial osdmap 2024-05-21T14:43:04.498 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-05-21T14:43:04.494+0000 7f6f7a800640 -1 osd.2 0 waiting for initial osdmap 2024-05-21T14:43:04.544 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-05-21T14:43:04.538+0000 7f093e600640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T14:43:04.555 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-05-21T14:43:04.550+0000 7f6f70800640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T14:43:04.673 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-21T14:43:04.809 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.802+0000 7f718b400640 1 Processor -- start 2024-05-21T14:43:04.809 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.802+0000 7f718b400640 1 -- start start 2024-05-21T14:43:04.811 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.806+0000 7f718b400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f71840c7fb0 0x7f7184152b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:04.811 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.806+0000 7f718b400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7184158900 0x7f71840c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:04.811 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.806+0000 7f718b400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7184153090 con 0x7f7184158d10 2024-05-21T14:43:04.811 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.806+0000 7f718b400640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f718415be70 con 0x7f7184158900 2024-05-21T14:43:04.811 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.806+0000 7f718b400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f718415c710 con 0x7f71840c7fb0 2024-05-21T14:43:04.811 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.806+0000 7f7183e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7184158900 0x7f71840c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:04.812 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.806+0000 7f7183e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7184158900 0x7f71840c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59902/0 (socket says 172.21.15.78:59902) 2024-05-21T14:43:04.812 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.806+0000 7f7183e00640 1 -- 172.21.15.78:0/2559756214 learned_addr learned my addr 172.21.15.78:0/2559756214 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:04.812 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.806+0000 7f7188a00640 1 --2- 172.21.15.78:0/2559756214 >> v2:172.21.15.84:3300/0 conn(0x7f71840c7fb0 0x7f7184152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:04.813 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.806+0000 7f7183e00640 1 -- 172.21.15.78:0/2559756214 >> v2:172.21.15.84:3300/0 conn(0x7f71840c7fb0 msgr2=0x7f7184152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:04.813 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.806+0000 7f7183e00640 1 --2- 172.21.15.78:0/2559756214 >> v2:172.21.15.84:3300/0 conn(0x7f71840c7fb0 0x7f7184152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:04.813 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.806+0000 7f7183e00640 1 -- 172.21.15.78:0/2559756214 >> v1:172.21.15.84:6789/0 conn(0x7f7184158d10 legacy=0x7f71840c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:04.813 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.806+0000 7f7183e00640 1 -- 172.21.15.78:0/2559756214 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7184073b00 con 0x7f7184158900 2024-05-21T14:43:04.814 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.806+0000 7f7183e00640 1 --2- 172.21.15.78:0/2559756214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7184158900 0x7f71840c9290 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7184070ff0 tx=0x7f717001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4fa60024fbc295 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:04.816 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.810+0000 7f7183400640 1 -- 172.21.15.78:0/2559756214 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71700ab610 con 0x7f7184158900 2024-05-21T14:43:04.816 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.810+0000 7f7183400640 1 -- 172.21.15.78:0/2559756214 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71700b0070 con 0x7f7184158900 2024-05-21T14:43:04.816 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.810+0000 7f7183400640 1 -- 172.21.15.78:0/2559756214 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71700ab9d0 con 0x7f7184158900 2024-05-21T14:43:04.817 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.810+0000 7f718b400640 1 -- 172.21.15.78:0/2559756214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7184158900 msgr2=0x7f71840c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:04.817 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.810+0000 7f718b400640 1 --2- 172.21.15.78:0/2559756214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7184158900 0x7f71840c9290 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7184070ff0 tx=0x7f717001c520 comp rx=0 tx=0).stop 2024-05-21T14:43:04.817 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.810+0000 7f718b400640 1 -- 172.21.15.78:0/2559756214 shutdown_connections 2024-05-21T14:43:04.817 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.810+0000 7f718b400640 1 --2- 172.21.15.78:0/2559756214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7184158900 0x7f71840c9290 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:04.817 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.810+0000 7f718b400640 1 --2- 172.21.15.78:0/2559756214 >> v2:172.21.15.84:3300/0 conn(0x7f71840c7fb0 0x7f7184152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:04.817 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.810+0000 7f718b400640 1 -- 172.21.15.78:0/2559756214 >> 172.21.15.78:0/2559756214 conn(0x7f718406b620 msgr2=0x7f718406ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:04.818 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.810+0000 7f718b400640 1 -- 172.21.15.78:0/2559756214 shutdown_connections 2024-05-21T14:43:04.818 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.810+0000 7f718b400640 1 -- 172.21.15.78:0/2559756214 wait complete. 2024-05-21T14:43:04.818 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.810+0000 7f718b400640 1 Processor -- start 2024-05-21T14:43:04.818 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.810+0000 7f718b400640 1 -- start start 2024-05-21T14:43:04.820 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f718b400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71840c7fb0 0x7f718414c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:04.821 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f718b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7184158900 0x7f71840c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:04.821 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f718b400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7184158d10 0x7f71841548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:04.821 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f718b400640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f71840c9ee0 con 0x7f71840c7fb0 2024-05-21T14:43:04.821 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f718b400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f71840c83c0 con 0x7f7184158900 2024-05-21T14:43:04.821 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f718b400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f718415cba0 con 0x7f7184158d10 2024-05-21T14:43:04.821 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f7188a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71840c7fb0 0x7f718414c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:04.821 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f7188a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71840c7fb0 0x7f718414c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59908/0 (socket says 172.21.15.78:59908) 2024-05-21T14:43:04.821 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f7188a00640 1 -- 172.21.15.78:0/567268989 learned_addr learned my addr 172.21.15.78:0/567268989 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:04.821 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f7183e00640 1 --2- 172.21.15.78:0/567268989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7184158900 0x7f71840c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:04.821 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f7189400640 1 --2- 172.21.15.78:0/567268989 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7184158d10 0x7f71841548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:04.821 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f7188a00640 1 -- 172.21.15.78:0/567268989 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7184158d10 msgr2=0x7f71841548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:04.821 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f7188a00640 1 --2- 172.21.15.78:0/567268989 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7184158d10 0x7f71841548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:04.822 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f7188a00640 1 -- 172.21.15.78:0/567268989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7184158900 msgr2=0x7f71840c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:04.822 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f7188a00640 1 --2- 172.21.15.78:0/567268989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7184158900 0x7f71840c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:04.822 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f7188a00640 1 -- 172.21.15.78:0/567268989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71841560c0 con 0x7f71840c7fb0 2024-05-21T14:43:04.822 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f7183e00640 1 --2- 172.21.15.78:0/567268989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7184158900 0x7f71840c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:04.822 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f7188a00640 1 --2- 172.21.15.78:0/567268989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71840c7fb0 0x7f718414c880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f717400e870 tx=0x7f717400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:04.822 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f7180c00640 1 -- 172.21.15.78:0/567268989 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7174017070 con 0x7f71840c7fb0 2024-05-21T14:43:04.822 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f7180c00640 1 -- 172.21.15.78:0/567268989 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f717400c940 con 0x7f71840c7fb0 2024-05-21T14:43:04.822 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f718b400640 1 -- 172.21.15.78:0/567268989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71841f3620 con 0x7f71840c7fb0 2024-05-21T14:43:04.822 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f7180c00640 1 -- 172.21.15.78:0/567268989 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717400ccf0 con 0x7f71840c7fb0 2024-05-21T14:43:04.822 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f718b400640 1 -- 172.21.15.78:0/567268989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71841f2b40 con 0x7f71840c7fb0 2024-05-21T14:43:04.823 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.814+0000 7f718b400640 1 -- 172.21.15.78:0/567268989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f718404f730 con 0x7f71840c7fb0 2024-05-21T14:43:04.823 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.818+0000 7f7180c00640 1 -- 172.21.15.78:0/567268989 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f717401a070 con 0x7f71840c7fb0 2024-05-21T14:43:04.824 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.818+0000 7f7180c00640 1 --2- 172.21.15.78:0/567268989 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7164067860 0x7f7164069d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:04.824 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.818+0000 7f7180c00640 1 -- 172.21.15.78:0/567268989 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7f7174084e40 con 0x7f71840c7fb0 2024-05-21T14:43:04.824 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.818+0000 7f7183e00640 1 --2- 172.21.15.78:0/567268989 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7164067860 0x7f7164069d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:04.825 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.818+0000 7f7183e00640 1 --2- 172.21.15.78:0/567268989 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7164067860 0x7f7164069d70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f71700af000 tx=0x7f71700a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:04.829 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.822+0000 7f7180c00640 1 -- 172.21.15.78:0/567268989 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f71740566d0 con 0x7f71840c7fb0 2024-05-21T14:43:04.993 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.986+0000 7f718b400640 1 -- 172.21.15.78:0/567268989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71840b2cf0 con 0x7f71840c7fb0 2024-05-21T14:43:04.994 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.986+0000 7f7180c00640 1 -- 172.21.15.78:0/567268989 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7578 (secure 0 0 0) 0x7f7174055fd0 con 0x7f71840c7fb0 2024-05-21T14:43:04.994 INFO:teuthology.misc.health.smithi078.stdout: 2024-05-21T14:43:04.994 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":14,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:03.958664+0000","last_up_change":"2024-05-21T14:43:02.936209+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:43:04.996 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.990+0000 7f718b400640 1 -- 172.21.15.78:0/567268989 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7164067860 msgr2=0x7f7164069d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:04.996 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.990+0000 7f718b400640 1 --2- 172.21.15.78:0/567268989 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7164067860 0x7f7164069d70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f71700af000 tx=0x7f71700a7000 comp rx=0 tx=0).stop 2024-05-21T14:43:04.996 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.990+0000 7f718b400640 1 -- 172.21.15.78:0/567268989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71840c7fb0 msgr2=0x7f718414c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:04.997 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.990+0000 7f718b400640 1 --2- 172.21.15.78:0/567268989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71840c7fb0 0x7f718414c880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f717400e870 tx=0x7f717400ec70 comp rx=0 tx=0).stop 2024-05-21T14:43:04.997 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.990+0000 7f718b400640 1 -- 172.21.15.78:0/567268989 shutdown_connections 2024-05-21T14:43:04.997 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.990+0000 7f718b400640 1 --2- 172.21.15.78:0/567268989 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7164067860 0x7f7164069d70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:04.997 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.990+0000 7f718b400640 1 --2- 172.21.15.78:0/567268989 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7184158d10 0x7f71841548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:04.997 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.990+0000 7f718b400640 1 --2- 172.21.15.78:0/567268989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7184158900 0x7f71840c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:04.997 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.990+0000 7f718b400640 1 --2- 172.21.15.78:0/567268989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71840c7fb0 0x7f718414c880 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:04.997 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.990+0000 7f718b400640 1 -- 172.21.15.78:0/567268989 >> 172.21.15.78:0/567268989 conn(0x7f718406b620 msgr2=0x7f718406ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:04.997 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.990+0000 7f718b400640 1 -- 172.21.15.78:0/567268989 shutdown_connections 2024-05-21T14:43:04.997 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:04.990+0000 7f718b400640 1 -- 172.21.15.78:0/567268989 wait complete. 2024-05-21T14:43:05.014 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-05-21T14:43:11.820 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-21T14:43:11.964 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.957+0000 7f5e8e200640 1 Processor -- start 2024-05-21T14:43:11.964 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.957+0000 7f5e8e200640 1 -- start start 2024-05-21T14:43:11.966 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.957+0000 7f5e8e200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5e8806d550 0x7f5e880c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:11.966 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.957+0000 7f5e8e200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5e8815ba40 0x7f5e88155970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:11.966 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.957+0000 7f5e8e200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e8806d960 con 0x7f5e8815be50 2024-05-21T14:43:11.966 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.957+0000 7f5e8e200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f5e8815c990 con 0x7f5e8815ba40 2024-05-21T14:43:11.966 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.957+0000 7f5e8e200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f5e8806d0c0 con 0x7f5e8806d550 2024-05-21T14:43:11.966 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.957+0000 7f5e7fe00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5e8815ba40 0x7f5e88155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:11.966 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.957+0000 7f5e7fe00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5e8815ba40 0x7f5e88155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59912/0 (socket says 172.21.15.78:59912) 2024-05-21T14:43:11.966 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.957+0000 7f5e7fe00640 1 -- 172.21.15.78:0/1531830626 learned_addr learned my addr 172.21.15.78:0/1531830626 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:11.966 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.957+0000 7f5e8ce00640 1 --2- 172.21.15.78:0/1531830626 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5e8806d550 0x7f5e880c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:11.967 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.957+0000 7f5e7fe00640 1 -- 172.21.15.78:0/1531830626 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5e8806d550 msgr2=0x7f5e880c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:11.967 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.957+0000 7f5e7fe00640 1 --2- 172.21.15.78:0/1531830626 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5e8806d550 0x7f5e880c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:11.967 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.957+0000 7f5e7fe00640 1 -- 172.21.15.78:0/1531830626 >> v1:172.21.15.84:6789/0 conn(0x7f5e8815be50 legacy=0x7f5e880cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:11.967 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.957+0000 7f5e7fe00640 1 -- 172.21.15.78:0/1531830626 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e8815c3d0 con 0x7f5e8815ba40 2024-05-21T14:43:11.969 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.961+0000 7f5e7fe00640 1 --2- 172.21.15.78:0/1531830626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e8815ba40 0x7f5e88155970 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e8815cb10 tx=0x7f5e7001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9710749c166fef97 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:11.969 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.961+0000 7f5e87e00640 1 -- 172.21.15.78:0/1531830626 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e700b0070 con 0x7f5e8815ba40 2024-05-21T14:43:11.969 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.961+0000 7f5e87e00640 1 -- 172.21.15.78:0/1531830626 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e700ab600 con 0x7f5e8815ba40 2024-05-21T14:43:11.969 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.961+0000 7f5e87e00640 1 -- 172.21.15.78:0/1531830626 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e700ab9d0 con 0x7f5e8815ba40 2024-05-21T14:43:11.970 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.961+0000 7f5e8e200640 1 -- 172.21.15.78:0/1531830626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e8815ba40 msgr2=0x7f5e88155970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:11.970 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.961+0000 7f5e8e200640 1 --2- 172.21.15.78:0/1531830626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e8815ba40 0x7f5e88155970 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e8815cb10 tx=0x7f5e7001c540 comp rx=0 tx=0).stop 2024-05-21T14:43:11.970 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.961+0000 7f5e8e200640 1 -- 172.21.15.78:0/1531830626 shutdown_connections 2024-05-21T14:43:11.970 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.961+0000 7f5e8e200640 1 --2- 172.21.15.78:0/1531830626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e8815ba40 0x7f5e88155970 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:11.970 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.961+0000 7f5e8e200640 1 --2- 172.21.15.78:0/1531830626 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5e8806d550 0x7f5e880c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:11.970 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.961+0000 7f5e8e200640 1 -- 172.21.15.78:0/1531830626 >> 172.21.15.78:0/1531830626 conn(0x7f5e880713c0 msgr2=0x7f5e880717d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:11.970 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.961+0000 7f5e8e200640 1 -- 172.21.15.78:0/1531830626 shutdown_connections 2024-05-21T14:43:11.971 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.961+0000 7f5e8e200640 1 -- 172.21.15.78:0/1531830626 wait complete. 2024-05-21T14:43:11.972 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e8e200640 1 Processor -- start 2024-05-21T14:43:11.972 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e8e200640 1 -- start start 2024-05-21T14:43:11.974 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e8e200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e8806d550 0x7f5e88151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:11.974 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e8e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e8815ba40 0x7f5e881f8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:11.974 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e8e200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5e8815be50 0x7f5e8815ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:11.974 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e8e200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5e880cc020 con 0x7f5e8806d550 2024-05-21T14:43:11.974 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e8e200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5e88074410 con 0x7f5e8815ba40 2024-05-21T14:43:11.974 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e8e200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f5e880cc1a0 con 0x7f5e8815be50 2024-05-21T14:43:11.974 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e8ce00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e8806d550 0x7f5e88151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:11.975 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e8ce00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e8806d550 0x7f5e88151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59928/0 (socket says 172.21.15.78:59928) 2024-05-21T14:43:11.975 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e8ce00640 1 -- 172.21.15.78:0/2567829527 learned_addr learned my addr 172.21.15.78:0/2567829527 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:11.975 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e7fe00640 1 --2- 172.21.15.78:0/2567829527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e8815ba40 0x7f5e881f8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:11.975 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e8d800640 1 --2- 172.21.15.78:0/2567829527 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5e8815be50 0x7f5e8815ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:11.976 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e8ce00640 1 -- 172.21.15.78:0/2567829527 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5e8815be50 msgr2=0x7f5e8815ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:11.976 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e8ce00640 1 --2- 172.21.15.78:0/2567829527 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5e8815be50 0x7f5e8815ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:11.976 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e8ce00640 1 -- 172.21.15.78:0/2567829527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e8815ba40 msgr2=0x7f5e881f8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:11.976 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e8ce00640 1 --2- 172.21.15.78:0/2567829527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e8815ba40 0x7f5e881f8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:11.976 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e8ce00640 1 -- 172.21.15.78:0/2567829527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e881f8760 con 0x7f5e8806d550 2024-05-21T14:43:11.976 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.965+0000 7f5e7fe00640 1 --2- 172.21.15.78:0/2567829527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e8815ba40 0x7f5e881f8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:11.976 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.969+0000 7f5e8ce00640 1 --2- 172.21.15.78:0/2567829527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e8806d550 0x7f5e88151ca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800d5f0 tx=0x7f5e7800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:11.976 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.969+0000 7f5e85600640 1 -- 172.21.15.78:0/2567829527 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e780125f0 con 0x7f5e8806d550 2024-05-21T14:43:11.977 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.969+0000 7f5e85600640 1 -- 172.21.15.78:0/2567829527 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e78019070 con 0x7f5e8806d550 2024-05-21T14:43:11.977 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.969+0000 7f5e8e200640 1 -- 172.21.15.78:0/2567829527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e880cecb0 con 0x7f5e8806d550 2024-05-21T14:43:11.977 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.969+0000 7f5e85600640 1 -- 172.21.15.78:0/2567829527 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e780129d0 con 0x7f5e8806d550 2024-05-21T14:43:11.977 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.969+0000 7f5e8e200640 1 -- 172.21.15.78:0/2567829527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e88150af0 con 0x7f5e8806d550 2024-05-21T14:43:11.977 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.969+0000 7f5e8e200640 1 -- 172.21.15.78:0/2567829527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e8804fc50 con 0x7f5e8806d550 2024-05-21T14:43:11.977 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.969+0000 7f5e85600640 1 -- 172.21.15.78:0/2567829527 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5e78012b70 con 0x7f5e8806d550 2024-05-21T14:43:11.978 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.969+0000 7f5e85600640 1 --2- 172.21.15.78:0/2567829527 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f5e640678c0 0x7f5e64069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:11.978 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.969+0000 7f5e85600640 1 -- 172.21.15.78:0/2567829527 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f5e78085e20 con 0x7f5e8806d550 2024-05-21T14:43:11.978 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.969+0000 7f5e7fe00640 1 --2- 172.21.15.78:0/2567829527 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f5e640678c0 0x7f5e64069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:11.979 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.973+0000 7f5e7fe00640 1 --2- 172.21.15.78:0/2567829527 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f5e640678c0 0x7f5e64069dd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5e880b4c30 tx=0x7f5e70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:11.983 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:11.977+0000 7f5e85600640 1 -- 172.21.15.78:0/2567829527 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f5e78056ca0 con 0x7f5e8806d550 2024-05-21T14:43:12.140 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:12.133+0000 7f5e8e200640 1 -- 172.21.15.78:0/2567829527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5e88068f60 con 0x7f5e8806d550 2024-05-21T14:43:12.141 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:12.133+0000 7f5e85600640 1 -- 172.21.15.78:0/2567829527 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12812 (secure 0 0 0) 0x7f5e780565a0 con 0x7f5e8806d550 2024-05-21T14:43:12.141 INFO:teuthology.misc.health.smithi078.stdout: 2024-05-21T14:43:12.142 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":19,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:09.070844+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:43:12.143 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:12.137+0000 7f5e8e200640 1 -- 172.21.15.78:0/2567829527 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f5e640678c0 msgr2=0x7f5e64069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:12.143 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:12.137+0000 7f5e8e200640 1 --2- 172.21.15.78:0/2567829527 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f5e640678c0 0x7f5e64069dd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5e880b4c30 tx=0x7f5e70008040 comp rx=0 tx=0).stop 2024-05-21T14:43:12.144 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:12.137+0000 7f5e8e200640 1 -- 172.21.15.78:0/2567829527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e8806d550 msgr2=0x7f5e88151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:12.144 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:12.137+0000 7f5e8e200640 1 --2- 172.21.15.78:0/2567829527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e8806d550 0x7f5e88151ca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800d5f0 tx=0x7f5e7800dab0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.144 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:12.137+0000 7f5e8e200640 1 -- 172.21.15.78:0/2567829527 shutdown_connections 2024-05-21T14:43:12.144 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:12.137+0000 7f5e8e200640 1 --2- 172.21.15.78:0/2567829527 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f5e640678c0 0x7f5e64069dd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.144 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:12.137+0000 7f5e8e200640 1 --2- 172.21.15.78:0/2567829527 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5e8815be50 0x7f5e8815ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.144 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:12.137+0000 7f5e8e200640 1 --2- 172.21.15.78:0/2567829527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e8815ba40 0x7f5e881f8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.144 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:12.137+0000 7f5e8e200640 1 --2- 172.21.15.78:0/2567829527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e8806d550 0x7f5e88151ca0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.144 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:12.137+0000 7f5e8e200640 1 -- 172.21.15.78:0/2567829527 >> 172.21.15.78:0/2567829527 conn(0x7f5e880713c0 msgr2=0x7f5e8814e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:12.144 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:12.137+0000 7f5e8e200640 1 -- 172.21.15.78:0/2567829527 shutdown_connections 2024-05-21T14:43:12.144 INFO:teuthology.misc.health.smithi078.stderr:2024-05-21T14:43:12.137+0000 7f5e8e200640 1 -- 172.21.15.78:0/2567829527 wait complete. 2024-05-21T14:43:12.161 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-21T14:43:12.161 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-21T14:43:12.161 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-21T14:43:12.162 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-21T14:43:12.165 INFO:tasks.ceph.mds.a:Started 2024-05-21T14:43:12.165 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-21T14:43:12.165 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-21T14:43:12.168 INFO:tasks.ceph.mds.c:Started 2024-05-21T14:43:12.168 INFO:tasks.ceph.mds.e:Restarting daemon 2024-05-21T14:43:12.168 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-05-21T14:43:12.171 INFO:tasks.ceph.mds.e:Started 2024-05-21T14:43:12.171 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-21T14:43:12.171 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-21T14:43:12.174 INFO:tasks.ceph.mds.b:Started 2024-05-21T14:43:12.174 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-21T14:43:12.174 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-21T14:43:12.177 INFO:tasks.ceph.mds.d:Started 2024-05-21T14:43:12.177 INFO:tasks.ceph.mds.f:Restarting daemon 2024-05-21T14:43:12.177 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-05-21T14:43:12.179 INFO:tasks.ceph.mds.f:Started 2024-05-21T14:43:12.179 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-21T14:43:12.180 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:43:12.288 INFO:tasks.ceph.mds.f.smithi084.stdout:starting mds.f at 2024-05-21T14:43:12.289 INFO:tasks.ceph.mds.b.smithi084.stdout:starting mds.b at 2024-05-21T14:43:12.289 INFO:tasks.ceph.mds.d.smithi084.stdout:starting mds.d at 2024-05-21T14:43:12.295 INFO:tasks.ceph.mds.e.smithi078.stdout:starting mds.e at 2024-05-21T14:43:12.318 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2024-05-21T14:43:12.318 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-05-21T14:43:12.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.333+0000 7ff6b0c00640 1 Processor -- start 2024-05-21T14:43:12.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.333+0000 7ff6b0c00640 1 -- start start 2024-05-21T14:43:12.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.337+0000 7ff6b0c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff6ac070d70 0x7ff6ac06cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:12.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.337+0000 7ff6b0c00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6ac0c9550 con 0x7ff6ac155cb0 2024-05-21T14:43:12.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.337+0000 7ff6b0c00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6ac0c9810 con 0x7ff6ac071180 2024-05-21T14:43:12.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.337+0000 7ff6b0c00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7ff6ac15c440 con 0x7ff6ac070d70 2024-05-21T14:43:12.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.337+0000 7ff6a9e00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff6ac155cb0 0x7ff6ac06e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60108/0 (socket says 172.21.15.78:60108) 2024-05-21T14:43:12.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.337+0000 7ff6a9e00640 1 -- 172.21.15.78:0/580678683 learned_addr learned my addr 172.21.15.78:0/580678683 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:12.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.337+0000 7ff6a3e00640 1 --2- 172.21.15.78:0/580678683 >> v2:172.21.15.84:3300/0 conn(0x7ff6ac070d70 0x7ff6ac06cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:12.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.337+0000 7ff6a9400640 1 -- 172.21.15.78:0/580678683 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2344548071 0 0) 0x7ff6ac0c9550 con 0x7ff6ac155cb0 2024-05-21T14:43:12.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.337+0000 7ff6a9400640 1 -- 172.21.15.78:0/580678683 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff690003530 con 0x7ff6ac155cb0 2024-05-21T14:43:12.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.337+0000 7ff6a3e00640 1 -- 172.21.15.78:0/580678683 >> v1:172.21.15.84:6789/0 conn(0x7ff6ac071180 legacy=0x7ff6ac166340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:12.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.337+0000 7ff6a3e00640 1 -- 172.21.15.78:0/580678683 >> v1:172.21.15.78:6789/0 conn(0x7ff6ac155cb0 legacy=0x7ff6ac06e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:12.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.337+0000 7ff6a3e00640 1 -- 172.21.15.78:0/580678683 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ac0c9af0 con 0x7ff6ac070d70 2024-05-21T14:43:12.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.341+0000 7ff6a3e00640 1 --2- 172.21.15.78:0/580678683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6ac070d70 0x7ff6ac06cf10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac15c5c0 tx=0x7ff69401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=794df94bf71db8a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:12.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.341+0000 7ff6a9400640 1 -- 172.21.15.78:0/580678683 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6940b2070 con 0x7ff6ac070d70 2024-05-21T14:43:12.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.341+0000 7ff6a9400640 1 -- 172.21.15.78:0/580678683 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6940ad680 con 0x7ff6ac070d70 2024-05-21T14:43:12.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.341+0000 7ff6a9400640 1 -- 172.21.15.78:0/580678683 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6940ada50 con 0x7ff6ac070d70 2024-05-21T14:43:12.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.341+0000 7ff6b0c00640 1 -- 172.21.15.78:0/580678683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6ac070d70 msgr2=0x7ff6ac06cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:12.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.341+0000 7ff6b0c00640 1 --2- 172.21.15.78:0/580678683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6ac070d70 0x7ff6ac06cf10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac15c5c0 tx=0x7ff69401c470 comp rx=0 tx=0).stop 2024-05-21T14:43:12.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.341+0000 7ff6b0c00640 1 -- 172.21.15.78:0/580678683 shutdown_connections 2024-05-21T14:43:12.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.341+0000 7ff6b0c00640 1 --2- 172.21.15.78:0/580678683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6ac070d70 0x7ff6ac06cf10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.341+0000 7ff6b0c00640 1 -- 172.21.15.78:0/580678683 >> 172.21.15.78:0/580678683 conn(0x7ff6ac0752c0 msgr2=0x7ff6ac0ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:12.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.341+0000 7ff6b0c00640 1 -- 172.21.15.78:0/580678683 shutdown_connections 2024-05-21T14:43:12.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.341+0000 7ff6b0c00640 1 -- 172.21.15.78:0/580678683 wait complete. 2024-05-21T14:43:12.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6b0c00640 1 Processor -- start 2024-05-21T14:43:12.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6b0c00640 1 -- start start 2024-05-21T14:43:12.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6b0c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6ac070d70 0x7ff6ac0ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:12.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6b0c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff6ac071180 0x7ff6ac1402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:12.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6b0c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6ac155cb0 0x7ff6ac1407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:12.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6b0c00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac15c8d0 con 0x7ff6ac155cb0 2024-05-21T14:43:12.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6b0c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac06de70 con 0x7ff6ac070d70 2024-05-21T14:43:12.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6b0c00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff6ac15ca50 con 0x7ff6ac071180 2024-05-21T14:43:12.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6aa800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6ac155cb0 0x7ff6ac1407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:12.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6a9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6ac070d70 0x7ff6ac0ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:12.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6aa800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6ac155cb0 0x7ff6ac1407e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59966/0 (socket says 172.21.15.78:59966) 2024-05-21T14:43:12.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6aa800640 1 -- 172.21.15.78:0/103818004 learned_addr learned my addr 172.21.15.78:0/103818004 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:12.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6a3e00640 1 --2- 172.21.15.78:0/103818004 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff6ac071180 0x7ff6ac1402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:12.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6aa800640 1 -- 172.21.15.78:0/103818004 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff6ac071180 msgr2=0x7ff6ac1402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:12.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6aa800640 1 --2- 172.21.15.78:0/103818004 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff6ac071180 0x7ff6ac1402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6aa800640 1 -- 172.21.15.78:0/103818004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6ac070d70 msgr2=0x7ff6ac0ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:12.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6aa800640 1 --2- 172.21.15.78:0/103818004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6ac070d70 0x7ff6ac0ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6aa800640 1 -- 172.21.15.78:0/103818004 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ac15edf0 con 0x7ff6ac155cb0 2024-05-21T14:43:12.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6aa800640 1 --2- 172.21.15.78:0/103818004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6ac155cb0 0x7ff6ac1407e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400c730 tx=0x7ff6a400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:12.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6a2000640 1 -- 172.21.15.78:0/103818004 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4003b80 con 0x7ff6ac155cb0 2024-05-21T14:43:12.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6a2000640 1 -- 172.21.15.78:0/103818004 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6a4003d20 con 0x7ff6ac155cb0 2024-05-21T14:43:12.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6b0c00640 1 -- 172.21.15.78:0/103818004 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ac0cd000 con 0x7ff6ac155cb0 2024-05-21T14:43:12.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6a2000640 1 -- 172.21.15.78:0/103818004 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4005310 con 0x7ff6ac155cb0 2024-05-21T14:43:12.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.345+0000 7ff6b0c00640 1 -- 172.21.15.78:0/103818004 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ac0cd5c0 con 0x7ff6ac155cb0 2024-05-21T14:43:12.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.349+0000 7ff6b0c00640 1 -- 172.21.15.78:0/103818004 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ac04f730 con 0x7ff6ac155cb0 2024-05-21T14:43:12.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.349+0000 7ff6a2000640 1 -- 172.21.15.78:0/103818004 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff6a40056c0 con 0x7ff6ac155cb0 2024-05-21T14:43:12.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.349+0000 7ff6a2000640 1 --2- 172.21.15.78:0/103818004 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff6880678c0 0x7ff688069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:12.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.349+0000 7ff6a2000640 1 -- 172.21.15.78:0/103818004 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7ff6a4085910 con 0x7ff6ac155cb0 2024-05-21T14:43:12.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.349+0000 7ff6a9e00640 1 --2- 172.21.15.78:0/103818004 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff6880678c0 0x7ff688069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:12.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.349+0000 7ff6a9e00640 1 --2- 172.21.15.78:0/103818004 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff6880678c0 0x7ff688069dd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0011f0 tx=0x7ff69c007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:12.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.353+0000 7ff6a2000640 1 -- 172.21.15.78:0/103818004 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7ff6ac15edf0 con 0x7ff6ac155cb0 2024-05-21T14:43:12.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.513+0000 7ff6b0c00640 1 -- 172.21.15.78:0/103818004 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6ac0caf80 con 0x7ff6ac155cb0 2024-05-21T14:43:12.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.513+0000 7ff6a2000640 1 -- 172.21.15.78:0/103818004 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12812 (secure 0 0 0) 0x7ff6a40560b0 con 0x7ff6ac155cb0 2024-05-21T14:43:12.521 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:12.522 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:09.070844+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:43:12.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.517+0000 7ff6b0c00640 1 -- 172.21.15.78:0/103818004 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff6880678c0 msgr2=0x7ff688069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:12.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.517+0000 7ff6b0c00640 1 --2- 172.21.15.78:0/103818004 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff6880678c0 0x7ff688069dd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0011f0 tx=0x7ff69c007d40 comp rx=0 tx=0).stop 2024-05-21T14:43:12.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.517+0000 7ff6b0c00640 1 -- 172.21.15.78:0/103818004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6ac155cb0 msgr2=0x7ff6ac1407e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:12.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.517+0000 7ff6b0c00640 1 --2- 172.21.15.78:0/103818004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6ac155cb0 0x7ff6ac1407e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400c730 tx=0x7ff6a400cbf0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.517+0000 7ff6b0c00640 1 -- 172.21.15.78:0/103818004 shutdown_connections 2024-05-21T14:43:12.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.517+0000 7ff6b0c00640 1 --2- 172.21.15.78:0/103818004 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff6880678c0 0x7ff688069dd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.517+0000 7ff6b0c00640 1 --2- 172.21.15.78:0/103818004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6ac155cb0 0x7ff6ac1407e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.517+0000 7ff6b0c00640 1 --2- 172.21.15.78:0/103818004 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff6ac071180 0x7ff6ac1402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.517+0000 7ff6b0c00640 1 --2- 172.21.15.78:0/103818004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6ac070d70 0x7ff6ac0ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.517+0000 7ff6b0c00640 1 -- 172.21.15.78:0/103818004 >> 172.21.15.78:0/103818004 conn(0x7ff6ac0752c0 msgr2=0x7ff6ac14a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:12.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.517+0000 7ff6b0c00640 1 -- 172.21.15.78:0/103818004 shutdown_connections 2024-05-21T14:43:12.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.517+0000 7ff6b0c00640 1 -- 172.21.15.78:0/103818004 wait complete. 2024-05-21T14:43:12.543 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-21T14:43:06.569415+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-21T14:43:12.543 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-21T14:43:12.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8acc800640 1 Processor -- start 2024-05-21T14:43:12.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8acc800640 1 -- start start 2024-05-21T14:43:12.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8acc800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ac40c5c30 0x7f8ac41538d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:12.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8acc800640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac40c7240 con 0x7f8ac40c7f90 2024-05-21T14:43:12.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8acc800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac40c74e0 con 0x7f8ac40c6540 2024-05-21T14:43:12.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8acc800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac4153e10 con 0x7f8ac40c5c30 2024-05-21T14:43:12.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac9400640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8ac40c7f90 0x7f8ac415cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60124/0 (socket says 172.21.15.78:60124) 2024-05-21T14:43:12.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac9400640 1 -- 172.21.15.78:0/3347129747 learned_addr learned my addr 172.21.15.78:0/3347129747 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:12.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac9e00640 1 --2- 172.21.15.78:0/3347129747 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ac40c5c30 0x7f8ac41538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:12.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac8a00640 1 -- 172.21.15.78:0/3347129747 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1435889492 0 0) 0x7f8ac40c7240 con 0x7f8ac40c7f90 2024-05-21T14:43:12.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac8a00640 1 -- 172.21.15.78:0/3347129747 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8aac003530 con 0x7f8ac40c7f90 2024-05-21T14:43:12.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac8a00640 1 -- 172.21.15.78:0/3347129747 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1795522908 0 0) 0x7f8aac003530 con 0x7f8ac40c7f90 2024-05-21T14:43:12.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac8a00640 1 -- 172.21.15.78:0/3347129747 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ac40c5c30 msgr2=0x7f8ac41538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:12.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac8a00640 1 --2- 172.21.15.78:0/3347129747 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ac40c5c30 0x7f8ac41538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac8a00640 1 -- 172.21.15.78:0/3347129747 >> v1:172.21.15.84:6789/0 conn(0x7f8ac40c6540 legacy=0x7f8ac40735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:12.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac8a00640 1 -- 172.21.15.78:0/3347129747 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac40c77c0 con 0x7f8ac40c7f90 2024-05-21T14:43:12.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac8a00640 1 -- 172.21.15.78:0/3347129747 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7f8ab40016a0 con 0x7f8ac40c7f90 2024-05-21T14:43:12.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac8a00640 1 -- 172.21.15.78:0/3347129747 >> v1:172.21.15.78:6789/0 conn(0x7f8ac40c7f90 legacy=0x7f8ac415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:12.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac8a00640 1 --2- 172.21.15.78:0/3347129747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac003a60 0x7f8aac003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:12.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac8a00640 1 --2- 172.21.15.78:0/3347129747 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ac40c5c30 0x7f8aac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:12.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac8a00640 1 --2- 172.21.15.78:0/3347129747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8aac004d50 0x7f8aac005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac8a00640 1 -- 172.21.15.78:0/3347129747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac4153e10 con 0x7f8aac004d50 2024-05-21T14:43:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac8a00640 1 -- 172.21.15.78:0/3347129747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac00bad0 con 0x7f8aac003a60 2024-05-21T14:43:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac8a00640 1 -- 172.21.15.78:0/3347129747 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac00bcd0 con 0x7f8ac40c5c30 2024-05-21T14:43:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8aca800640 1 --2- 172.21.15.78:0/3347129747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8aac004d50 0x7f8aac005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac9e00640 1 --2- 172.21.15.78:0/3347129747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac003a60 0x7f8aac003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.685+0000 7f8ac9400640 1 --2- 172.21.15.78:0/3347129747 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ac40c5c30 0x7f8aac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.689+0000 7f8aca800640 1 -- 172.21.15.78:0/3347129747 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ac40c5c30 msgr2=0x7f8aac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.689+0000 7f8aca800640 1 --2- 172.21.15.78:0/3347129747 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ac40c5c30 0x7f8aac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.689+0000 7f8aca800640 1 -- 172.21.15.78:0/3347129747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac003a60 msgr2=0x7f8aac003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.689+0000 7f8aca800640 1 --2- 172.21.15.78:0/3347129747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac003a60 0x7f8aac003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.689+0000 7f8aca800640 1 -- 172.21.15.78:0/3347129747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac003530 con 0x7f8aac004d50 2024-05-21T14:43:12.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.689+0000 7f8aca800640 1 --2- 172.21.15.78:0/3347129747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8aac004d50 0x7f8aac005160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40705e0 tx=0x7f8ac001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cdb7df5e909633 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:12.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.689+0000 7f8ac8a00640 1 -- 172.21.15.78:0/3347129747 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00b1070 con 0x7f8aac004d50 2024-05-21T14:43:12.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.689+0000 7f8ac8a00640 1 -- 172.21.15.78:0/3347129747 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ac00a4a80 con 0x7f8aac004d50 2024-05-21T14:43:12.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.689+0000 7f8ac8a00640 1 -- 172.21.15.78:0/3347129747 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0001b60 con 0x7f8aac004d50 2024-05-21T14:43:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.689+0000 7f8acc800640 1 -- 172.21.15.78:0/3347129747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8aac004d50 msgr2=0x7f8aac005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.689+0000 7f8acc800640 1 --2- 172.21.15.78:0/3347129747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8aac004d50 0x7f8aac005160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40705e0 tx=0x7f8ac001c540 comp rx=0 tx=0).stop 2024-05-21T14:43:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.689+0000 7f8aca800640 1 -- 172.21.15.78:0/3347129747 reap_dead start 2024-05-21T14:43:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.689+0000 7f8acc800640 1 -- 172.21.15.78:0/3347129747 shutdown_connections 2024-05-21T14:43:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.689+0000 7f8acc800640 1 -- 172.21.15.78:0/3347129747 >> 172.21.15.78:0/3347129747 conn(0x7f8ac40cd1e0 msgr2=0x7f8ac40c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.689+0000 7f8acc800640 1 -- 172.21.15.78:0/3347129747 shutdown_connections 2024-05-21T14:43:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.689+0000 7f8acc800640 1 -- 172.21.15.78:0/3347129747 wait complete. 2024-05-21T14:43:12.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.693+0000 7f8acc800640 1 Processor -- start 2024-05-21T14:43:12.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.693+0000 7f8acc800640 1 -- start start 2024-05-21T14:43:12.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.693+0000 7f8acc800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac004d50 0x7f8ac40725d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:12.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.693+0000 7f8acc800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ac414b110 0x7f8ac414b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:12.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.693+0000 7f8acc800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ac41590c0 0x7f8ac41594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:12.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.693+0000 7f8acc800640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac415dff0 con 0x7f8ac41590c0 2024-05-21T14:43:12.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.693+0000 7f8acc800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac40c4370 con 0x7f8aac004d50 2024-05-21T14:43:12.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.693+0000 7f8acc800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac415e170 con 0x7f8ac414b110 2024-05-21T14:43:12.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.693+0000 7f8aca800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ac41590c0 0x7f8ac41594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:12.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.693+0000 7f8aca800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ac41590c0 0x7f8ac41594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59988/0 (socket says 172.21.15.78:59988) 2024-05-21T14:43:12.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.693+0000 7f8aca800640 1 -- 172.21.15.78:0/1522229380 learned_addr learned my addr 172.21.15.78:0/1522229380 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:12.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.693+0000 7f8ac9e00640 1 --2- 172.21.15.78:0/1522229380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac004d50 0x7f8ac40725d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:12.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.697+0000 7f8ac9400640 1 --2- 172.21.15.78:0/1522229380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ac414b110 0x7f8ac414b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:12.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.697+0000 7f8aca800640 1 -- 172.21.15.78:0/1522229380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ac414b110 msgr2=0x7f8ac414b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:12.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.697+0000 7f8aca800640 1 --2- 172.21.15.78:0/1522229380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ac414b110 0x7f8ac414b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.697+0000 7f8aca800640 1 -- 172.21.15.78:0/1522229380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac004d50 msgr2=0x7f8ac40725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:12.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.697+0000 7f8aca800640 1 --2- 172.21.15.78:0/1522229380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac004d50 0x7f8ac40725d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.697+0000 7f8aca800640 1 -- 172.21.15.78:0/1522229380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac4072b10 con 0x7f8ac41590c0 2024-05-21T14:43:12.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.697+0000 7f8ac9400640 1 --2- 172.21.15.78:0/1522229380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ac414b110 0x7f8ac414b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:12.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.697+0000 7f8aca800640 1 --2- 172.21.15.78:0/1522229380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ac41590c0 0x7f8ac41594d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ac001ca20 tx=0x7f8aac005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:12.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.697+0000 7f8abe000640 1 -- 172.21.15.78:0/1522229380 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00bc070 con 0x7f8ac41590c0 2024-05-21T14:43:12.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.697+0000 7f8abe000640 1 -- 172.21.15.78:0/1522229380 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ac00a4e50 con 0x7f8ac41590c0 2024-05-21T14:43:12.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.697+0000 7f8acc800640 1 -- 172.21.15.78:0/1522229380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac4071550 con 0x7f8ac41590c0 2024-05-21T14:43:12.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.697+0000 7f8abe000640 1 -- 172.21.15.78:0/1522229380 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00b1040 con 0x7f8ac41590c0 2024-05-21T14:43:12.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.697+0000 7f8acc800640 1 -- 172.21.15.78:0/1522229380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac4071af0 con 0x7f8ac41590c0 2024-05-21T14:43:12.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.697+0000 7f8acc800640 1 -- 172.21.15.78:0/1522229380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac40c7b40 con 0x7f8ac41590c0 2024-05-21T14:43:12.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.697+0000 7f8abe000640 1 -- 172.21.15.78:0/1522229380 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8ac00b4070 con 0x7f8ac41590c0 2024-05-21T14:43:12.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.701+0000 7f8abe000640 1 --2- 172.21.15.78:0/1522229380 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f8aa80678c0 0x7f8aa8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:12.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.701+0000 7f8abe000640 1 -- 172.21.15.78:0/1522229380 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f8ac011df20 con 0x7f8ac41590c0 2024-05-21T14:43:12.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.701+0000 7f8ac9e00640 1 --2- 172.21.15.78:0/1522229380 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f8aa80678c0 0x7f8aa8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:12.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.701+0000 7f8ac9e00640 1 --2- 172.21.15.78:0/1522229380 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f8aa80678c0 0x7f8aa8069dd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009be0 tx=0x7f8ab8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:12.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.705+0000 7f8abe000640 1 -- 172.21.15.78:0/1522229380 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f8ac0016570 con 0x7f8ac41590c0 2024-05-21T14:43:12.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.861+0000 7f8acc800640 1 -- 172.21.15.78:0/1522229380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8ac41e3540 con 0x7f8ac41590c0 2024-05-21T14:43:12.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.861+0000 7f8abe000640 1 -- 172.21.15.78:0/1522229380 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7f8ac00ee630 con 0x7f8ac41590c0 2024-05-21T14:43:12.870 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-05-21T14:43:12.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.865+0000 7f8acc800640 1 -- 172.21.15.78:0/1522229380 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f8aa80678c0 msgr2=0x7f8aa8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:12.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.865+0000 7f8acc800640 1 --2- 172.21.15.78:0/1522229380 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f8aa80678c0 0x7f8aa8069dd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009be0 tx=0x7f8ab8009190 comp rx=0 tx=0).stop 2024-05-21T14:43:12.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.865+0000 7f8acc800640 1 -- 172.21.15.78:0/1522229380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ac41590c0 msgr2=0x7f8ac41594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:12.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.865+0000 7f8acc800640 1 --2- 172.21.15.78:0/1522229380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ac41590c0 0x7f8ac41594d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ac001ca20 tx=0x7f8aac005840 comp rx=0 tx=0).stop 2024-05-21T14:43:12.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.865+0000 7f8acc800640 1 -- 172.21.15.78:0/1522229380 shutdown_connections 2024-05-21T14:43:12.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.865+0000 7f8acc800640 1 --2- 172.21.15.78:0/1522229380 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f8aa80678c0 0x7f8aa8069dd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.865+0000 7f8acc800640 1 --2- 172.21.15.78:0/1522229380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ac41590c0 0x7f8ac41594d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.865+0000 7f8acc800640 1 --2- 172.21.15.78:0/1522229380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8ac414b110 0x7f8ac414b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.865+0000 7f8acc800640 1 --2- 172.21.15.78:0/1522229380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8aac004d50 0x7f8ac40725d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:12.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.865+0000 7f8acc800640 1 -- 172.21.15.78:0/1522229380 >> 172.21.15.78:0/1522229380 conn(0x7f8ac40cd1e0 msgr2=0x7f8ac40735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:12.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.865+0000 7f8acc800640 1 -- 172.21.15.78:0/1522229380 shutdown_connections 2024-05-21T14:43:12.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:12.865+0000 7f8acc800640 1 -- 172.21.15.78:0/1522229380 wait complete. 2024-05-21T14:43:12.891 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T14:43:13.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6909c00640 1 Processor -- start 2024-05-21T14:43:13.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6909c00640 1 -- start start 2024-05-21T14:43:13.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6909c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6904071fe0 0x7f69040723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:13.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6909c00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69040715f0 con 0x7f69040c5640 2024-05-21T14:43:13.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6909c00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6904072b80 con 0x7f69041529d0 2024-05-21T14:43:13.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6909c00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f69040c8530 con 0x7f6904071fe0 2024-05-21T14:43:13.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6903400640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f69040c5640 0x7f6904162e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60140/0 (socket says 172.21.15.78:60140) 2024-05-21T14:43:13.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6903400640 1 -- 172.21.15.78:0/3291818587 learned_addr learned my addr 172.21.15.78:0/3291818587 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:13.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f68fa000640 1 --2- 172.21.15.78:0/3291818587 >> v2:172.21.15.84:3300/0 conn(0x7f6904071fe0 0x7f69040723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:13.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902000640 1 -- 172.21.15.78:0/3291818587 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1459168673 0 0) 0x7f69040715f0 con 0x7f69040c5640 2024-05-21T14:43:13.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902000640 1 -- 172.21.15.78:0/3291818587 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68e8003530 con 0x7f69040c5640 2024-05-21T14:43:13.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902000640 1 -- 172.21.15.78:0/3291818587 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1449904083 0 0) 0x7f68e8003530 con 0x7f69040c5640 2024-05-21T14:43:13.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902000640 1 -- 172.21.15.78:0/3291818587 >> v2:172.21.15.84:3300/0 conn(0x7f6904071fe0 msgr2=0x7f69040723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:13.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902000640 1 --2- 172.21.15.78:0/3291818587 >> v2:172.21.15.84:3300/0 conn(0x7f6904071fe0 0x7f69040723f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:13.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902000640 1 -- 172.21.15.78:0/3291818587 >> v1:172.21.15.84:6789/0 conn(0x7f69041529d0 legacy=0x7f6904072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:13.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902000640 1 -- 172.21.15.78:0/3291818587 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69040c8810 con 0x7f69040c5640 2024-05-21T14:43:13.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902000640 1 -- 172.21.15.78:0/3291818587 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7f68fc001680 con 0x7f69040c5640 2024-05-21T14:43:13.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902000640 1 -- 172.21.15.78:0/3291818587 >> v1:172.21.15.78:6789/0 conn(0x7f69040c5640 legacy=0x7f6904162e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:13.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902000640 1 --2- 172.21.15.78:0/3291818587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68e80039c0 0x7f68e8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:13.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902000640 1 --2- 172.21.15.78:0/3291818587 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f68e8004810 0x7f68e8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:13.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902000640 1 --2- 172.21.15.78:0/3291818587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e80051d0 0x7f68e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:13.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902000640 1 -- 172.21.15.78:0/3291818587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f69040c8530 con 0x7f68e80039c0 2024-05-21T14:43:13.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902000640 1 -- 172.21.15.78:0/3291818587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f68e800c170 con 0x7f68e80051d0 2024-05-21T14:43:13.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902000640 1 -- 172.21.15.78:0/3291818587 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f68e800c370 con 0x7f68e8004810 2024-05-21T14:43:13.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902a00640 1 --2- 172.21.15.78:0/3291818587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68e80039c0 0x7f68e8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:13.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f68fa000640 1 --2- 172.21.15.78:0/3291818587 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f68e8004810 0x7f68e8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:13.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6903400640 1 --2- 172.21.15.78:0/3291818587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e80051d0 0x7f68e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:13.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902a00640 1 -- 172.21.15.78:0/3291818587 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f68e8004810 msgr2=0x7f68e8004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:13.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.033+0000 7f6902a00640 1 --2- 172.21.15.78:0/3291818587 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f68e8004810 0x7f68e8004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:13.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.037+0000 7f6902a00640 1 -- 172.21.15.78:0/3291818587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e80051d0 msgr2=0x7f68e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:13.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.037+0000 7f6902a00640 1 --2- 172.21.15.78:0/3291818587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e80051d0 0x7f68e800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:13.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.037+0000 7f6902a00640 1 -- 172.21.15.78:0/3291818587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e8003530 con 0x7f68e80039c0 2024-05-21T14:43:13.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.037+0000 7f6903400640 1 -- 172.21.15.78:0/3291818587 reap_dead start 2024-05-21T14:43:13.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.037+0000 7f6902a00640 1 --2- 172.21.15.78:0/3291818587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68e80039c0 0x7f68e8003e30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f68f4001e70 tx=0x7f68f401c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529d7d9c78cec014 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:13.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.037+0000 7f6902000640 1 -- 172.21.15.78:0/3291818587 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f4001a90 con 0x7f68e80039c0 2024-05-21T14:43:13.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.037+0000 7f6902000640 1 -- 172.21.15.78:0/3291818587 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f40a8050 con 0x7f68e80039c0 2024-05-21T14:43:13.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.037+0000 7f6902000640 1 -- 172.21.15.78:0/3291818587 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f4003dc0 con 0x7f68e80039c0 2024-05-21T14:43:13.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.037+0000 7f6909c00640 1 -- 172.21.15.78:0/3291818587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68e80039c0 msgr2=0x7f68e8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:13.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.037+0000 7f6909c00640 1 --2- 172.21.15.78:0/3291818587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68e80039c0 0x7f68e8003e30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f68f4001e70 tx=0x7f68f401c6c0 comp rx=0 tx=0).stop 2024-05-21T14:43:13.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.037+0000 7f6909c00640 1 -- 172.21.15.78:0/3291818587 shutdown_connections 2024-05-21T14:43:13.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.037+0000 7f6909c00640 1 --2- 172.21.15.78:0/3291818587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68e80039c0 0x7f68e8003e30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:13.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.037+0000 7f6909c00640 1 -- 172.21.15.78:0/3291818587 >> 172.21.15.78:0/3291818587 conn(0x7f69040c9380 msgr2=0x7f69040c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:13.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.037+0000 7f6909c00640 1 -- 172.21.15.78:0/3291818587 shutdown_connections 2024-05-21T14:43:13.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.037+0000 7f6909c00640 1 -- 172.21.15.78:0/3291818587 wait complete. 2024-05-21T14:43:13.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.041+0000 7f6909c00640 1 Processor -- start 2024-05-21T14:43:13.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.041+0000 7f6909c00640 1 -- start start 2024-05-21T14:43:13.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.041+0000 7f6909c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e80039c0 0x7f69041f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:13.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.041+0000 7f6909c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f69041f8f60 0x7f690414bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:13.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.041+0000 7f6909c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6904156450 0x7f690414c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.041+0000 7f6909c00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f69040c3a20 con 0x7f6904156450 2024-05-21T14:43:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.041+0000 7f6909c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f69040c38a0 con 0x7f68e80039c0 2024-05-21T14:43:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.041+0000 7f6909c00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f6904072e40 con 0x7f69041f8f60 2024-05-21T14:43:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.041+0000 7f6903400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6904156450 0x7f690414c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.041+0000 7f6903400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6904156450 0x7f690414c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60000/0 (socket says 172.21.15.78:60000) 2024-05-21T14:43:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.041+0000 7f6903400640 1 -- 172.21.15.78:0/688082003 learned_addr learned my addr 172.21.15.78:0/688082003 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.045+0000 7f6902a00640 1 --2- 172.21.15.78:0/688082003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e80039c0 0x7f69041f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.045+0000 7f68fa000640 1 --2- 172.21.15.78:0/688082003 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f69041f8f60 0x7f690414bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.045+0000 7f6903400640 1 -- 172.21.15.78:0/688082003 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f69041f8f60 msgr2=0x7f690414bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.045+0000 7f6903400640 1 --2- 172.21.15.78:0/688082003 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f69041f8f60 0x7f690414bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.045+0000 7f6903400640 1 -- 172.21.15.78:0/688082003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e80039c0 msgr2=0x7f69041f5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.045+0000 7f6903400640 1 --2- 172.21.15.78:0/688082003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e80039c0 0x7f69041f5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.045+0000 7f6903400640 1 -- 172.21.15.78:0/688082003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6904156b70 con 0x7f6904156450 2024-05-21T14:43:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.045+0000 7f6903400640 1 --2- 172.21.15.78:0/688082003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6904156450 0x7f690414c1a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f690406e9a0 tx=0x7f68fc007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:13.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.045+0000 7f68fb400640 1 -- 172.21.15.78:0/688082003 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc01a070 con 0x7f6904156450 2024-05-21T14:43:13.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.045+0000 7f68fb400640 1 -- 172.21.15.78:0/688082003 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68fc00f6a0 con 0x7f6904156450 2024-05-21T14:43:13.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.045+0000 7f6909c00640 1 -- 172.21.15.78:0/688082003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69041f5ec0 con 0x7f6904156450 2024-05-21T14:43:13.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.045+0000 7f68fb400640 1 -- 172.21.15.78:0/688082003 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc00fa70 con 0x7f6904156450 2024-05-21T14:43:13.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.045+0000 7f6909c00640 1 -- 172.21.15.78:0/688082003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6904152260 con 0x7f6904156450 2024-05-21T14:43:13.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.045+0000 7f6909c00640 1 -- 172.21.15.78:0/688082003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6904156d40 con 0x7f6904156450 2024-05-21T14:43:13.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.045+0000 7f68fb400640 1 -- 172.21.15.78:0/688082003 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f68fc01d070 con 0x7f6904156450 2024-05-21T14:43:13.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.045+0000 7f68fb400640 1 --2- 172.21.15.78:0/688082003 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f68e00678f0 0x7f68e0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:13.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.045+0000 7f68fb400640 1 -- 172.21.15.78:0/688082003 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f68fc084ce0 con 0x7f6904156450 2024-05-21T14:43:13.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.049+0000 7f6902a00640 1 --2- 172.21.15.78:0/688082003 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f68e00678f0 0x7f68e0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:13.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.049+0000 7f6902a00640 1 --2- 172.21.15.78:0/688082003 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f68e00678f0 0x7f68e0069e00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f68f40ad000 tx=0x7f68f4001520 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:13.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.053+0000 7f68fb400640 1 -- 172.21.15.78:0/688082003 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f68fc055480 con 0x7f6904156450 2024-05-21T14:43:13.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.241+0000 7f6909c00640 1 -- 172.21.15.78:0/688082003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f690404f730 con 0x7f6904156450 2024-05-21T14:43:13.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.241+0000 7f68fb400640 1 -- 172.21.15.78:0/688082003 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f68fc059780 con 0x7f6904156450 2024-05-21T14:43:13.248 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:13.248 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6838/1750816366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1750816366},{"type":"v1","addr":"172.21.15.84:6838","nonce":1750816366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-21T14:43:13.248 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 2 2024-05-21T14:43:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.241+0000 7f6909c00640 1 -- 172.21.15.78:0/688082003 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f68e00678f0 msgr2=0x7f68e0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.241+0000 7f6909c00640 1 --2- 172.21.15.78:0/688082003 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f68e00678f0 0x7f68e0069e00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f68f40ad000 tx=0x7f68f4001520 comp rx=0 tx=0).stop 2024-05-21T14:43:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.241+0000 7f6909c00640 1 -- 172.21.15.78:0/688082003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6904156450 msgr2=0x7f690414c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.241+0000 7f6909c00640 1 --2- 172.21.15.78:0/688082003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6904156450 0x7f690414c1a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f690406e9a0 tx=0x7f68fc007430 comp rx=0 tx=0).stop 2024-05-21T14:43:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.241+0000 7f6909c00640 1 -- 172.21.15.78:0/688082003 shutdown_connections 2024-05-21T14:43:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.241+0000 7f6909c00640 1 --2- 172.21.15.78:0/688082003 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f68e00678f0 0x7f68e0069e00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.241+0000 7f6909c00640 1 --2- 172.21.15.78:0/688082003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6904156450 0x7f690414c1a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.241+0000 7f6909c00640 1 --2- 172.21.15.78:0/688082003 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f69041f8f60 0x7f690414bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.241+0000 7f6909c00640 1 --2- 172.21.15.78:0/688082003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68e80039c0 0x7f69041f5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.241+0000 7f6909c00640 1 -- 172.21.15.78:0/688082003 >> 172.21.15.78:0/688082003 conn(0x7f69040c9380 msgr2=0x7f6904150bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.241+0000 7f6909c00640 1 -- 172.21.15.78:0/688082003 shutdown_connections 2024-05-21T14:43:13.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:13.241+0000 7f6909c00640 1 -- 172.21.15.78:0/688082003 wait complete. 2024-05-21T14:43:15.269 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T14:43:15.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.417+0000 7f38ade00640 1 Processor -- start 2024-05-21T14:43:15.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.417+0000 7f38ade00640 1 -- start start 2024-05-21T14:43:15.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.417+0000 7f38ade00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f38a80c87b0 0x7f38a8151de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:15.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.417+0000 7f38ade00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f38a806c2c0 0x7f38a8162670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:15.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.417+0000 7f38ade00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38a8158110 con 0x7f38a806beb0 2024-05-21T14:43:15.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.417+0000 7f38ade00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f38a8158c90 con 0x7f38a806c2c0 2024-05-21T14:43:15.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.417+0000 7f38ade00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f38a81583f0 con 0x7f38a80c87b0 2024-05-21T14:43:15.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.417+0000 7f38a7400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f38a806c2c0 0x7f38a8162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:15.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.417+0000 7f38a6a00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f38a80c87b0 0x7f38a8151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:15.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.417+0000 7f38a7400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f38a806c2c0 0x7f38a8162670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:57074/0 (socket says 172.21.15.78:57074) 2024-05-21T14:43:15.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.417+0000 7f38a7400640 1 -- 172.21.15.78:0/1882497119 learned_addr learned my addr 172.21.15.78:0/1882497119 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:15.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.417+0000 7f38a7400640 1 -- 172.21.15.78:0/1882497119 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f38a80c87b0 msgr2=0x7f38a8151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:15.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.417+0000 7f38a7400640 1 --2- 172.21.15.78:0/1882497119 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f38a80c87b0 0x7f38a8151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.417+0000 7f38a7400640 1 -- 172.21.15.78:0/1882497119 >> v1:172.21.15.84:6789/0 conn(0x7f38a806beb0 legacy=0x7f38a815b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:15.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.417+0000 7f38a7400640 1 -- 172.21.15.78:0/1882497119 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a81586d0 con 0x7f38a806c2c0 2024-05-21T14:43:15.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.421+0000 7f38a7400640 1 --2- 172.21.15.78:0/1882497119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a806c2c0 0x7f38a8162670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f38a000af60 tx=0x7f38a001daa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4a37b9e3f864bbd server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:15.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.421+0000 7f38a6000640 1 -- 172.21.15.78:0/1882497119 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a000a2d0 con 0x7f38a806c2c0 2024-05-21T14:43:15.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.421+0000 7f38a6000640 1 -- 172.21.15.78:0/1882497119 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a00a6700 con 0x7f38a806c2c0 2024-05-21T14:43:15.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.421+0000 7f38a6000640 1 -- 172.21.15.78:0/1882497119 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a00a6ad0 con 0x7f38a806c2c0 2024-05-21T14:43:15.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.421+0000 7f38ade00640 1 -- 172.21.15.78:0/1882497119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a806c2c0 msgr2=0x7f38a8162670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:15.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.421+0000 7f38ade00640 1 --2- 172.21.15.78:0/1882497119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a806c2c0 0x7f38a8162670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f38a000af60 tx=0x7f38a001daa0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.421+0000 7f38ade00640 1 -- 172.21.15.78:0/1882497119 shutdown_connections 2024-05-21T14:43:15.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.421+0000 7f38ade00640 1 --2- 172.21.15.78:0/1882497119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a806c2c0 0x7f38a8162670 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.421+0000 7f38ade00640 1 --2- 172.21.15.78:0/1882497119 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f38a80c87b0 0x7f38a8151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.421+0000 7f38ade00640 1 -- 172.21.15.78:0/1882497119 >> 172.21.15.78:0/1882497119 conn(0x7f38a80c9380 msgr2=0x7f38a80c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:15.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.421+0000 7f38ade00640 1 -- 172.21.15.78:0/1882497119 shutdown_connections 2024-05-21T14:43:15.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.421+0000 7f38ade00640 1 -- 172.21.15.78:0/1882497119 wait complete. 2024-05-21T14:43:15.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f38ade00640 1 Processor -- start 2024-05-21T14:43:15.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f38ade00640 1 -- start start 2024-05-21T14:43:15.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f38ade00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f38a806beb0 0x7f38a8143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:15.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f38ade00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38a806c2c0 0x7f38a813cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:15.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f38ade00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a80c87b0 0x7f38a813d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:15.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f38ade00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f38a8157e70 con 0x7f38a806c2c0 2024-05-21T14:43:15.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f38ade00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f38a8157cf0 con 0x7f38a80c87b0 2024-05-21T14:43:15.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f38ade00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f38a80c8bc0 con 0x7f38a806beb0 2024-05-21T14:43:15.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f389e000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38a806c2c0 0x7f38a813cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:15.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f389e000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38a806c2c0 0x7f38a813cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51524/0 (socket says 172.21.15.78:51524) 2024-05-21T14:43:15.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f389e000640 1 -- 172.21.15.78:0/1860581649 learned_addr learned my addr 172.21.15.78:0/1860581649 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:15.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f38a6a00640 1 --2- 172.21.15.78:0/1860581649 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f38a806beb0 0x7f38a8143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:15.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f38a7400640 1 --2- 172.21.15.78:0/1860581649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a80c87b0 0x7f38a813d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f389e000640 1 -- 172.21.15.78:0/1860581649 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f38a806beb0 msgr2=0x7f38a8143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f389e000640 1 --2- 172.21.15.78:0/1860581649 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f38a806beb0 0x7f38a8143bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f389e000640 1 -- 172.21.15.78:0/1860581649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a80c87b0 msgr2=0x7f38a813d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f389e000640 1 --2- 172.21.15.78:0/1860581649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a80c87b0 0x7f38a813d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.425+0000 7f389e000640 1 -- 172.21.15.78:0/1860581649 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a8155160 con 0x7f38a806c2c0 2024-05-21T14:43:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.429+0000 7f389e000640 1 --2- 172.21.15.78:0/1860581649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38a806c2c0 0x7f38a813cfa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f389000c3a0 tx=0x7f389000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.429+0000 7f389fe00640 1 -- 172.21.15.78:0/1860581649 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38900052d0 con 0x7f38a806c2c0 2024-05-21T14:43:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.429+0000 7f389fe00640 1 -- 172.21.15.78:0/1860581649 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3890005470 con 0x7f38a806c2c0 2024-05-21T14:43:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.429+0000 7f38ade00640 1 -- 172.21.15.78:0/1860581649 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a81556b0 con 0x7f38a806c2c0 2024-05-21T14:43:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.429+0000 7f389fe00640 1 -- 172.21.15.78:0/1860581649 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3890007260 con 0x7f38a806c2c0 2024-05-21T14:43:15.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.429+0000 7f38ade00640 1 -- 172.21.15.78:0/1860581649 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a813da20 con 0x7f38a806c2c0 2024-05-21T14:43:15.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.429+0000 7f38ade00640 1 -- 172.21.15.78:0/1860581649 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38a8143570 con 0x7f38a806c2c0 2024-05-21T14:43:15.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.429+0000 7f389fe00640 1 -- 172.21.15.78:0/1860581649 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3890007400 con 0x7f38a806c2c0 2024-05-21T14:43:15.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.429+0000 7f389fe00640 1 --2- 172.21.15.78:0/1860581649 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f38840678f0 0x7f3884069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:15.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.429+0000 7f389fe00640 1 -- 172.21.15.78:0/1860581649 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f3890084d20 con 0x7f38a806c2c0 2024-05-21T14:43:15.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.429+0000 7f38a6a00640 1 --2- 172.21.15.78:0/1860581649 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f38840678f0 0x7f3884069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:15.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.433+0000 7f38a6a00640 1 --2- 172.21.15.78:0/1860581649 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f38840678f0 0x7f3884069e00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3898009ac0 tx=0x7f3898009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:15.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.433+0000 7f389fe00640 1 -- 172.21.15.78:0/1860581649 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f3890055550 con 0x7f38a806c2c0 2024-05-21T14:43:15.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.625+0000 7f38ade00640 1 -- 172.21.15.78:0/1860581649 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38a804f730 con 0x7f38a806c2c0 2024-05-21T14:43:15.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.625+0000 7f389fe00640 1 -- 172.21.15.78:0/1860581649 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5512 (secure 0 0 0) 0x7f3890059850 con 0x7f38a806c2c0 2024-05-21T14:43:15.632 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:15.632 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1952345794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1952345794},{"type":"v1","addr":"172.21.15.78:6833","nonce":1952345794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3517628193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3517628193},{"type":"v1","addr":"172.21.15.78:6836","nonce":3517628193}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3155872080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3155872080},{"type":"v1","addr":"172.21.15.84:6835","nonce":3155872080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6838/1750816366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1750816366},{"type":"v1","addr":"172.21.15.84:6838","nonce":1750816366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4300,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/4232079477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6837","nonce":4232079477},{"type":"v1","addr":"172.21.15.84:6839","nonce":4232079477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4321,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/1924967428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1924967428},{"type":"v1","addr":"172.21.15.78:6837","nonce":1924967428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-21T14:43:15.632 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 3 2024-05-21T14:43:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.625+0000 7f38ade00640 1 -- 172.21.15.78:0/1860581649 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f38840678f0 msgr2=0x7f3884069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.625+0000 7f38ade00640 1 --2- 172.21.15.78:0/1860581649 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f38840678f0 0x7f3884069e00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3898009ac0 tx=0x7f3898009190 comp rx=0 tx=0).stop 2024-05-21T14:43:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.625+0000 7f38ade00640 1 -- 172.21.15.78:0/1860581649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38a806c2c0 msgr2=0x7f38a813cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.625+0000 7f38ade00640 1 --2- 172.21.15.78:0/1860581649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38a806c2c0 0x7f38a813cfa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f389000c3a0 tx=0x7f389000c860 comp rx=0 tx=0).stop 2024-05-21T14:43:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.625+0000 7f38ade00640 1 -- 172.21.15.78:0/1860581649 shutdown_connections 2024-05-21T14:43:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.625+0000 7f38ade00640 1 --2- 172.21.15.78:0/1860581649 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f38840678f0 0x7f3884069e00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.625+0000 7f38ade00640 1 --2- 172.21.15.78:0/1860581649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a80c87b0 0x7f38a813d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.625+0000 7f38ade00640 1 --2- 172.21.15.78:0/1860581649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38a806c2c0 0x7f38a813cfa0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.625+0000 7f38ade00640 1 --2- 172.21.15.78:0/1860581649 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f38a806beb0 0x7f38a8143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.625+0000 7f38ade00640 1 -- 172.21.15.78:0/1860581649 >> 172.21.15.78:0/1860581649 conn(0x7f38a80c9380 msgr2=0x7f38a8140420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.625+0000 7f38ade00640 1 -- 172.21.15.78:0/1860581649 shutdown_connections 2024-05-21T14:43:15.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.625+0000 7f38ade00640 1 -- 172.21.15.78:0/1860581649 wait complete. 2024-05-21T14:43:15.653 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:43:15.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.789+0000 7fe92f000640 1 Processor -- start 2024-05-21T14:43:15.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.789+0000 7fe92f000640 1 -- start start 2024-05-21T14:43:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.793+0000 7fe92f000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe928071f50 0x7fe92815c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.793+0000 7fe92f000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe928164160 0x7fe928166580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.793+0000 7fe92f000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe928072970 con 0x7fe9280c7ff0 2024-05-21T14:43:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.793+0000 7fe92f000640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fe92815bbd0 con 0x7fe928071f50 2024-05-21T14:43:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.793+0000 7fe92f000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe9280c4c60 con 0x7fe928164160 2024-05-21T14:43:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.793+0000 7fe927e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe928071f50 0x7fe92815c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.793+0000 7fe927e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe928071f50 0x7fe92815c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51528/0 (socket says 172.21.15.78:51528) 2024-05-21T14:43:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.793+0000 7fe927e00640 1 -- 172.21.15.78:0/1913892553 learned_addr learned my addr 172.21.15.78:0/1913892553 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.793+0000 7fe92d000640 1 --2- 172.21.15.78:0/1913892553 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe928164160 0x7fe928166580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.793+0000 7fe927e00640 1 -- 172.21.15.78:0/1913892553 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe928164160 msgr2=0x7fe928166580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.793+0000 7fe927e00640 1 --2- 172.21.15.78:0/1913892553 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe928164160 0x7fe928166580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.793+0000 7fe927e00640 1 -- 172.21.15.78:0/1913892553 >> v1:172.21.15.84:6789/0 conn(0x7fe9280c7ff0 legacy=0x7fe9280cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:15.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.793+0000 7fe927e00640 1 -- 172.21.15.78:0/1913892553 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe928072c10 con 0x7fe928071f50 2024-05-21T14:43:15.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.797+0000 7fe927e00640 1 --2- 172.21.15.78:0/1913892553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe928071f50 0x7fe92815c060 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe918009e50 tx=0x7fe91801f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35f3d5815ef8f36 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:15.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.797+0000 7fe927400640 1 -- 172.21.15.78:0/1913892553 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9180b4070 con 0x7fe928071f50 2024-05-21T14:43:15.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.797+0000 7fe927400640 1 -- 172.21.15.78:0/1913892553 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9180af400 con 0x7fe928071f50 2024-05-21T14:43:15.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.797+0000 7fe927400640 1 -- 172.21.15.78:0/1913892553 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9180af7d0 con 0x7fe928071f50 2024-05-21T14:43:15.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.797+0000 7fe92f000640 1 -- 172.21.15.78:0/1913892553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe928071f50 msgr2=0x7fe92815c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:15.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.797+0000 7fe92f000640 1 --2- 172.21.15.78:0/1913892553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe928071f50 0x7fe92815c060 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe918009e50 tx=0x7fe91801f210 comp rx=0 tx=0).stop 2024-05-21T14:43:15.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.797+0000 7fe92f000640 1 -- 172.21.15.78:0/1913892553 shutdown_connections 2024-05-21T14:43:15.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.797+0000 7fe92f000640 1 --2- 172.21.15.78:0/1913892553 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe928164160 0x7fe928166580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.797+0000 7fe92f000640 1 --2- 172.21.15.78:0/1913892553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe928071f50 0x7fe92815c060 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.797+0000 7fe92f000640 1 -- 172.21.15.78:0/1913892553 >> 172.21.15.78:0/1913892553 conn(0x7fe92806b620 msgr2=0x7fe92806ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:15.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.797+0000 7fe92f000640 1 -- 172.21.15.78:0/1913892553 shutdown_connections 2024-05-21T14:43:15.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.797+0000 7fe92f000640 1 -- 172.21.15.78:0/1913892553 wait complete. 2024-05-21T14:43:15.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92f000640 1 Processor -- start 2024-05-21T14:43:15.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92f000640 1 -- start start 2024-05-21T14:43:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92f000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe928071f50 0x7fe9280cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92f000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9280c7ff0 0x7fe928154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92f000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe928164160 0x7fe92814fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92f000640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe9280734b0 con 0x7fe928164160 2024-05-21T14:43:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92f000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe9280731d0 con 0x7fe9280c7ff0 2024-05-21T14:43:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92f000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe92815b7f0 con 0x7fe928071f50 2024-05-21T14:43:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92d000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe928164160 0x7fe92814fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe927e00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe928071f50 0x7fe9280cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92d000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe928164160 0x7fe92814fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51532/0 (socket says 172.21.15.78:51532) 2024-05-21T14:43:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92d000640 1 -- 172.21.15.78:0/1813724242 learned_addr learned my addr 172.21.15.78:0/1813724242 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe91f400640 1 --2- 172.21.15.78:0/1813724242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9280c7ff0 0x7fe928154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92d000640 1 -- 172.21.15.78:0/1813724242 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe928071f50 msgr2=0x7fe9280cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92d000640 1 --2- 172.21.15.78:0/1813724242 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe928071f50 0x7fe9280cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92d000640 1 -- 172.21.15.78:0/1813724242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9280c7ff0 msgr2=0x7fe928154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92d000640 1 --2- 172.21.15.78:0/1813724242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9280c7ff0 0x7fe928154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92d000640 1 -- 172.21.15.78:0/1813724242 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9280cbf80 con 0x7fe928164160 2024-05-21T14:43:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92d000640 1 --2- 172.21.15.78:0/1813724242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe928164160 0x7fe92814fe60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe92000d530 tx=0x7fe92000d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe924c00640 1 -- 172.21.15.78:0/1813724242 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9200125f0 con 0x7fe928164160 2024-05-21T14:43:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe924c00640 1 -- 172.21.15.78:0/1813724242 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe920019070 con 0x7fe928164160 2024-05-21T14:43:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92f000640 1 -- 172.21.15.78:0/1813724242 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9280cd540 con 0x7fe928164160 2024-05-21T14:43:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe924c00640 1 -- 172.21.15.78:0/1813724242 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9200129d0 con 0x7fe928164160 2024-05-21T14:43:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.801+0000 7fe92f000640 1 -- 172.21.15.78:0/1813724242 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe928158bb0 con 0x7fe928164160 2024-05-21T14:43:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.805+0000 7fe92f000640 1 -- 172.21.15.78:0/1813724242 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe92804f730 con 0x7fe928164160 2024-05-21T14:43:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.805+0000 7fe924c00640 1 -- 172.21.15.78:0/1813724242 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe920012b70 con 0x7fe928164160 2024-05-21T14:43:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.805+0000 7fe924c00640 1 --2- 172.21.15.78:0/1813724242 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9040678f0 0x7fe904069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.805+0000 7fe924c00640 1 -- 172.21.15.78:0/1813724242 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fe920085b70 con 0x7fe928164160 2024-05-21T14:43:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.805+0000 7fe927e00640 1 --2- 172.21.15.78:0/1813724242 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9040678f0 0x7fe904069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:15.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.805+0000 7fe927e00640 1 --2- 172.21.15.78:0/1813724242 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9040678f0 0x7fe904069e00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe9180b1000 tx=0x7fe9180aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:15.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.809+0000 7fe924c00640 1 -- 172.21.15.78:0/1813724242 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fe9200563b0 con 0x7fe928164160 2024-05-21T14:43:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.969+0000 7fe92f000640 1 -- 172.21.15.78:0/1813724242 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9280740e0 con 0x7fe928164160 2024-05-21T14:43:15.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.969+0000 7fe924c00640 1 -- 172.21.15.78:0/1813724242 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12812 (secure 0 0 0) 0x7fe92005a6b0 con 0x7fe928164160 2024-05-21T14:43:15.976 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:15.977 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:09.070844+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:43:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.969+0000 7fe92f000640 1 -- 172.21.15.78:0/1813724242 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9040678f0 msgr2=0x7fe904069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.969+0000 7fe92f000640 1 --2- 172.21.15.78:0/1813724242 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9040678f0 0x7fe904069e00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe9180b1000 tx=0x7fe9180aa000 comp rx=0 tx=0).stop 2024-05-21T14:43:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.969+0000 7fe92f000640 1 -- 172.21.15.78:0/1813724242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe928164160 msgr2=0x7fe92814fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.969+0000 7fe92f000640 1 --2- 172.21.15.78:0/1813724242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe928164160 0x7fe92814fe60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe92000d530 tx=0x7fe92000d9f0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.969+0000 7fe92f000640 1 -- 172.21.15.78:0/1813724242 shutdown_connections 2024-05-21T14:43:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.969+0000 7fe92f000640 1 --2- 172.21.15.78:0/1813724242 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9040678f0 0x7fe904069e00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.969+0000 7fe92f000640 1 --2- 172.21.15.78:0/1813724242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe928164160 0x7fe92814fe60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.969+0000 7fe92f000640 1 --2- 172.21.15.78:0/1813724242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9280c7ff0 0x7fe928154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.969+0000 7fe92f000640 1 --2- 172.21.15.78:0/1813724242 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe928071f50 0x7fe9280cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.969+0000 7fe92f000640 1 -- 172.21.15.78:0/1813724242 >> 172.21.15.78:0/1813724242 conn(0x7fe92806b620 msgr2=0x7fe9281541c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.969+0000 7fe92f000640 1 -- 172.21.15.78:0/1813724242 shutdown_connections 2024-05-21T14:43:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:15.969+0000 7fe92f000640 1 -- 172.21.15.78:0/1813724242 wait complete. 2024-05-21T14:43:15.998 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-21T14:43:06.569415+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-21T14:43:15.999 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-21T14:43:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.141+0000 7f62dd200640 1 Processor -- start 2024-05-21T14:43:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.141+0000 7f62dd200640 1 -- start start 2024-05-21T14:43:16.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.141+0000 7f62dd200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62d80733d0 0x7f62d8071910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:16.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.141+0000 7f62dd200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62d8160e20 0x7f62d8163240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:16.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.141+0000 7f62dd200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62d8071e50 con 0x7f62d81527a0 2024-05-21T14:43:16.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.141+0000 7f62dd200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f62d8072980 con 0x7f62d8160e20 2024-05-21T14:43:16.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.141+0000 7f62dd200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f62d8072f40 con 0x7f62d80733d0 2024-05-21T14:43:16.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.141+0000 7f62d6800640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62d8160e20 0x7f62d8163240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:16.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.141+0000 7f62d6800640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62d8160e20 0x7f62d8163240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51540/0 (socket says 172.21.15.78:51540) 2024-05-21T14:43:16.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.141+0000 7f62d6800640 1 -- 172.21.15.78:0/3574091078 learned_addr learned my addr 172.21.15.78:0/3574091078 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:16.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.141+0000 7f62d5e00640 1 --2- 172.21.15.78:0/3574091078 >> v2:172.21.15.84:3300/0 conn(0x7f62d80733d0 0x7f62d8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:16.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.141+0000 7f62d6800640 1 -- 172.21.15.78:0/3574091078 >> v2:172.21.15.84:3300/0 conn(0x7f62d80733d0 msgr2=0x7f62d8071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:16.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.141+0000 7f62d6800640 1 --2- 172.21.15.78:0/3574091078 >> v2:172.21.15.84:3300/0 conn(0x7f62d80733d0 0x7f62d8071910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.141+0000 7f62d6800640 1 -- 172.21.15.78:0/3574091078 >> v1:172.21.15.84:6789/0 conn(0x7f62d81527a0 legacy=0x7f62d80c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.141+0000 7f62d6800640 1 -- 172.21.15.78:0/3574091078 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d80737e0 con 0x7f62d8160e20 2024-05-21T14:43:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.145+0000 7f62d6800640 1 --2- 172.21.15.78:0/3574091078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d8160e20 0x7f62d8163240 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f62d8072b00 tx=0x7f62d001f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98ebe764ebf5fe server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.145+0000 7f62d4a00640 1 -- 172.21.15.78:0/3574091078 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d00b4070 con 0x7f62d8160e20 2024-05-21T14:43:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.145+0000 7f62d4a00640 1 -- 172.21.15.78:0/3574091078 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d00af400 con 0x7f62d8160e20 2024-05-21T14:43:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.145+0000 7f62d4a00640 1 -- 172.21.15.78:0/3574091078 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d00af7d0 con 0x7f62d8160e20 2024-05-21T14:43:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.145+0000 7f62dd200640 1 -- 172.21.15.78:0/3574091078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d8160e20 msgr2=0x7f62d8163240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.145+0000 7f62dd200640 1 --2- 172.21.15.78:0/3574091078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d8160e20 0x7f62d8163240 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f62d8072b00 tx=0x7f62d001f1d0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.145+0000 7f62dd200640 1 -- 172.21.15.78:0/3574091078 shutdown_connections 2024-05-21T14:43:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.145+0000 7f62dd200640 1 --2- 172.21.15.78:0/3574091078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d8160e20 0x7f62d8163240 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.145+0000 7f62dd200640 1 --2- 172.21.15.78:0/3574091078 >> v2:172.21.15.84:3300/0 conn(0x7f62d80733d0 0x7f62d8071910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.145+0000 7f62dd200640 1 -- 172.21.15.78:0/3574091078 >> 172.21.15.78:0/3574091078 conn(0x7f62d80cd1e0 msgr2=0x7f62d80c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.145+0000 7f62dd200640 1 -- 172.21.15.78:0/3574091078 shutdown_connections 2024-05-21T14:43:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.145+0000 7f62dd200640 1 -- 172.21.15.78:0/3574091078 wait complete. 2024-05-21T14:43:16.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62dd200640 1 Processor -- start 2024-05-21T14:43:16.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62dd200640 1 -- start start 2024-05-21T14:43:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62dd200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62d80733d0 0x7f62d814bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62dd200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d81527a0 0x7f62d8142af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62dd200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f62d8160e20 0x7f62d8143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62dd200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f62d8074060 con 0x7f62d81527a0 2024-05-21T14:43:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62dd200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f62d8073d80 con 0x7f62d80733d0 2024-05-21T14:43:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62dd200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f62d8072bd0 con 0x7f62d8160e20 2024-05-21T14:43:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62d5400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d81527a0 0x7f62d8142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62d5400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d81527a0 0x7f62d8142af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51546/0 (socket says 172.21.15.78:51546) 2024-05-21T14:43:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62d5400640 1 -- 172.21.15.78:0/1760952367 learned_addr learned my addr 172.21.15.78:0/1760952367 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62d6800640 1 --2- 172.21.15.78:0/1760952367 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f62d8160e20 0x7f62d8143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62d5e00640 1 --2- 172.21.15.78:0/1760952367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62d80733d0 0x7f62d814bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62d5400640 1 -- 172.21.15.78:0/1760952367 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f62d8160e20 msgr2=0x7f62d8143030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62d5400640 1 --2- 172.21.15.78:0/1760952367 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f62d8160e20 0x7f62d8143030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62d5400640 1 -- 172.21.15.78:0/1760952367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62d80733d0 msgr2=0x7f62d814bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62d5400640 1 --2- 172.21.15.78:0/1760952367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62d80733d0 0x7f62d814bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62d5400640 1 -- 172.21.15.78:0/1760952367 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d80c70e0 con 0x7f62d81527a0 2024-05-21T14:43:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62d5e00640 1 --2- 172.21.15.78:0/1760952367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62d80733d0 0x7f62d814bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62d5400640 1 --2- 172.21.15.78:0/1760952367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d81527a0 0x7f62d8142af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f62c400c370 tx=0x7f62c400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62ce000640 1 -- 172.21.15.78:0/1760952367 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c40052d0 con 0x7f62d81527a0 2024-05-21T14:43:16.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62ce000640 1 -- 172.21.15.78:0/1760952367 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62c4005470 con 0x7f62d81527a0 2024-05-21T14:43:16.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62ce000640 1 -- 172.21.15.78:0/1760952367 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c4007260 con 0x7f62d81527a0 2024-05-21T14:43:16.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62dd200640 1 -- 172.21.15.78:0/1760952367 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d8143f50 con 0x7f62d81527a0 2024-05-21T14:43:16.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.149+0000 7f62dd200640 1 -- 172.21.15.78:0/1760952367 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d81444f0 con 0x7f62d81527a0 2024-05-21T14:43:16.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.153+0000 7f62dd200640 1 -- 172.21.15.78:0/1760952367 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62d81439f0 con 0x7f62d81527a0 2024-05-21T14:43:16.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.153+0000 7f62ce000640 1 -- 172.21.15.78:0/1760952367 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f62c4007400 con 0x7f62d81527a0 2024-05-21T14:43:16.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.153+0000 7f62ce000640 1 --2- 172.21.15.78:0/1760952367 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f62b80678c0 0x7f62b8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:16.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.153+0000 7f62ce000640 1 -- 172.21.15.78:0/1760952367 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f62c4084cd0 con 0x7f62d81527a0 2024-05-21T14:43:16.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.153+0000 7f62d5e00640 1 --2- 172.21.15.78:0/1760952367 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f62b80678c0 0x7f62b8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:16.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.157+0000 7f62d5e00640 1 --2- 172.21.15.78:0/1760952367 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f62b80678c0 0x7f62b8069dd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f62d80c6e40 tx=0x7f62c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.157+0000 7f62ce000640 1 -- 172.21.15.78:0/1760952367 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f62c4055500 con 0x7f62d81527a0 2024-05-21T14:43:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.313+0000 7f62dd200640 1 -- 172.21.15.78:0/1760952367 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f62d8141200 con 0x7f62d81527a0 2024-05-21T14:43:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.313+0000 7f62ce000640 1 -- 172.21.15.78:0/1760952367 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7f62c4059800 con 0x7f62d81527a0 2024-05-21T14:43:16.322 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-05-21T14:43:16.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.317+0000 7f62dd200640 1 -- 172.21.15.78:0/1760952367 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f62b80678c0 msgr2=0x7f62b8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.317+0000 7f62dd200640 1 --2- 172.21.15.78:0/1760952367 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f62b80678c0 0x7f62b8069dd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f62d80c6e40 tx=0x7f62c8008040 comp rx=0 tx=0).stop 2024-05-21T14:43:16.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.317+0000 7f62dd200640 1 -- 172.21.15.78:0/1760952367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d81527a0 msgr2=0x7f62d8142af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.317+0000 7f62dd200640 1 --2- 172.21.15.78:0/1760952367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d81527a0 0x7f62d8142af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f62c400c370 tx=0x7f62c400c830 comp rx=0 tx=0).stop 2024-05-21T14:43:16.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.317+0000 7f62dd200640 1 -- 172.21.15.78:0/1760952367 shutdown_connections 2024-05-21T14:43:16.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.317+0000 7f62dd200640 1 --2- 172.21.15.78:0/1760952367 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f62b80678c0 0x7f62b8069dd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.317+0000 7f62dd200640 1 --2- 172.21.15.78:0/1760952367 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f62d8160e20 0x7f62d8143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.317+0000 7f62dd200640 1 --2- 172.21.15.78:0/1760952367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d81527a0 0x7f62d8142af0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.317+0000 7f62dd200640 1 --2- 172.21.15.78:0/1760952367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62d80733d0 0x7f62d814bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.317+0000 7f62dd200640 1 -- 172.21.15.78:0/1760952367 >> 172.21.15.78:0/1760952367 conn(0x7f62d80cd1e0 msgr2=0x7f62d80c6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:16.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.317+0000 7f62dd200640 1 -- 172.21.15.78:0/1760952367 shutdown_connections 2024-05-21T14:43:16.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.317+0000 7f62dd200640 1 -- 172.21.15.78:0/1760952367 wait complete. 2024-05-21T14:43:16.344 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-21T14:43:16.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.481+0000 7fb843400640 1 Processor -- start 2024-05-21T14:43:16.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.481+0000 7fb843400640 1 -- start start 2024-05-21T14:43:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.485+0000 7fb843400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb83c071fe0 0x7fb83c0723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.485+0000 7fb843400640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb83c0715f0 con 0x7fb83c0c5640 2024-05-21T14:43:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.485+0000 7fb843400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb83c072b80 con 0x7fb83c1529d0 2024-05-21T14:43:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.485+0000 7fb843400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fb83c0c8530 con 0x7fb83c071fe0 2024-05-21T14:43:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.485+0000 7fb841400640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb83c0c5640 0x7fb83c162e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:46848/0 (socket says 172.21.15.78:46848) 2024-05-21T14:43:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.485+0000 7fb841400640 1 -- 172.21.15.78:0/3766023955 learned_addr learned my addr 172.21.15.78:0/3766023955 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.485+0000 7fb83be00640 1 --2- 172.21.15.78:0/3766023955 >> v2:172.21.15.84:3300/0 conn(0x7fb83c071fe0 0x7fb83c0723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.485+0000 7fb83b400640 1 -- 172.21.15.78:0/3766023955 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 204635896 0 0) 0x7fb83c0715f0 con 0x7fb83c0c5640 2024-05-21T14:43:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.485+0000 7fb83b400640 1 -- 172.21.15.78:0/3766023955 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb820003530 con 0x7fb83c0c5640 2024-05-21T14:43:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.485+0000 7fb83be00640 1 -- 172.21.15.78:0/3766023955 >> v1:172.21.15.84:6789/0 conn(0x7fb83c1529d0 legacy=0x7fb83c072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.485+0000 7fb83be00640 1 -- 172.21.15.78:0/3766023955 >> v1:172.21.15.78:6789/0 conn(0x7fb83c0c5640 legacy=0x7fb83c162e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.485+0000 7fb83be00640 1 -- 172.21.15.78:0/3766023955 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83c0c8810 con 0x7fb83c071fe0 2024-05-21T14:43:16.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.485+0000 7fb83b400640 1 -- 172.21.15.78:0/3766023955 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3131242131 0 0) 0x7fb820003530 con 0x7fb83c0c5640 2024-05-21T14:43:16.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.489+0000 7fb83be00640 1 --2- 172.21.15.78:0/3766023955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb83c071fe0 0x7fb83c0723f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb8280097c0 tx=0x7fb82801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c9ef2ed9c436867 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:16.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.489+0000 7fb83b400640 1 -- 172.21.15.78:0/3766023955 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8280b0070 con 0x7fb83c071fe0 2024-05-21T14:43:16.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.489+0000 7fb83b400640 1 -- 172.21.15.78:0/3766023955 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8280ab400 con 0x7fb83c071fe0 2024-05-21T14:43:16.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.489+0000 7fb83b400640 1 -- 172.21.15.78:0/3766023955 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb834001680 con 0x7fb83c071fe0 2024-05-21T14:43:16.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.489+0000 7fb843400640 1 -- 172.21.15.78:0/3766023955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb83c071fe0 msgr2=0x7fb83c0723f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.489+0000 7fb843400640 1 --2- 172.21.15.78:0/3766023955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb83c071fe0 0x7fb83c0723f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb8280097c0 tx=0x7fb82801c3c0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.489+0000 7fb843400640 1 -- 172.21.15.78:0/3766023955 shutdown_connections 2024-05-21T14:43:16.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.489+0000 7fb843400640 1 --2- 172.21.15.78:0/3766023955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb83c071fe0 0x7fb83c0723f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.489+0000 7fb843400640 1 -- 172.21.15.78:0/3766023955 >> 172.21.15.78:0/3766023955 conn(0x7fb83c0c9380 msgr2=0x7fb83c0c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:16.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.489+0000 7fb843400640 1 -- 172.21.15.78:0/3766023955 shutdown_connections 2024-05-21T14:43:16.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.489+0000 7fb843400640 1 -- 172.21.15.78:0/3766023955 wait complete. 2024-05-21T14:43:16.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb843400640 1 Processor -- start 2024-05-21T14:43:16.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb843400640 1 -- start start 2024-05-21T14:43:16.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb843400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb83c071fe0 0x7fb83c1581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:16.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb843400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb83c0c5640 0x7fb83c145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:16.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb843400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb83c1529d0 0x7fb83c144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:16.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb843400640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c166f40 con 0x7fb83c071fe0 2024-05-21T14:43:16.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb843400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c166dc0 con 0x7fb83c0c5640 2024-05-21T14:43:16.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb843400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb83c1670c0 con 0x7fb83c1529d0 2024-05-21T14:43:16.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb840a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb83c071fe0 0x7fb83c1581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:16.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb840a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb83c071fe0 0x7fb83c1581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51552/0 (socket says 172.21.15.78:51552) 2024-05-21T14:43:16.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb840a00640 1 -- 172.21.15.78:0/3436682029 learned_addr learned my addr 172.21.15.78:0/3436682029 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:16.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb83be00640 1 --2- 172.21.15.78:0/3436682029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb83c0c5640 0x7fb83c145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:16.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb841400640 1 --2- 172.21.15.78:0/3436682029 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb83c1529d0 0x7fb83c144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:16.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb840a00640 1 -- 172.21.15.78:0/3436682029 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb83c1529d0 msgr2=0x7fb83c144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb840a00640 1 --2- 172.21.15.78:0/3436682029 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb83c1529d0 0x7fb83c144510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb840a00640 1 -- 172.21.15.78:0/3436682029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb83c0c5640 msgr2=0x7fb83c145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb840a00640 1 --2- 172.21.15.78:0/3436682029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb83c0c5640 0x7fb83c145420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb840a00640 1 -- 172.21.15.78:0/3436682029 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83c158720 con 0x7fb83c071fe0 2024-05-21T14:43:16.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb83be00640 1 --2- 172.21.15.78:0/3436682029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb83c0c5640 0x7fb83c145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:16.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb840a00640 1 --2- 172.21.15.78:0/3436682029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb83c071fe0 0x7fb83c1581e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb82c00c7d0 tx=0x7fb82c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:16.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb838c00640 1 -- 172.21.15.78:0/3436682029 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82c003b80 con 0x7fb83c071fe0 2024-05-21T14:43:16.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb838c00640 1 -- 172.21.15.78:0/3436682029 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb82c003d20 con 0x7fb83c071fe0 2024-05-21T14:43:16.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb843400640 1 -- 172.21.15.78:0/3436682029 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb83c1f3730 con 0x7fb83c071fe0 2024-05-21T14:43:16.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb838c00640 1 -- 172.21.15.78:0/3436682029 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82c00aa90 con 0x7fb83c071fe0 2024-05-21T14:43:16.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.493+0000 7fb843400640 1 -- 172.21.15.78:0/3436682029 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb83c1f3cf0 con 0x7fb83c071fe0 2024-05-21T14:43:16.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.497+0000 7fb843400640 1 -- 172.21.15.78:0/3436682029 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb83c04f730 con 0x7fb83c071fe0 2024-05-21T14:43:16.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.497+0000 7fb838c00640 1 -- 172.21.15.78:0/3436682029 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb82c00ac30 con 0x7fb83c071fe0 2024-05-21T14:43:16.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.497+0000 7fb838c00640 1 --2- 172.21.15.78:0/3436682029 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb81c0678c0 0x7fb81c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:16.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.497+0000 7fb838c00640 1 -- 172.21.15.78:0/3436682029 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fb82c085910 con 0x7fb83c071fe0 2024-05-21T14:43:16.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.497+0000 7fb83be00640 1 --2- 172.21.15.78:0/3436682029 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb81c0678c0 0x7fb81c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:16.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.497+0000 7fb83be00640 1 --2- 172.21.15.78:0/3436682029 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb81c0678c0 0x7fb81c069dd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8280ad000 tx=0x7fb828008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:16.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.501+0000 7fb838c00640 1 -- 172.21.15.78:0/3436682029 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb82c056700 con 0x7fb83c071fe0 2024-05-21T14:43:16.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.661+0000 7fb843400640 1 -- 172.21.15.78:0/3436682029 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb83c06fc10 con 0x7fb83c071fe0 2024-05-21T14:43:16.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.661+0000 7fb838c00640 1 -- 172.21.15.78:0/3436682029 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7fb82c056000 con 0x7fb83c071fe0 2024-05-21T14:43:16.718 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:16.718 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2024-05-21T14:43:16.718 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-05-21T14:43:16.718 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2024-05-21T14:43:16.718 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2024-05-21T14:43:16.718 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-05-21T14:43:16.719 INFO:teuthology.orchestra.run.smithi078.stdout:] 2024-05-21T14:43:16.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.661+0000 7fb843400640 1 -- 172.21.15.78:0/3436682029 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb81c0678c0 msgr2=0x7fb81c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.661+0000 7fb843400640 1 --2- 172.21.15.78:0/3436682029 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb81c0678c0 0x7fb81c069dd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8280ad000 tx=0x7fb828008040 comp rx=0 tx=0).stop 2024-05-21T14:43:16.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.661+0000 7fb843400640 1 -- 172.21.15.78:0/3436682029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb83c071fe0 msgr2=0x7fb83c1581e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.661+0000 7fb843400640 1 --2- 172.21.15.78:0/3436682029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb83c071fe0 0x7fb83c1581e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb82c00c7d0 tx=0x7fb82c00cc90 comp rx=0 tx=0).stop 2024-05-21T14:43:16.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.661+0000 7fb843400640 1 -- 172.21.15.78:0/3436682029 shutdown_connections 2024-05-21T14:43:16.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.661+0000 7fb843400640 1 --2- 172.21.15.78:0/3436682029 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb81c0678c0 0x7fb81c069dd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.661+0000 7fb843400640 1 --2- 172.21.15.78:0/3436682029 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb83c1529d0 0x7fb83c144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.661+0000 7fb843400640 1 --2- 172.21.15.78:0/3436682029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb83c0c5640 0x7fb83c145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.661+0000 7fb843400640 1 --2- 172.21.15.78:0/3436682029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb83c071fe0 0x7fb83c1581e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.665+0000 7fb843400640 1 -- 172.21.15.78:0/3436682029 >> 172.21.15.78:0/3436682029 conn(0x7fb83c0c9380 msgr2=0x7fb83c0c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:16.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.665+0000 7fb843400640 1 -- 172.21.15.78:0/3436682029 shutdown_connections 2024-05-21T14:43:16.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.665+0000 7fb843400640 1 -- 172.21.15.78:0/3436682029 wait complete. 2024-05-21T14:43:16.721 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-21T14:43:16.721 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-21T14:43:16.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.865+0000 7f24b4a00640 1 Processor -- start 2024-05-21T14:43:16.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.865+0000 7f24b4a00640 1 -- start start 2024-05-21T14:43:16.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.865+0000 7f24b4a00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f24b015cb00 0x7f24b00ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:16.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.865+0000 7f24b4a00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24b00c5310 con 0x7f24b00ca6f0 2024-05-21T14:43:16.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.865+0000 7f24b4a00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24b00c5ee0 con 0x7f24b00c5ad0 2024-05-21T14:43:16.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.865+0000 7f24b4a00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f24b00c8a00 con 0x7f24b015cb00 2024-05-21T14:43:16.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.865+0000 7f24af200640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f24b00ca6f0 0x7f24b0163e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:46860/0 (socket says 172.21.15.78:46860) 2024-05-21T14:43:16.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.865+0000 7f24ade00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f24b015cb00 0x7f24b00ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:16.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.865+0000 7f24af200640 1 -- 172.21.15.78:0/1168541606 learned_addr learned my addr 172.21.15.78:0/1168541606 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:16.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.865+0000 7f24ad400640 1 -- 172.21.15.78:0/1168541606 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2538702533 0 0) 0x7f24b00c5310 con 0x7f24b00ca6f0 2024-05-21T14:43:16.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.865+0000 7f24ad400640 1 -- 172.21.15.78:0/1168541606 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2494003530 con 0x7f24b00ca6f0 2024-05-21T14:43:16.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.865+0000 7f24ade00640 1 -- 172.21.15.78:0/1168541606 >> v1:172.21.15.84:6789/0 conn(0x7f24b00c5ad0 legacy=0x7f24b01536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.865+0000 7f24ade00640 1 -- 172.21.15.78:0/1168541606 >> v1:172.21.15.78:6789/0 conn(0x7f24b00ca6f0 legacy=0x7f24b0163e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.865+0000 7f24ade00640 1 -- 172.21.15.78:0/1168541606 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b00c7530 con 0x7f24b015cb00 2024-05-21T14:43:16.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.869+0000 7f24ade00640 1 --2- 172.21.15.78:0/1168541606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b015cb00 0x7f24b00ca1b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f249c0097c0 tx=0x7f249c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fe21e1d4ce7f8a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:16.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.869+0000 7f24ad400640 1 -- 172.21.15.78:0/1168541606 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c0b5070 con 0x7f24b015cb00 2024-05-21T14:43:16.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.869+0000 7f24ad400640 1 -- 172.21.15.78:0/1168541606 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f249c0a8990 con 0x7f24b015cb00 2024-05-21T14:43:16.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.869+0000 7f24ad400640 1 -- 172.21.15.78:0/1168541606 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c0a8d60 con 0x7f24b015cb00 2024-05-21T14:43:16.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.869+0000 7f24b4a00640 1 -- 172.21.15.78:0/1168541606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b015cb00 msgr2=0x7f24b00ca1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.869+0000 7f24b4a00640 1 --2- 172.21.15.78:0/1168541606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b015cb00 0x7f24b00ca1b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f249c0097c0 tx=0x7f249c01ec90 comp rx=0 tx=0).stop 2024-05-21T14:43:16.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.869+0000 7f24b4a00640 1 -- 172.21.15.78:0/1168541606 shutdown_connections 2024-05-21T14:43:16.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.869+0000 7f24b4a00640 1 --2- 172.21.15.78:0/1168541606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b015cb00 0x7f24b00ca1b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.869+0000 7f24b4a00640 1 -- 172.21.15.78:0/1168541606 >> 172.21.15.78:0/1168541606 conn(0x7f24b006cd30 msgr2=0x7f24b006fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:16.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.869+0000 7f24b4a00640 1 -- 172.21.15.78:0/1168541606 shutdown_connections 2024-05-21T14:43:16.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.869+0000 7f24b4a00640 1 -- 172.21.15.78:0/1168541606 wait complete. 2024-05-21T14:43:16.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24b4a00640 1 Processor -- start 2024-05-21T14:43:16.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24b4a00640 1 -- start start 2024-05-21T14:43:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24b4a00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24b00c5ad0 0x7f24b01f0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24b4a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b00ca6f0 0x7f24b014bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24b4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24b015cb00 0x7f24b0147510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24b4a00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f24b00c55b0 con 0x7f24b00ca6f0 2024-05-21T14:43:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24b4a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f24b00c7af0 con 0x7f24b015cb00 2024-05-21T14:43:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24b4a00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f24b015cf10 con 0x7f24b00c5ad0 2024-05-21T14:43:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24ade00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b00ca6f0 0x7f24b014bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24ade00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b00ca6f0 0x7f24b014bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51576/0 (socket says 172.21.15.78:51576) 2024-05-21T14:43:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24ade00640 1 -- 172.21.15.78:0/2981293628 learned_addr learned my addr 172.21.15.78:0/2981293628 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24af200640 1 --2- 172.21.15.78:0/2981293628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24b015cb00 0x7f24b0147510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24ae800640 1 --2- 172.21.15.78:0/2981293628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24b00c5ad0 0x7f24b01f0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24ade00640 1 -- 172.21.15.78:0/2981293628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24b00c5ad0 msgr2=0x7f24b01f0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24ade00640 1 --2- 172.21.15.78:0/2981293628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24b00c5ad0 0x7f24b01f0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24ade00640 1 -- 172.21.15.78:0/2981293628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24b015cb00 msgr2=0x7f24b0147510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:16.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24ade00640 1 --2- 172.21.15.78:0/2981293628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24b015cb00 0x7f24b0147510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:16.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24ade00640 1 -- 172.21.15.78:0/2981293628 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b015c8a0 con 0x7f24b00ca6f0 2024-05-21T14:43:16.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24af200640 1 --2- 172.21.15.78:0/2981293628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24b015cb00 0x7f24b0147510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:16.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24ade00640 1 --2- 172.21.15.78:0/2981293628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b00ca6f0 0x7f24b014bde0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f249c0b3040 tx=0x7f249c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:16.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24a6a00640 1 -- 172.21.15.78:0/2981293628 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c0bf070 con 0x7f24b00ca6f0 2024-05-21T14:43:16.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24a6a00640 1 -- 172.21.15.78:0/2981293628 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f249c0b0720 con 0x7f24b00ca6f0 2024-05-21T14:43:16.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.873+0000 7f24a6a00640 1 -- 172.21.15.78:0/2981293628 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c0b5040 con 0x7f24b00ca6f0 2024-05-21T14:43:16.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.877+0000 7f24b4a00640 1 -- 172.21.15.78:0/2981293628 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b014e090 con 0x7f24b00ca6f0 2024-05-21T14:43:16.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.877+0000 7f24b4a00640 1 -- 172.21.15.78:0/2981293628 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b014e350 con 0x7f24b00ca6f0 2024-05-21T14:43:16.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.877+0000 7f24b4a00640 1 -- 172.21.15.78:0/2981293628 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b0069f30 con 0x7f24b00ca6f0 2024-05-21T14:43:16.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.877+0000 7f24a6a00640 1 -- 172.21.15.78:0/2981293628 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f249c0b0b10 con 0x7f24b00ca6f0 2024-05-21T14:43:16.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.877+0000 7f24a6a00640 1 --2- 172.21.15.78:0/2981293628 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24900678f0 0x7f2490069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:16.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.877+0000 7f24a6a00640 1 -- 172.21.15.78:0/2981293628 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f249c1222e0 con 0x7f24b00ca6f0 2024-05-21T14:43:16.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.877+0000 7f24ae800640 1 --2- 172.21.15.78:0/2981293628 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24900678f0 0x7f2490069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:16.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.881+0000 7f24ae800640 1 --2- 172.21.15.78:0/2981293628 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24900678f0 0x7f2490069e00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f24a0000f70 tx=0x7f24a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:16.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:16.881+0000 7f24a6a00640 1 -- 172.21.15.78:0/2981293628 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f249c0187f0 con 0x7f24b00ca6f0 2024-05-21T14:43:16.972 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:43:16.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:43:17.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.041+0000 7f24b4a00640 1 -- 172.21.15.78:0/2981293628 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f24b0151fa0 con 0x7f24b00ca6f0 2024-05-21T14:43:17.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.561+0000 7f24a6a00640 1 -- 172.21.15.78:0/2981293628 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f249c0f3040 con 0x7f24b00ca6f0 2024-05-21T14:43:17.567 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2024-05-21T14:43:17.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.561+0000 7f24b4a00640 1 -- 172.21.15.78:0/2981293628 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24900678f0 msgr2=0x7f2490069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:17.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.561+0000 7f24b4a00640 1 --2- 172.21.15.78:0/2981293628 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24900678f0 0x7f2490069e00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f24a0000f70 tx=0x7f24a0009040 comp rx=0 tx=0).stop 2024-05-21T14:43:17.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.561+0000 7f24b4a00640 1 -- 172.21.15.78:0/2981293628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b00ca6f0 msgr2=0x7f24b014bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:17.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.561+0000 7f24b4a00640 1 --2- 172.21.15.78:0/2981293628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b00ca6f0 0x7f24b014bde0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f249c0b3040 tx=0x7f249c01ba30 comp rx=0 tx=0).stop 2024-05-21T14:43:17.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.561+0000 7f24b4a00640 1 -- 172.21.15.78:0/2981293628 shutdown_connections 2024-05-21T14:43:17.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.561+0000 7f24b4a00640 1 --2- 172.21.15.78:0/2981293628 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24900678f0 0x7f2490069e00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:17.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.561+0000 7f24b4a00640 1 --2- 172.21.15.78:0/2981293628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24b015cb00 0x7f24b0147510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:17.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.561+0000 7f24b4a00640 1 --2- 172.21.15.78:0/2981293628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24b00ca6f0 0x7f24b014bde0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:17.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.561+0000 7f24b4a00640 1 --2- 172.21.15.78:0/2981293628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24b00c5ad0 0x7f24b01f0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:17.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.561+0000 7f24b4a00640 1 -- 172.21.15.78:0/2981293628 >> 172.21.15.78:0/2981293628 conn(0x7f24b006cd30 msgr2=0x7f24b0150ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:17.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.561+0000 7f24b4a00640 1 -- 172.21.15.78:0/2981293628 shutdown_connections 2024-05-21T14:43:17.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.561+0000 7f24b4a00640 1 -- 172.21.15.78:0/2981293628 wait complete. 2024-05-21T14:43:17.598 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-21T14:43:17.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.789+0000 7f9ce5e00640 1 Processor -- start 2024-05-21T14:43:17.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.789+0000 7f9ce5e00640 1 -- start start 2024-05-21T14:43:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.789+0000 7f9ce5e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9ce0071660 0x7f9ce0158590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.789+0000 7f9ce5e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9ce006d370 0x7f9ce006d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.793+0000 7f9ce5e00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce0158ad0 con 0x7f9ce015b6c0 2024-05-21T14:43:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.793+0000 7f9ce5e00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f9ce00c3430 con 0x7f9ce0071660 2024-05-21T14:43:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.793+0000 7f9ce5e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f9ce015b230 con 0x7f9ce006d370 2024-05-21T14:43:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.793+0000 7f9ce4a00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9ce0071660 0x7f9ce0158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.793+0000 7f9ce4a00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9ce0071660 0x7f9ce0158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51588/0 (socket says 172.21.15.78:51588) 2024-05-21T14:43:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.793+0000 7f9ce4a00640 1 -- 172.21.15.78:0/1599590480 learned_addr learned my addr 172.21.15.78:0/1599590480 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.793+0000 7f9cdfe00640 1 --2- 172.21.15.78:0/1599590480 >> v2:172.21.15.84:3300/0 conn(0x7f9ce006d370 0x7f9ce006d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.793+0000 7f9ce4a00640 1 -- 172.21.15.78:0/1599590480 >> v2:172.21.15.84:3300/0 conn(0x7f9ce006d370 msgr2=0x7f9ce006d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.793+0000 7f9ce4a00640 1 --2- 172.21.15.78:0/1599590480 >> v2:172.21.15.84:3300/0 conn(0x7f9ce006d370 0x7f9ce006d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.793+0000 7f9ce4a00640 1 -- 172.21.15.78:0/1599590480 >> v1:172.21.15.84:6789/0 conn(0x7f9ce015b6c0 legacy=0x7f9ce015bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.793+0000 7f9ce4a00640 1 -- 172.21.15.78:0/1599590480 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce00c3660 con 0x7f9ce0071660 2024-05-21T14:43:17.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.793+0000 7f9ce4a00640 1 --2- 172.21.15.78:0/1599590480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0071660 0x7f9ce0158590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9ce006fea0 tx=0x7f9cd401e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee519c96a6f26c server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:17.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.797+0000 7f9cdf400640 1 -- 172.21.15.78:0/1599590480 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd40ad070 con 0x7f9ce0071660 2024-05-21T14:43:17.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.797+0000 7f9cdf400640 1 -- 172.21.15.78:0/1599590480 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd4004230 con 0x7f9ce0071660 2024-05-21T14:43:17.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.797+0000 7f9cdf400640 1 -- 172.21.15.78:0/1599590480 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4003620 con 0x7f9ce0071660 2024-05-21T14:43:17.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.797+0000 7f9ce5e00640 1 -- 172.21.15.78:0/1599590480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0071660 msgr2=0x7f9ce0158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:17.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.797+0000 7f9ce5e00640 1 --2- 172.21.15.78:0/1599590480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0071660 0x7f9ce0158590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9ce006fea0 tx=0x7f9cd401e940 comp rx=0 tx=0).stop 2024-05-21T14:43:17.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.797+0000 7f9ce5e00640 1 -- 172.21.15.78:0/1599590480 shutdown_connections 2024-05-21T14:43:17.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.797+0000 7f9ce5e00640 1 --2- 172.21.15.78:0/1599590480 >> v2:172.21.15.84:3300/0 conn(0x7f9ce006d370 0x7f9ce006d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:17.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.797+0000 7f9ce5e00640 1 --2- 172.21.15.78:0/1599590480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0071660 0x7f9ce0158590 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:17.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.797+0000 7f9ce5e00640 1 -- 172.21.15.78:0/1599590480 >> 172.21.15.78:0/1599590480 conn(0x7f9ce006ecd0 msgr2=0x7f9ce006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:17.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.797+0000 7f9ce5e00640 1 -- 172.21.15.78:0/1599590480 shutdown_connections 2024-05-21T14:43:17.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.797+0000 7f9ce5e00640 1 -- 172.21.15.78:0/1599590480 wait complete. 2024-05-21T14:43:17.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.797+0000 7f9ce5e00640 1 Processor -- start 2024-05-21T14:43:17.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.797+0000 7f9ce5e00640 1 -- start start 2024-05-21T14:43:17.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9ce5e00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9ce006d370 0x7f9ce00c5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:17.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9ce5e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0071660 0x7f9ce00cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:17.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9ce5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ce015b6c0 0x7f9ce0072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:17.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9ce5e00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce00c90c0 con 0x7f9ce0071660 2024-05-21T14:43:17.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9ce5e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce00c8890 con 0x7f9ce015b6c0 2024-05-21T14:43:17.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9ce5e00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce01644a0 con 0x7f9ce006d370 2024-05-21T14:43:17.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9cdfe00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0071660 0x7f9ce00cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:17.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9cdfe00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0071660 0x7f9ce00cb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51598/0 (socket says 172.21.15.78:51598) 2024-05-21T14:43:17.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9cdfe00640 1 -- 172.21.15.78:0/472575165 learned_addr learned my addr 172.21.15.78:0/472575165 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:17.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9ce4a00640 1 --2- 172.21.15.78:0/472575165 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9ce006d370 0x7f9ce00c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:17.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9ce5400640 1 --2- 172.21.15.78:0/472575165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ce015b6c0 0x7f9ce0072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9cdfe00640 1 -- 172.21.15.78:0/472575165 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9ce006d370 msgr2=0x7f9ce00c5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9cdfe00640 1 --2- 172.21.15.78:0/472575165 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9ce006d370 0x7f9ce00c5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9cdfe00640 1 -- 172.21.15.78:0/472575165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ce015b6c0 msgr2=0x7f9ce0072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9cdfe00640 1 --2- 172.21.15.78:0/472575165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ce015b6c0 0x7f9ce0072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9cdfe00640 1 -- 172.21.15.78:0/472575165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce00cb7a0 con 0x7f9ce0071660 2024-05-21T14:43:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9cdfe00640 1 --2- 172.21.15.78:0/472575165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0071660 0x7f9ce00cb260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00e8a0 tx=0x7f9ccc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9cdcc00640 1 -- 172.21.15.78:0/472575165 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc017070 con 0x7f9ce0071660 2024-05-21T14:43:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9cdcc00640 1 -- 172.21.15.78:0/472575165 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc00c940 con 0x7f9ce0071660 2024-05-21T14:43:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9ce5e00640 1 -- 172.21.15.78:0/472575165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce014fcb0 con 0x7f9ce0071660 2024-05-21T14:43:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9cdcc00640 1 -- 172.21.15.78:0/472575165 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc00ccf0 con 0x7f9ce0071660 2024-05-21T14:43:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9ce5e00640 1 -- 172.21.15.78:0/472575165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce0150270 con 0x7f9ce0071660 2024-05-21T14:43:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.801+0000 7f9ce5e00640 1 -- 172.21.15.78:0/472575165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce0142440 con 0x7f9ce0071660 2024-05-21T14:43:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.805+0000 7f9cdcc00640 1 -- 172.21.15.78:0/472575165 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ccc01a070 con 0x7f9ce0071660 2024-05-21T14:43:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.805+0000 7f9cdcc00640 1 --2- 172.21.15.78:0/472575165 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9cc00678f0 0x7f9cc0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.805+0000 7f9cdcc00640 1 -- 172.21.15.78:0/472575165 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f9ccc085d20 con 0x7f9ce0071660 2024-05-21T14:43:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.805+0000 7f9ce4a00640 1 --2- 172.21.15.78:0/472575165 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9cc00678f0 0x7f9cc0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:17.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.805+0000 7f9ce4a00640 1 --2- 172.21.15.78:0/472575165 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9cc00678f0 0x7f9cc0069e00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9cd40b1000 tx=0x7f9cd40a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:17.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.809+0000 7f9cdcc00640 1 -- 172.21.15.78:0/472575165 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f9ccc056350 con 0x7f9ce0071660 2024-05-21T14:43:17.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:17.965+0000 7f9ce5e00640 1 -- 172.21.15.78:0/472575165 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9ce0071440 con 0x7f9ce0071660 2024-05-21T14:43:18.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.569+0000 7f9cdcc00640 1 -- 172.21.15.78:0/472575165 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7f9ccc05a650 con 0x7f9ce0071660 2024-05-21T14:43:18.576 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2024-05-21T14:43:18.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.569+0000 7f9ce5e00640 1 -- 172.21.15.78:0/472575165 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9cc00678f0 msgr2=0x7f9cc0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:18.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.569+0000 7f9ce5e00640 1 --2- 172.21.15.78:0/472575165 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9cc00678f0 0x7f9cc0069e00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9cd40b1000 tx=0x7f9cd40a9070 comp rx=0 tx=0).stop 2024-05-21T14:43:18.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.569+0000 7f9ce5e00640 1 -- 172.21.15.78:0/472575165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0071660 msgr2=0x7f9ce00cb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:18.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.569+0000 7f9ce5e00640 1 --2- 172.21.15.78:0/472575165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0071660 0x7f9ce00cb260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00e8a0 tx=0x7f9ccc00eca0 comp rx=0 tx=0).stop 2024-05-21T14:43:18.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.569+0000 7f9ce5e00640 1 -- 172.21.15.78:0/472575165 shutdown_connections 2024-05-21T14:43:18.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.569+0000 7f9ce5e00640 1 --2- 172.21.15.78:0/472575165 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9cc00678f0 0x7f9cc0069e00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:18.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.569+0000 7f9ce5e00640 1 --2- 172.21.15.78:0/472575165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ce015b6c0 0x7f9ce0072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:18.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.569+0000 7f9ce5e00640 1 --2- 172.21.15.78:0/472575165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ce0071660 0x7f9ce00cb260 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:18.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.569+0000 7f9ce5e00640 1 --2- 172.21.15.78:0/472575165 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9ce006d370 0x7f9ce00c5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:18.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.569+0000 7f9ce5e00640 1 -- 172.21.15.78:0/472575165 >> 172.21.15.78:0/472575165 conn(0x7f9ce006ecd0 msgr2=0x7f9ce0145420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:18.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.573+0000 7f9ce5e00640 1 -- 172.21.15.78:0/472575165 shutdown_connections 2024-05-21T14:43:18.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.573+0000 7f9ce5e00640 1 -- 172.21.15.78:0/472575165 wait complete. 2024-05-21T14:43:18.628 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-21T14:43:18.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.773+0000 7f6424000640 1 Processor -- start 2024-05-21T14:43:18.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.773+0000 7f6424000640 1 -- start start 2024-05-21T14:43:18.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.773+0000 7f6424000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f641c0c8900 0x7f641c0c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:18.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.773+0000 7f6424000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f641c159dc0 0x7f641c0750d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:18.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.773+0000 7f6424000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f641c15cca0 con 0x7f641c074cc0 2024-05-21T14:43:18.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.773+0000 7f6424000640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f641c15d870 con 0x7f641c159dc0 2024-05-21T14:43:18.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.773+0000 7f6424000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f641c0c70e0 con 0x7f641c0c8900 2024-05-21T14:43:18.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.773+0000 7f6422000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f641c159dc0 0x7f641c0750d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:18.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.773+0000 7f6422000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f641c159dc0 0x7f641c0750d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51604/0 (socket says 172.21.15.78:51604) 2024-05-21T14:43:18.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.773+0000 7f6422000640 1 -- 172.21.15.78:0/51218317 learned_addr learned my addr 172.21.15.78:0/51218317 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:18.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.773+0000 7f6421600640 1 --2- 172.21.15.78:0/51218317 >> v2:172.21.15.84:3300/0 conn(0x7f641c0c8900 0x7f641c0c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:18.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.773+0000 7f6422000640 1 -- 172.21.15.78:0/51218317 >> v2:172.21.15.84:3300/0 conn(0x7f641c0c8900 msgr2=0x7f641c0c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:18.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.773+0000 7f6422000640 1 --2- 172.21.15.78:0/51218317 >> v2:172.21.15.84:3300/0 conn(0x7f641c0c8900 0x7f641c0c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:18.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.773+0000 7f6422000640 1 -- 172.21.15.78:0/51218317 >> v1:172.21.15.84:6789/0 conn(0x7f641c074cc0 legacy=0x7f641c1596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:18.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.773+0000 7f6422000640 1 -- 172.21.15.78:0/51218317 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641c15cf40 con 0x7f641c159dc0 2024-05-21T14:43:18.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.777+0000 7f6422000640 1 --2- 172.21.15.78:0/51218317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f641c159dc0 0x7f641c0750d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f641c0733f0 tx=0x7f641401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f66cf714ff4018 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:18.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.777+0000 7f641be00640 1 -- 172.21.15.78:0/51218317 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64140b5070 con 0x7f641c159dc0 2024-05-21T14:43:18.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.777+0000 7f641be00640 1 -- 172.21.15.78:0/51218317 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64140a89d0 con 0x7f641c159dc0 2024-05-21T14:43:18.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.777+0000 7f641be00640 1 -- 172.21.15.78:0/51218317 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64140a8da0 con 0x7f641c159dc0 2024-05-21T14:43:18.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.777+0000 7f6424000640 1 -- 172.21.15.78:0/51218317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f641c159dc0 msgr2=0x7f641c0750d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:18.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.777+0000 7f6424000640 1 --2- 172.21.15.78:0/51218317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f641c159dc0 0x7f641c0750d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f641c0733f0 tx=0x7f641401ecd0 comp rx=0 tx=0).stop 2024-05-21T14:43:18.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.777+0000 7f6424000640 1 -- 172.21.15.78:0/51218317 shutdown_connections 2024-05-21T14:43:18.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.777+0000 7f6424000640 1 --2- 172.21.15.78:0/51218317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f641c159dc0 0x7f641c0750d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:18.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.777+0000 7f6424000640 1 --2- 172.21.15.78:0/51218317 >> v2:172.21.15.84:3300/0 conn(0x7f641c0c8900 0x7f641c0c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:18.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.777+0000 7f6424000640 1 -- 172.21.15.78:0/51218317 >> 172.21.15.78:0/51218317 conn(0x7f641c0cb4e0 msgr2=0x7f641c0cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:18.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.777+0000 7f6424000640 1 -- 172.21.15.78:0/51218317 shutdown_connections 2024-05-21T14:43:18.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.777+0000 7f6424000640 1 -- 172.21.15.78:0/51218317 wait complete. 2024-05-21T14:43:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.781+0000 7f6424000640 1 Processor -- start 2024-05-21T14:43:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.781+0000 7f6424000640 1 -- start start 2024-05-21T14:43:18.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.781+0000 7f6424000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f641c074cc0 0x7f641c1f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:18.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.781+0000 7f6424000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f641c0c8900 0x7f641c0cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:18.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.781+0000 7f6424000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f641c159dc0 0x7f641c159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:18.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.781+0000 7f6424000640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f641c0c6d20 con 0x7f641c074cc0 2024-05-21T14:43:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.781+0000 7f6424000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f641c15d500 con 0x7f641c159dc0 2024-05-21T14:43:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.781+0000 7f6424000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f641c0c6ea0 con 0x7f641c0c8900 2024-05-21T14:43:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.781+0000 7f6421600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f641c074cc0 0x7f641c1f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.781+0000 7f6421600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f641c074cc0 0x7f641c1f6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51620/0 (socket says 172.21.15.78:51620) 2024-05-21T14:43:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.781+0000 7f6421600640 1 -- 172.21.15.78:0/875876339 learned_addr learned my addr 172.21.15.78:0/875876339 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.781+0000 7f6420c00640 1 --2- 172.21.15.78:0/875876339 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f641c0c8900 0x7f641c0cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.781+0000 7f6422000640 1 --2- 172.21.15.78:0/875876339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f641c159dc0 0x7f641c159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.785+0000 7f6421600640 1 -- 172.21.15.78:0/875876339 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f641c0c8900 msgr2=0x7f641c0cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.785+0000 7f6421600640 1 --2- 172.21.15.78:0/875876339 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f641c0c8900 0x7f641c0cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.785+0000 7f6421600640 1 -- 172.21.15.78:0/875876339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f641c159dc0 msgr2=0x7f641c159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.785+0000 7f6421600640 1 --2- 172.21.15.78:0/875876339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f641c159dc0 0x7f641c159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.785+0000 7f6421600640 1 -- 172.21.15.78:0/875876339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641c06dc30 con 0x7f641c074cc0 2024-05-21T14:43:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.785+0000 7f6421600640 1 --2- 172.21.15.78:0/875876339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f641c074cc0 0x7f641c1f6300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6410007e70 tx=0x7f641000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.785+0000 7f6419600640 1 -- 172.21.15.78:0/875876339 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410014620 con 0x7f641c074cc0 2024-05-21T14:43:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.785+0000 7f6419600640 1 -- 172.21.15.78:0/875876339 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6410019070 con 0x7f641c074cc0 2024-05-21T14:43:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.785+0000 7f6424000640 1 -- 172.21.15.78:0/875876339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641c06e1b0 con 0x7f641c074cc0 2024-05-21T14:43:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.785+0000 7f6419600640 1 -- 172.21.15.78:0/875876339 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410014a00 con 0x7f641c074cc0 2024-05-21T14:43:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.785+0000 7f6424000640 1 -- 172.21.15.78:0/875876339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f641c1f5b00 con 0x7f641c074cc0 2024-05-21T14:43:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.785+0000 7f6424000640 1 -- 172.21.15.78:0/875876339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f641c04f730 con 0x7f641c074cc0 2024-05-21T14:43:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.785+0000 7f6419600640 1 -- 172.21.15.78:0/875876339 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6410014ba0 con 0x7f641c074cc0 2024-05-21T14:43:18.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.785+0000 7f6419600640 1 --2- 172.21.15.78:0/875876339 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f63fc0678f0 0x7f63fc069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:18.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.789+0000 7f6419600640 1 -- 172.21.15.78:0/875876339 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f64100865a0 con 0x7f641c074cc0 2024-05-21T14:43:18.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.789+0000 7f6420c00640 1 --2- 172.21.15.78:0/875876339 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f63fc0678f0 0x7f63fc069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:18.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.789+0000 7f6420c00640 1 --2- 172.21.15.78:0/875876339 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f63fc0678f0 0x7f63fc069e00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f641c0759a0 tx=0x7f6408008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:18.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.793+0000 7f6419600640 1 -- 172.21.15.78:0/875876339 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f6410011260 con 0x7f641c074cc0 2024-05-21T14:43:18.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:18.981+0000 7f6424000640 1 -- 172.21.15.78:0/875876339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f641c0c8020 con 0x7f641c074cc0 2024-05-21T14:43:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.569+0000 7f6419600640 1 -- 172.21.15.78:0/875876339 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f6410057010 con 0x7f641c074cc0 2024-05-21T14:43:19.578 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 2 and data pool 3 2024-05-21T14:43:19.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.573+0000 7f6424000640 1 -- 172.21.15.78:0/875876339 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f63fc0678f0 msgr2=0x7f63fc069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:19.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.573+0000 7f6424000640 1 --2- 172.21.15.78:0/875876339 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f63fc0678f0 0x7f63fc069e00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f641c0759a0 tx=0x7f6408008040 comp rx=0 tx=0).stop 2024-05-21T14:43:19.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.573+0000 7f6424000640 1 -- 172.21.15.78:0/875876339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f641c074cc0 msgr2=0x7f641c1f6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:19.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.573+0000 7f6424000640 1 --2- 172.21.15.78:0/875876339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f641c074cc0 0x7f641c1f6300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6410007e70 tx=0x7f641000e4b0 comp rx=0 tx=0).stop 2024-05-21T14:43:19.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.573+0000 7f6424000640 1 -- 172.21.15.78:0/875876339 shutdown_connections 2024-05-21T14:43:19.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.573+0000 7f6424000640 1 --2- 172.21.15.78:0/875876339 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f63fc0678f0 0x7f63fc069e00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:19.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.573+0000 7f6424000640 1 --2- 172.21.15.78:0/875876339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f641c159dc0 0x7f641c159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:19.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.573+0000 7f6424000640 1 --2- 172.21.15.78:0/875876339 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f641c0c8900 0x7f641c0cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:19.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.573+0000 7f6424000640 1 --2- 172.21.15.78:0/875876339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f641c074cc0 0x7f641c1f6300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:19.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.573+0000 7f6424000640 1 -- 172.21.15.78:0/875876339 >> 172.21.15.78:0/875876339 conn(0x7f641c0cb4e0 msgr2=0x7f641c073480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:19.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.573+0000 7f6424000640 1 -- 172.21.15.78:0/875876339 shutdown_connections 2024-05-21T14:43:19.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.573+0000 7f6424000640 1 -- 172.21.15.78:0/875876339 wait complete. 2024-05-21T14:43:19.621 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:43:19.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.765+0000 7fa1f2600640 1 Processor -- start 2024-05-21T14:43:19.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.765+0000 7fa1f2600640 1 -- start start 2024-05-21T14:43:19.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.765+0000 7fa1f2600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa1ec1529d0 0x7fa1ec072e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:19.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.765+0000 7fa1f2600640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa1ec0723f0 0x7fa1ec162e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:19.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.765+0000 7fa1f2600640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1ec073380 con 0x7fa1ec071fe0 2024-05-21T14:43:19.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.769+0000 7fa1f2600640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fa1ec0715f0 con 0x7fa1ec0723f0 2024-05-21T14:43:19.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.769+0000 7fa1f2600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa1ec072b80 con 0x7fa1ec1529d0 2024-05-21T14:43:19.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.769+0000 7fa1ebe00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa1ec0723f0 0x7fa1ec162e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:19.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.769+0000 7fa1e2a00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa1ec071fe0 0x7fa1ec0c5640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:46866/0 (socket says 172.21.15.78:46866) 2024-05-21T14:43:19.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.769+0000 7fa1e2a00640 1 -- 172.21.15.78:0/2043862897 learned_addr learned my addr 172.21.15.78:0/2043862897 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:19.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.769+0000 7fa1eb400640 1 --2- 172.21.15.78:0/2043862897 >> v2:172.21.15.84:3300/0 conn(0x7fa1ec1529d0 0x7fa1ec072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:19.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.769+0000 7fa1ebe00640 1 -- 172.21.15.78:0/2043862897 >> v2:172.21.15.84:3300/0 conn(0x7fa1ec1529d0 msgr2=0x7fa1ec072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:19.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.769+0000 7fa1ebe00640 1 --2- 172.21.15.78:0/2043862897 >> v2:172.21.15.84:3300/0 conn(0x7fa1ec1529d0 0x7fa1ec072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:19.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.769+0000 7fa1ebe00640 1 -- 172.21.15.78:0/2043862897 >> v1:172.21.15.78:6789/0 conn(0x7fa1ec071fe0 legacy=0x7fa1ec0c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:19.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.769+0000 7fa1ebe00640 1 -- 172.21.15.78:0/2043862897 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ec0c8530 con 0x7fa1ec0723f0 2024-05-21T14:43:19.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.769+0000 7fa1ebe00640 1 --2- 172.21.15.78:0/2043862897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1ec0723f0 0x7fa1ec162e80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0c4ff0 tx=0x7fa1e401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db30ce32d5a32511 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:19.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.769+0000 7fa1eaa00640 1 -- 172.21.15.78:0/2043862897 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e40b2070 con 0x7fa1ec0723f0 2024-05-21T14:43:19.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.769+0000 7fa1eaa00640 1 -- 172.21.15.78:0/2043862897 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e40a57f0 con 0x7fa1ec0723f0 2024-05-21T14:43:19.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.769+0000 7fa1eaa00640 1 -- 172.21.15.78:0/2043862897 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e40a5bc0 con 0x7fa1ec0723f0 2024-05-21T14:43:19.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.773+0000 7fa1f2600640 1 -- 172.21.15.78:0/2043862897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1ec0723f0 msgr2=0x7fa1ec162e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:19.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.773+0000 7fa1f2600640 1 --2- 172.21.15.78:0/2043862897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1ec0723f0 0x7fa1ec162e80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0c4ff0 tx=0x7fa1e401c930 comp rx=0 tx=0).stop 2024-05-21T14:43:19.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.773+0000 7fa1f2600640 1 -- 172.21.15.78:0/2043862897 shutdown_connections 2024-05-21T14:43:19.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.773+0000 7fa1f2600640 1 --2- 172.21.15.78:0/2043862897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1ec0723f0 0x7fa1ec162e80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:19.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.773+0000 7fa1f2600640 1 --2- 172.21.15.78:0/2043862897 >> v2:172.21.15.84:3300/0 conn(0x7fa1ec1529d0 0x7fa1ec072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:19.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.773+0000 7fa1f2600640 1 -- 172.21.15.78:0/2043862897 >> 172.21.15.78:0/2043862897 conn(0x7fa1ec0c9380 msgr2=0x7fa1ec0c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:19.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.773+0000 7fa1f2600640 1 -- 172.21.15.78:0/2043862897 shutdown_connections 2024-05-21T14:43:19.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.773+0000 7fa1f2600640 1 -- 172.21.15.78:0/2043862897 wait complete. 2024-05-21T14:43:19.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.773+0000 7fa1f2600640 1 Processor -- start 2024-05-21T14:43:19.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.773+0000 7fa1f2600640 1 -- start start 2024-05-21T14:43:19.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1f2600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1ec071fe0 0x7fa1ec1f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:19.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1f2600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1ec0723f0 0x7fa1ec1551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:19.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1f2600640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa1ec1529d0 0x7fa1ec1434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:19.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1f2600640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ec0c5ed0 con 0x7fa1ec071fe0 2024-05-21T14:43:19.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1f2600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ec0c5d50 con 0x7fa1ec0723f0 2024-05-21T14:43:19.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1f2600640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa1ec0c38a0 con 0x7fa1ec1529d0 2024-05-21T14:43:19.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1eb400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1ec071fe0 0x7fa1ec1f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:19.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1eb400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1ec071fe0 0x7fa1ec1f4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51652/0 (socket says 172.21.15.78:51652) 2024-05-21T14:43:19.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1eb400640 1 -- 172.21.15.78:0/545688031 learned_addr learned my addr 172.21.15.78:0/545688031 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:19.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1e2a00640 1 --2- 172.21.15.78:0/545688031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1ec0723f0 0x7fa1ec1551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:19.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1ebe00640 1 --2- 172.21.15.78:0/545688031 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa1ec1529d0 0x7fa1ec1434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:19.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1eb400640 1 -- 172.21.15.78:0/545688031 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa1ec1529d0 msgr2=0x7fa1ec1434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:19.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1eb400640 1 --2- 172.21.15.78:0/545688031 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa1ec1529d0 0x7fa1ec1434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:19.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1eb400640 1 -- 172.21.15.78:0/545688031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1ec0723f0 msgr2=0x7fa1ec1551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:19.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1eb400640 1 --2- 172.21.15.78:0/545688031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1ec0723f0 0x7fa1ec1551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:19.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1eb400640 1 -- 172.21.15.78:0/545688031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ec1556f0 con 0x7fa1ec071fe0 2024-05-21T14:43:19.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1eb400640 1 --2- 172.21.15.78:0/545688031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1ec071fe0 0x7fa1ec1f4860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00d620 tx=0x7fa1dc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:19.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1e3e00640 1 -- 172.21.15.78:0/545688031 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc00b620 con 0x7fa1ec071fe0 2024-05-21T14:43:19.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1e3e00640 1 -- 172.21.15.78:0/545688031 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1dc019070 con 0x7fa1ec071fe0 2024-05-21T14:43:19.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1f2600640 1 -- 172.21.15.78:0/545688031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1ec154110 con 0x7fa1ec071fe0 2024-05-21T14:43:19.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1e3e00640 1 -- 172.21.15.78:0/545688031 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc00b9e0 con 0x7fa1ec071fe0 2024-05-21T14:43:19.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1f2600640 1 -- 172.21.15.78:0/545688031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1ec1546d0 con 0x7fa1ec071fe0 2024-05-21T14:43:19.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1f2600640 1 -- 172.21.15.78:0/545688031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1ec04f730 con 0x7fa1ec071fe0 2024-05-21T14:43:19.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.777+0000 7fa1e3e00640 1 -- 172.21.15.78:0/545688031 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa1dc00bb80 con 0x7fa1ec071fe0 2024-05-21T14:43:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.781+0000 7fa1e3e00640 1 --2- 172.21.15.78:0/545688031 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa1c80678c0 0x7fa1c8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.781+0000 7fa1e3e00640 1 -- 172.21.15.78:0/545688031 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa1dc086120 con 0x7fa1ec071fe0 2024-05-21T14:43:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.781+0000 7fa1e2a00640 1 --2- 172.21.15.78:0/545688031 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa1c80678c0 0x7fa1c8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:19.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.781+0000 7fa1e2a00640 1 --2- 172.21.15.78:0/545688031 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa1c80678c0 0x7fa1c8069dd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0ca380 tx=0x7fa1d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:19.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.785+0000 7fa1e3e00640 1 -- 172.21.15.78:0/545688031 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa1dc056bd0 con 0x7fa1ec071fe0 2024-05-21T14:43:19.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.941+0000 7fa1f2600640 1 -- 172.21.15.78:0/545688031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1ec14fd20 con 0x7fa1ec071fe0 2024-05-21T14:43:19.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.941+0000 7fa1e3e00640 1 -- 172.21.15.78:0/545688031 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16550 (secure 0 0 0) 0x7fa1dc0564d0 con 0x7fa1ec071fe0 2024-05-21T14:43:19.950 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:19.950 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:18.985153+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T14:43:17.088549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T14:43:18.012571+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:43:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.945+0000 7fa1f2600640 1 -- 172.21.15.78:0/545688031 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa1c80678c0 msgr2=0x7fa1c8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.945+0000 7fa1f2600640 1 --2- 172.21.15.78:0/545688031 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa1c80678c0 0x7fa1c8069dd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0ca380 tx=0x7fa1d4009040 comp rx=0 tx=0).stop 2024-05-21T14:43:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.945+0000 7fa1f2600640 1 -- 172.21.15.78:0/545688031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1ec071fe0 msgr2=0x7fa1ec1f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.945+0000 7fa1f2600640 1 --2- 172.21.15.78:0/545688031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1ec071fe0 0x7fa1ec1f4860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00d620 tx=0x7fa1dc00dae0 comp rx=0 tx=0).stop 2024-05-21T14:43:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.945+0000 7fa1f2600640 1 -- 172.21.15.78:0/545688031 shutdown_connections 2024-05-21T14:43:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.945+0000 7fa1f2600640 1 --2- 172.21.15.78:0/545688031 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa1c80678c0 0x7fa1c8069dd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.945+0000 7fa1f2600640 1 --2- 172.21.15.78:0/545688031 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa1ec1529d0 0x7fa1ec1434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.945+0000 7fa1f2600640 1 --2- 172.21.15.78:0/545688031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1ec0723f0 0x7fa1ec1551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.945+0000 7fa1f2600640 1 --2- 172.21.15.78:0/545688031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1ec071fe0 0x7fa1ec1f4860 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.945+0000 7fa1f2600640 1 -- 172.21.15.78:0/545688031 >> 172.21.15.78:0/545688031 conn(0x7fa1ec0c9380 msgr2=0x7fa1ec06ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.945+0000 7fa1f2600640 1 -- 172.21.15.78:0/545688031 shutdown_connections 2024-05-21T14:43:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:19.945+0000 7fa1f2600640 1 -- 172.21.15.78:0/545688031 wait complete. 2024-05-21T14:43:19.971 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:43:20.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.109+0000 7f472e800640 1 Processor -- start 2024-05-21T14:43:20.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.109+0000 7f472e800640 1 -- start start 2024-05-21T14:43:20.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.113+0000 7f472e800640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f47280c6760 0x7f47280c7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:20.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.113+0000 7f472e800640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4728153cd0 con 0x7f4728159f20 2024-05-21T14:43:20.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.113+0000 7f472e800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f472815cdf0 con 0x7f47280736d0 2024-05-21T14:43:20.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.113+0000 7f472e800640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f472815cbb0 con 0x7f47280c6760 2024-05-21T14:43:20.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.113+0000 7f4727400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f47280c6760 0x7f47280c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:20.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.113+0000 7f4727e00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4728159f20 0x7f4728163f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:46878/0 (socket says 172.21.15.78:46878) 2024-05-21T14:43:20.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.113+0000 7f4727e00640 1 -- 172.21.15.78:0/2043255112 learned_addr learned my addr 172.21.15.78:0/2043255112 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:20.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.113+0000 7f4727400640 1 -- 172.21.15.78:0/2043255112 >> v1:172.21.15.84:6789/0 conn(0x7f47280736d0 legacy=0x7f4728159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:20.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.113+0000 7f4727400640 1 -- 172.21.15.78:0/2043255112 >> v1:172.21.15.78:6789/0 conn(0x7f4728159f20 legacy=0x7f4728163f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:20.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.113+0000 7f4727400640 1 -- 172.21.15.78:0/2043255112 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472815d0d0 con 0x7f47280c6760 2024-05-21T14:43:20.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.113+0000 7f4726a00640 1 -- 172.21.15.78:0/2043255112 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242515847 0 0) 0x7f4728153cd0 con 0x7f4728159f20 2024-05-21T14:43:20.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.117+0000 7f4727400640 1 --2- 172.21.15.78:0/2043255112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47280c6760 0x7f47280c7310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4718009d90 tx=0x7f471801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3b672f2efa97d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:20.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.117+0000 7f4726a00640 1 -- 172.21.15.78:0/2043255112 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47180b2070 con 0x7f47280c6760 2024-05-21T14:43:20.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.117+0000 7f4726a00640 1 -- 172.21.15.78:0/2043255112 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47180a5830 con 0x7f47280c6760 2024-05-21T14:43:20.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.117+0000 7f4726a00640 1 -- 172.21.15.78:0/2043255112 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47180a5c00 con 0x7f47280c6760 2024-05-21T14:43:20.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.117+0000 7f472e800640 1 -- 172.21.15.78:0/2043255112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47280c6760 msgr2=0x7f47280c7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:20.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.117+0000 7f472e800640 1 --2- 172.21.15.78:0/2043255112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47280c6760 0x7f47280c7310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4718009d90 tx=0x7f471801c970 comp rx=0 tx=0).stop 2024-05-21T14:43:20.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.117+0000 7f472e800640 1 -- 172.21.15.78:0/2043255112 shutdown_connections 2024-05-21T14:43:20.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.117+0000 7f472e800640 1 --2- 172.21.15.78:0/2043255112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47280c6760 0x7f47280c7310 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:20.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.117+0000 7f472e800640 1 -- 172.21.15.78:0/2043255112 >> 172.21.15.78:0/2043255112 conn(0x7f47280c9380 msgr2=0x7f47280c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:20.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.117+0000 7f472e800640 1 -- 172.21.15.78:0/2043255112 shutdown_connections 2024-05-21T14:43:20.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.117+0000 7f472e800640 1 -- 172.21.15.78:0/2043255112 wait complete. 2024-05-21T14:43:20.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.117+0000 7f472e800640 1 Processor -- start 2024-05-21T14:43:20.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.117+0000 7f472e800640 1 -- start start 2024-05-21T14:43:20.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f472e800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f47280736d0 0x7f472813f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:20.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f472e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47280c6760 0x7f4728148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:20.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f472e800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728159f20 0x7f47281485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:20.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f472e800640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f47280c7850 con 0x7f4728159f20 2024-05-21T14:43:20.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f472e800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f472815da00 con 0x7f47280c6760 2024-05-21T14:43:20.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f472e800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f47280c79d0 con 0x7f47280736d0 2024-05-21T14:43:20.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f4727e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728159f20 0x7f47281485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:20.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f4727e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728159f20 0x7f47281485b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51660/0 (socket says 172.21.15.78:51660) 2024-05-21T14:43:20.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f4727e00640 1 -- 172.21.15.78:0/3545354194 learned_addr learned my addr 172.21.15.78:0/3545354194 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:20.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f4727400640 1 --2- 172.21.15.78:0/3545354194 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f47280736d0 0x7f472813f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:20.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f471ea00640 1 --2- 172.21.15.78:0/3545354194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47280c6760 0x7f4728148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:20.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f4727e00640 1 -- 172.21.15.78:0/3545354194 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f47280736d0 msgr2=0x7f472813f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:20.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f4727e00640 1 --2- 172.21.15.78:0/3545354194 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f47280736d0 0x7f472813f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:20.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f4727e00640 1 -- 172.21.15.78:0/3545354194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47280c6760 msgr2=0x7f4728148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:20.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f4727e00640 1 --2- 172.21.15.78:0/3545354194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47280c6760 0x7f4728148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:20.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f4727e00640 1 -- 172.21.15.78:0/3545354194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472815c010 con 0x7f4728159f20 2024-05-21T14:43:20.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f4727400640 1 --2- 172.21.15.78:0/3545354194 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f47280736d0 0x7f472813f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:20.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f4727e00640 1 --2- 172.21.15.78:0/3545354194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728159f20 0x7f47281485b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f472000c410 tx=0x7f472000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f471fe00640 1 -- 172.21.15.78:0/3545354194 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47200074e0 con 0x7f4728159f20 2024-05-21T14:43:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f471fe00640 1 -- 172.21.15.78:0/3545354194 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47200047f0 con 0x7f4728159f20 2024-05-21T14:43:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f471fe00640 1 -- 172.21.15.78:0/3545354194 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720007680 con 0x7f4728159f20 2024-05-21T14:43:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f472e800640 1 -- 172.21.15.78:0/3545354194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f472815c2f0 con 0x7f4728159f20 2024-05-21T14:43:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f472e800640 1 -- 172.21.15.78:0/3545354194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4728143640 con 0x7f4728159f20 2024-05-21T14:43:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.121+0000 7f472e800640 1 -- 172.21.15.78:0/3545354194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f472815c530 con 0x7f4728159f20 2024-05-21T14:43:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.125+0000 7f471fe00640 1 -- 172.21.15.78:0/3545354194 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4720011070 con 0x7f4728159f20 2024-05-21T14:43:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.125+0000 7f471fe00640 1 --2- 172.21.15.78:0/3545354194 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f47040678f0 0x7f4704069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.125+0000 7f471fe00640 1 -- 172.21.15.78:0/3545354194 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4720085790 con 0x7f4728159f20 2024-05-21T14:43:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.125+0000 7f4727400640 1 --2- 172.21.15.78:0/3545354194 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f47040678f0 0x7f4704069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:20.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.125+0000 7f4727400640 1 --2- 172.21.15.78:0/3545354194 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f47040678f0 0x7f4704069e00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f47180af000 tx=0x7f47180a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:20.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.129+0000 7f471fe00640 1 -- 172.21.15.78:0/3545354194 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f472815c530 con 0x7f4728159f20 2024-05-21T14:43:20.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.289+0000 7f472e800640 1 -- 172.21.15.78:0/3545354194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4728165430 con 0x7f4728159f20 2024-05-21T14:43:20.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.289+0000 7f471fe00640 1 -- 172.21.15.78:0/3545354194 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16550 (secure 0 0 0) 0x7f47200562c0 con 0x7f4728159f20 2024-05-21T14:43:20.297 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:20.297 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:18.985153+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T14:43:17.088549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T14:43:18.012571+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:43:20.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.293+0000 7f472e800640 1 -- 172.21.15.78:0/3545354194 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f47040678f0 msgr2=0x7f4704069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:20.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.293+0000 7f472e800640 1 --2- 172.21.15.78:0/3545354194 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f47040678f0 0x7f4704069e00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f47180af000 tx=0x7f47180a7070 comp rx=0 tx=0).stop 2024-05-21T14:43:20.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.293+0000 7f472e800640 1 -- 172.21.15.78:0/3545354194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728159f20 msgr2=0x7f47281485b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:20.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.293+0000 7f472e800640 1 --2- 172.21.15.78:0/3545354194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728159f20 0x7f47281485b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f472000c410 tx=0x7f472000c8d0 comp rx=0 tx=0).stop 2024-05-21T14:43:20.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.293+0000 7f472e800640 1 -- 172.21.15.78:0/3545354194 shutdown_connections 2024-05-21T14:43:20.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.293+0000 7f472e800640 1 --2- 172.21.15.78:0/3545354194 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f47040678f0 0x7f4704069e00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:20.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.293+0000 7f472e800640 1 --2- 172.21.15.78:0/3545354194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728159f20 0x7f47281485b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:20.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.293+0000 7f472e800640 1 --2- 172.21.15.78:0/3545354194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47280c6760 0x7f4728148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:20.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.293+0000 7f472e800640 1 --2- 172.21.15.78:0/3545354194 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f47280736d0 0x7f472813f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:20.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.293+0000 7f472e800640 1 -- 172.21.15.78:0/3545354194 >> 172.21.15.78:0/3545354194 conn(0x7f47280c9380 msgr2=0x7f4728149240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:20.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.293+0000 7f472e800640 1 -- 172.21.15.78:0/3545354194 shutdown_connections 2024-05-21T14:43:20.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.293+0000 7f472e800640 1 -- 172.21.15.78:0/3545354194 wait complete. 2024-05-21T14:43:20.319 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-21T14:43:20.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.461+0000 7f63dac00640 1 Processor -- start 2024-05-21T14:43:20.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.461+0000 7f63dac00640 1 -- start start 2024-05-21T14:43:20.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63dac00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f63d40c5c30 0x7f63d41538d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:20.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63dac00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d40c7240 con 0x7f63d40c6540 2024-05-21T14:43:20.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63dac00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d40c74e0 con 0x7f63d40c7f90 2024-05-21T14:43:20.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63dac00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f63d4153e10 con 0x7f63d40c5c30 2024-05-21T14:43:20.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d8c00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f63d40c6540 0x7f63d40735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:46880/0 (socket says 172.21.15.78:46880) 2024-05-21T14:43:20.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d8c00640 1 -- 172.21.15.78:0/2502664365 learned_addr learned my addr 172.21.15.78:0/2502664365 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:20.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d3e00640 1 --2- 172.21.15.78:0/2502664365 >> v2:172.21.15.84:3300/0 conn(0x7f63d40c5c30 0x7f63d41538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:20.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d3400640 1 -- 172.21.15.78:0/2502664365 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4020471641 0 0) 0x7f63d40c7240 con 0x7f63d40c6540 2024-05-21T14:43:20.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d3400640 1 -- 172.21.15.78:0/2502664365 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63b8003530 con 0x7f63d40c6540 2024-05-21T14:43:20.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d3400640 1 -- 172.21.15.78:0/2502664365 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4168301845 0 0) 0x7f63b8003530 con 0x7f63d40c6540 2024-05-21T14:43:20.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d3400640 1 -- 172.21.15.78:0/2502664365 >> v2:172.21.15.84:3300/0 conn(0x7f63d40c5c30 msgr2=0x7f63d41538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:20.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d3400640 1 --2- 172.21.15.78:0/2502664365 >> v2:172.21.15.84:3300/0 conn(0x7f63d40c5c30 0x7f63d41538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:20.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d3400640 1 -- 172.21.15.78:0/2502664365 >> v1:172.21.15.84:6789/0 conn(0x7f63d40c7f90 legacy=0x7f63d415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:20.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d3400640 1 -- 172.21.15.78:0/2502664365 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d40c77c0 con 0x7f63d40c6540 2024-05-21T14:43:20.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d3400640 1 -- 172.21.15.78:0/2502664365 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7f63cc001680 con 0x7f63d40c6540 2024-05-21T14:43:20.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d3400640 1 -- 172.21.15.78:0/2502664365 >> v1:172.21.15.78:6789/0 conn(0x7f63d40c6540 legacy=0x7f63d40735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:20.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d3400640 1 --2- 172.21.15.78:0/2502664365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b8003a30 0x7f63b8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:20.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d3400640 1 --2- 172.21.15.78:0/2502664365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b8004810 0x7f63b8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:20.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d3400640 1 --2- 172.21.15.78:0/2502664365 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b8005230 0x7f63b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:20.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d3400640 1 -- 172.21.15.78:0/2502664365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f63d4153e10 con 0x7f63b8004810 2024-05-21T14:43:20.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d3400640 1 -- 172.21.15.78:0/2502664365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f63b800c1c0 con 0x7f63b8003a30 2024-05-21T14:43:20.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d3400640 1 -- 172.21.15.78:0/2502664365 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f63b800c3c0 con 0x7f63b8005230 2024-05-21T14:43:20.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63cb400640 1 --2- 172.21.15.78:0/2502664365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b8004810 0x7f63b8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:20.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d3e00640 1 --2- 172.21.15.78:0/2502664365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b8003a30 0x7f63b8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:20.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d8c00640 1 --2- 172.21.15.78:0/2502664365 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b8005230 0x7f63b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:20.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63cb400640 1 -- 172.21.15.78:0/2502664365 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b8005230 msgr2=0x7f63b800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:20.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63cb400640 1 --2- 172.21.15.78:0/2502664365 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b8005230 0x7f63b800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:20.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63cb400640 1 -- 172.21.15.78:0/2502664365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b8003a30 msgr2=0x7f63b8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:20.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63cb400640 1 --2- 172.21.15.78:0/2502664365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b8003a30 0x7f63b8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:20.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63cb400640 1 -- 172.21.15.78:0/2502664365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b8003530 con 0x7f63b8004810 2024-05-21T14:43:20.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.465+0000 7f63d8c00640 1 -- 172.21.15.78:0/2502664365 reap_dead start 2024-05-21T14:43:20.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.469+0000 7f63cb400640 1 --2- 172.21.15.78:0/2502664365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b8004810 0x7f63b8004c20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f63bc001750 tx=0x7f63bc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36dfae46d2d7711c server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:20.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.469+0000 7f63d3400640 1 -- 172.21.15.78:0/2502664365 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63bc0013a0 con 0x7f63b8004810 2024-05-21T14:43:20.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.469+0000 7f63d3400640 1 -- 172.21.15.78:0/2502664365 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63bc0052f0 con 0x7f63b8004810 2024-05-21T14:43:20.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.469+0000 7f63d3400640 1 -- 172.21.15.78:0/2502664365 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63bc003840 con 0x7f63b8004810 2024-05-21T14:43:20.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.469+0000 7f63dac00640 1 -- 172.21.15.78:0/2502664365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b8004810 msgr2=0x7f63b8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:20.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.469+0000 7f63dac00640 1 --2- 172.21.15.78:0/2502664365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b8004810 0x7f63b8004c20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f63bc001750 tx=0x7f63bc01c3e0 comp rx=0 tx=0).stop 2024-05-21T14:43:20.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.469+0000 7f63dac00640 1 -- 172.21.15.78:0/2502664365 shutdown_connections 2024-05-21T14:43:20.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.469+0000 7f63dac00640 1 --2- 172.21.15.78:0/2502664365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b8004810 0x7f63b8004c20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:20.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.469+0000 7f63dac00640 1 -- 172.21.15.78:0/2502664365 >> 172.21.15.78:0/2502664365 conn(0x7f63d40cd1e0 msgr2=0x7f63d40c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:20.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.469+0000 7f63dac00640 1 -- 172.21.15.78:0/2502664365 shutdown_connections 2024-05-21T14:43:20.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.469+0000 7f63dac00640 1 -- 172.21.15.78:0/2502664365 wait complete. 2024-05-21T14:43:20.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.469+0000 7f63dac00640 1 Processor -- start 2024-05-21T14:43:20.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63dac00640 1 -- start start 2024-05-21T14:43:20.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63dac00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b8004810 0x7f63d4148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:20.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63dac00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d41f2360 0x7f63d41440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:20.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63dac00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63d4144600 0x7f63d4149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:20.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63dac00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f63d40c48a0 con 0x7f63d41f2360 2024-05-21T14:43:20.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63dac00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f63d40c4370 con 0x7f63b8004810 2024-05-21T14:43:20.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63dac00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f63d40c6950 con 0x7f63d4144600 2024-05-21T14:43:20.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63cb400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d41f2360 0x7f63d41440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:20.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63cb400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d41f2360 0x7f63d41440c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51678/0 (socket says 172.21.15.78:51678) 2024-05-21T14:43:20.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63cb400640 1 -- 172.21.15.78:0/656700534 learned_addr learned my addr 172.21.15.78:0/656700534 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:20.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63d3e00640 1 --2- 172.21.15.78:0/656700534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b8004810 0x7f63d4148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:20.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63d8c00640 1 --2- 172.21.15.78:0/656700534 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63d4144600 0x7f63d4149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:20.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63cb400640 1 -- 172.21.15.78:0/656700534 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63d4144600 msgr2=0x7f63d4149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:20.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63cb400640 1 --2- 172.21.15.78:0/656700534 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63d4144600 0x7f63d4149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:20.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63cb400640 1 -- 172.21.15.78:0/656700534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b8004810 msgr2=0x7f63d4148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:20.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63cb400640 1 --2- 172.21.15.78:0/656700534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b8004810 0x7f63d4148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:20.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63cb400640 1 -- 172.21.15.78:0/656700534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d41f5d90 con 0x7f63d41f2360 2024-05-21T14:43:20.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63cb400640 1 --2- 172.21.15.78:0/656700534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d41f2360 0x7f63d41440c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f63bc01c210 tx=0x7f63b8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:20.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63d0c00640 1 -- 172.21.15.78:0/656700534 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63bc0013a0 con 0x7f63d41f2360 2024-05-21T14:43:20.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63d0c00640 1 -- 172.21.15.78:0/656700534 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63bc0ba070 con 0x7f63d41f2360 2024-05-21T14:43:20.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63d0c00640 1 -- 172.21.15.78:0/656700534 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63bc007a40 con 0x7f63d41f2360 2024-05-21T14:43:20.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63dac00640 1 -- 172.21.15.78:0/656700534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d4144a10 con 0x7f63d41f2360 2024-05-21T14:43:20.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.473+0000 7f63dac00640 1 -- 172.21.15.78:0/656700534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d41f1e60 con 0x7f63d41f2360 2024-05-21T14:43:20.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.477+0000 7f63dac00640 1 -- 172.21.15.78:0/656700534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d404f730 con 0x7f63d41f2360 2024-05-21T14:43:20.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.477+0000 7f63d0c00640 1 -- 172.21.15.78:0/656700534 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f63bc007490 con 0x7f63d41f2360 2024-05-21T14:43:20.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.477+0000 7f63d0c00640 1 --2- 172.21.15.78:0/656700534 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f63b00678f0 0x7f63b0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:20.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.477+0000 7f63d0c00640 1 -- 172.21.15.78:0/656700534 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f63bc11ff40 con 0x7f63d41f2360 2024-05-21T14:43:20.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.477+0000 7f63d3e00640 1 --2- 172.21.15.78:0/656700534 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f63b00678f0 0x7f63b0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:20.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.477+0000 7f63d3e00640 1 --2- 172.21.15.78:0/656700534 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f63b00678f0 0x7f63b0069e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f63c4003c10 tx=0x7f63c400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:20.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.481+0000 7f63d0c00640 1 -- 172.21.15.78:0/656700534 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f63d4144a10 con 0x7f63d41f2360 2024-05-21T14:43:20.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:20.673+0000 7f63dac00640 1 -- 172.21.15.78:0/656700534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f63d40c7b40 con 0x7f63d41f2360 2024-05-21T14:43:21.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.613+0000 7f63d0c00640 1 -- 172.21.15.78:0/656700534 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f63d41f5d90 con 0x7f63d41f2360 2024-05-21T14:43:21.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.617+0000 7f63dac00640 1 -- 172.21.15.78:0/656700534 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f63b00678f0 msgr2=0x7f63b0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:21.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.617+0000 7f63dac00640 1 --2- 172.21.15.78:0/656700534 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f63b00678f0 0x7f63b0069e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f63c4003c10 tx=0x7f63c400b040 comp rx=0 tx=0).stop 2024-05-21T14:43:21.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.617+0000 7f63dac00640 1 -- 172.21.15.78:0/656700534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d41f2360 msgr2=0x7f63d41440c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:21.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.617+0000 7f63dac00640 1 --2- 172.21.15.78:0/656700534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d41f2360 0x7f63d41440c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f63bc01c210 tx=0x7f63b8005840 comp rx=0 tx=0).stop 2024-05-21T14:43:21.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.617+0000 7f63dac00640 1 -- 172.21.15.78:0/656700534 shutdown_connections 2024-05-21T14:43:21.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.617+0000 7f63dac00640 1 --2- 172.21.15.78:0/656700534 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f63b00678f0 0x7f63b0069e00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:21.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.617+0000 7f63dac00640 1 --2- 172.21.15.78:0/656700534 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63d4144600 0x7f63d4149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:21.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.617+0000 7f63dac00640 1 --2- 172.21.15.78:0/656700534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63d41f2360 0x7f63d41440c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:21.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.617+0000 7f63dac00640 1 --2- 172.21.15.78:0/656700534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b8004810 0x7f63d4148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:21.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.617+0000 7f63dac00640 1 -- 172.21.15.78:0/656700534 >> 172.21.15.78:0/656700534 conn(0x7f63d40cd1e0 msgr2=0x7f63d4144cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:21.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.617+0000 7f63dac00640 1 -- 172.21.15.78:0/656700534 shutdown_connections 2024-05-21T14:43:21.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.617+0000 7f63dac00640 1 -- 172.21.15.78:0/656700534 wait complete. 2024-05-21T14:43:21.646 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300} 2024-05-21T14:43:21.647 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-05-21T14:43:21.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.789+0000 7f09bc200640 1 Processor -- start 2024-05-21T14:43:21.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.789+0000 7f09bc200640 1 -- start start 2024-05-21T14:43:21.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.789+0000 7f09bc200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f09b40c5c30 0x7f09b41538d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:21.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.789+0000 7f09bc200640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09b40c7240 con 0x7f09b40c6540 2024-05-21T14:43:21.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.789+0000 7f09bc200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09b40c74e0 con 0x7f09b40c7f90 2024-05-21T14:43:21.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.789+0000 7f09bc200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f09b4153e10 con 0x7f09b40c5c30 2024-05-21T14:43:21.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09ba200640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f09b40c6540 0x7f09b40735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:46894/0 (socket says 172.21.15.78:46894) 2024-05-21T14:43:21.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09ba200640 1 -- 172.21.15.78:0/2011517488 learned_addr learned my addr 172.21.15.78:0/2011517488 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:21.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b9800640 1 --2- 172.21.15.78:0/2011517488 >> v2:172.21.15.84:3300/0 conn(0x7f09b40c5c30 0x7f09b41538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:21.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b3e00640 1 -- 172.21.15.78:0/2011517488 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 816956497 0 0) 0x7f09b40c7240 con 0x7f09b40c6540 2024-05-21T14:43:21.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b3e00640 1 -- 172.21.15.78:0/2011517488 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f099c003530 con 0x7f09b40c6540 2024-05-21T14:43:21.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b3e00640 1 -- 172.21.15.78:0/2011517488 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3701316611 0 0) 0x7f099c003530 con 0x7f09b40c6540 2024-05-21T14:43:21.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b3e00640 1 -- 172.21.15.78:0/2011517488 >> v2:172.21.15.84:3300/0 conn(0x7f09b40c5c30 msgr2=0x7f09b41538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:21.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b3e00640 1 --2- 172.21.15.78:0/2011517488 >> v2:172.21.15.84:3300/0 conn(0x7f09b40c5c30 0x7f09b41538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:21.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b3e00640 1 -- 172.21.15.78:0/2011517488 >> v1:172.21.15.84:6789/0 conn(0x7f09b40c7f90 legacy=0x7f09b415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:21.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b3e00640 1 -- 172.21.15.78:0/2011517488 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b40c77c0 con 0x7f09b40c6540 2024-05-21T14:43:21.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b3e00640 1 -- 172.21.15.78:0/2011517488 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7f09ac001a00 con 0x7f09b40c6540 2024-05-21T14:43:21.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b3e00640 1 -- 172.21.15.78:0/2011517488 >> v1:172.21.15.78:6789/0 conn(0x7f09b40c6540 legacy=0x7f09b40735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:21.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b3e00640 1 --2- 172.21.15.78:0/2011517488 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f099c003a30 0x7f099c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:21.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b3e00640 1 --2- 172.21.15.78:0/2011517488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f099c004810 0x7f099c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:21.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b3e00640 1 --2- 172.21.15.78:0/2011517488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c005230 0x7f099c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:21.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b3e00640 1 -- 172.21.15.78:0/2011517488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f09b4153e10 con 0x7f099c004810 2024-05-21T14:43:21.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b3e00640 1 -- 172.21.15.78:0/2011517488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f099c00c1c0 con 0x7f099c005230 2024-05-21T14:43:21.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b3e00640 1 -- 172.21.15.78:0/2011517488 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f099c00c3c0 con 0x7f099c003a30 2024-05-21T14:43:21.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b8e00640 1 --2- 172.21.15.78:0/2011517488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f099c004810 0x7f099c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:21.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b9800640 1 --2- 172.21.15.78:0/2011517488 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f099c003a30 0x7f099c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:21.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09ba200640 1 --2- 172.21.15.78:0/2011517488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c005230 0x7f099c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:21.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b8e00640 1 -- 172.21.15.78:0/2011517488 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f099c003a30 msgr2=0x7f099c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:21.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b8e00640 1 --2- 172.21.15.78:0/2011517488 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f099c003a30 0x7f099c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:21.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b8e00640 1 -- 172.21.15.78:0/2011517488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c005230 msgr2=0x7f099c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:21.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b8e00640 1 --2- 172.21.15.78:0/2011517488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c005230 0x7f099c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:21.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09b8e00640 1 -- 172.21.15.78:0/2011517488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c003530 con 0x7f099c004810 2024-05-21T14:43:21.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.793+0000 7f09ba200640 1 -- 172.21.15.78:0/2011517488 reap_dead start 2024-05-21T14:43:21.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.797+0000 7f09b8e00640 1 --2- 172.21.15.78:0/2011517488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f099c004810 0x7f099c004c20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f09a0001750 tx=0x7f09a001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f518299ab64a2559 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:21.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.797+0000 7f09b3e00640 1 -- 172.21.15.78:0/2011517488 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a00013a0 con 0x7f099c004810 2024-05-21T14:43:21.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.797+0000 7f09b3e00640 1 -- 172.21.15.78:0/2011517488 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a00052f0 con 0x7f099c004810 2024-05-21T14:43:21.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.797+0000 7f09b3e00640 1 -- 172.21.15.78:0/2011517488 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0003840 con 0x7f099c004810 2024-05-21T14:43:21.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.797+0000 7f09bc200640 1 -- 172.21.15.78:0/2011517488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f099c004810 msgr2=0x7f099c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:21.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.797+0000 7f09bc200640 1 --2- 172.21.15.78:0/2011517488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f099c004810 0x7f099c004c20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f09a0001750 tx=0x7f09a001c3c0 comp rx=0 tx=0).stop 2024-05-21T14:43:21.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.797+0000 7f09bc200640 1 -- 172.21.15.78:0/2011517488 shutdown_connections 2024-05-21T14:43:21.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.797+0000 7f09bc200640 1 --2- 172.21.15.78:0/2011517488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f099c004810 0x7f099c004c20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:21.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.797+0000 7f09bc200640 1 -- 172.21.15.78:0/2011517488 >> 172.21.15.78:0/2011517488 conn(0x7f09b40cd1e0 msgr2=0x7f09b40c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:21.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.797+0000 7f09bc200640 1 -- 172.21.15.78:0/2011517488 shutdown_connections 2024-05-21T14:43:21.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.797+0000 7f09bc200640 1 -- 172.21.15.78:0/2011517488 wait complete. 2024-05-21T14:43:21.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.797+0000 7f09bc200640 1 Processor -- start 2024-05-21T14:43:21.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.797+0000 7f09bc200640 1 -- start start 2024-05-21T14:43:21.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09bc200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c004810 0x7f09b4149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:21.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09bc200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f09b4149b00 0x7f09b41f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:21.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09bc200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09b414c7d0 0x7f09b4148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:21.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09bc200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f09b40c48a0 con 0x7f09b414c7d0 2024-05-21T14:43:21.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09bc200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f09b40c4370 con 0x7f099c004810 2024-05-21T14:43:21.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09bc200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f09b40c6950 con 0x7f09b4149b00 2024-05-21T14:43:21.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09ba200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09b414c7d0 0x7f09b4148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:21.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09ba200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09b414c7d0 0x7f09b4148070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51696/0 (socket says 172.21.15.78:51696) 2024-05-21T14:43:21.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09ba200640 1 -- 172.21.15.78:0/188016387 learned_addr learned my addr 172.21.15.78:0/188016387 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09b9800640 1 --2- 172.21.15.78:0/188016387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c004810 0x7f09b4149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09b8e00640 1 --2- 172.21.15.78:0/188016387 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f09b4149b00 0x7f09b41f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09ba200640 1 -- 172.21.15.78:0/188016387 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f09b4149b00 msgr2=0x7f09b41f57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09ba200640 1 --2- 172.21.15.78:0/188016387 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f09b4149b00 0x7f09b41f57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09ba200640 1 -- 172.21.15.78:0/188016387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c004810 msgr2=0x7f09b4149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09ba200640 1 --2- 172.21.15.78:0/188016387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c004810 0x7f09b4149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09ba200640 1 -- 172.21.15.78:0/188016387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b41f5cf0 con 0x7f09b414c7d0 2024-05-21T14:43:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09b9800640 1 --2- 172.21.15.78:0/188016387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c004810 0x7f09b4149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09b8e00640 1 --2- 172.21.15.78:0/188016387 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f09b4149b00 0x7f09b41f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:21.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09ba200640 1 --2- 172.21.15.78:0/188016387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09b414c7d0 0x7f09b4148070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f09ac000f90 tx=0x7f09ac011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:21.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09b1600640 1 -- 172.21.15.78:0/188016387 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac010040 con 0x7f09b414c7d0 2024-05-21T14:43:21.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09b1600640 1 -- 172.21.15.78:0/188016387 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ac01a070 con 0x7f09b414c7d0 2024-05-21T14:43:21.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09bc200640 1 -- 172.21.15.78:0/188016387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b414bb40 con 0x7f09b414c7d0 2024-05-21T14:43:21.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09b1600640 1 -- 172.21.15.78:0/188016387 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac013a20 con 0x7f09b414c7d0 2024-05-21T14:43:21.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09bc200640 1 -- 172.21.15.78:0/188016387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b41f4fb0 con 0x7f09b414c7d0 2024-05-21T14:43:21.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.801+0000 7f09bc200640 1 -- 172.21.15.78:0/188016387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09b41f4da0 con 0x7f09b414c7d0 2024-05-21T14:43:21.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.805+0000 7f09b1600640 1 -- 172.21.15.78:0/188016387 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f09ac013bc0 con 0x7f09b414c7d0 2024-05-21T14:43:21.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.805+0000 7f09b1600640 1 --2- 172.21.15.78:0/188016387 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f09940678f0 0x7f0994069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:21.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.805+0000 7f09b1600640 1 -- 172.21.15.78:0/188016387 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f09ac088c00 con 0x7f09b414c7d0 2024-05-21T14:43:21.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.805+0000 7f09b9800640 1 --2- 172.21.15.78:0/188016387 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f09940678f0 0x7f0994069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:21.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.805+0000 7f09b9800640 1 --2- 172.21.15.78:0/188016387 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f09940678f0 0x7f0994069e00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f09b406b330 tx=0x7f09a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:21.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.809+0000 7f09b1600640 1 -- 172.21.15.78:0/188016387 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f09ac059610 con 0x7f09b414c7d0 2024-05-21T14:43:22.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:21.997+0000 7f09bc200640 1 -- 172.21.15.78:0/188016387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f09b414b8b0 con 0x7f09b414c7d0 2024-05-21T14:43:22.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.625+0000 7f09b1600640 1 -- 172.21.15.78:0/188016387 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v6) ==== 105+0+0 (secure 0 0 0) 0x7f09ac058f10 con 0x7f09b414c7d0 2024-05-21T14:43:22.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.629+0000 7f09bc200640 1 -- 172.21.15.78:0/188016387 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f09940678f0 msgr2=0x7f0994069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:22.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.629+0000 7f09bc200640 1 --2- 172.21.15.78:0/188016387 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f09940678f0 0x7f0994069e00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f09b406b330 tx=0x7f09a8008040 comp rx=0 tx=0).stop 2024-05-21T14:43:22.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.629+0000 7f09bc200640 1 -- 172.21.15.78:0/188016387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09b414c7d0 msgr2=0x7f09b4148070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:22.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.629+0000 7f09bc200640 1 --2- 172.21.15.78:0/188016387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09b414c7d0 0x7f09b4148070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f09ac000f90 tx=0x7f09ac011a00 comp rx=0 tx=0).stop 2024-05-21T14:43:22.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.629+0000 7f09bc200640 1 -- 172.21.15.78:0/188016387 shutdown_connections 2024-05-21T14:43:22.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.629+0000 7f09bc200640 1 --2- 172.21.15.78:0/188016387 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f09940678f0 0x7f0994069e00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:22.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.629+0000 7f09bc200640 1 --2- 172.21.15.78:0/188016387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09b414c7d0 0x7f09b4148070 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:22.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.629+0000 7f09bc200640 1 --2- 172.21.15.78:0/188016387 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f09b4149b00 0x7f09b41f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:22.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.629+0000 7f09bc200640 1 --2- 172.21.15.78:0/188016387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c004810 0x7f09b4149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:22.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.629+0000 7f09bc200640 1 -- 172.21.15.78:0/188016387 >> 172.21.15.78:0/188016387 conn(0x7f09b40cd1e0 msgr2=0x7f09b40739b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:22.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.629+0000 7f09bc200640 1 -- 172.21.15.78:0/188016387 shutdown_connections 2024-05-21T14:43:22.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.629+0000 7f09bc200640 1 -- 172.21.15.78:0/188016387 wait complete. 2024-05-21T14:43:22.659 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-21T14:43:22.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.805+0000 7fe9dfe00640 1 Processor -- start 2024-05-21T14:43:22.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.805+0000 7fe9dfe00640 1 -- start start 2024-05-21T14:43:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.805+0000 7fe9dfe00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe9d80733d0 0x7fe9d8071910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.805+0000 7fe9dfe00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe9d81527a0 0x7fe9d80c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.805+0000 7fe9dfe00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9d8071e50 con 0x7fe9d80c5980 2024-05-21T14:43:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.805+0000 7fe9dfe00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fe9d8072980 con 0x7fe9d81527a0 2024-05-21T14:43:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.805+0000 7fe9dfe00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fe9d8072f40 con 0x7fe9d80733d0 2024-05-21T14:43:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.805+0000 7fe9dca00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe9d81527a0 0x7fe9d80c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.805+0000 7fe9dde00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe9d80c5980 0x7fe9d815bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:46902/0 (socket says 172.21.15.78:46902) 2024-05-21T14:43:22.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.805+0000 7fe9dde00640 1 -- 172.21.15.78:0/4217305485 learned_addr learned my addr 172.21.15.78:0/4217305485 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.805+0000 7fe9dd400640 1 --2- 172.21.15.78:0/4217305485 >> v2:172.21.15.84:3300/0 conn(0x7fe9d80733d0 0x7fe9d8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.809+0000 7fe9dca00640 1 -- 172.21.15.78:0/4217305485 >> v2:172.21.15.84:3300/0 conn(0x7fe9d80733d0 msgr2=0x7fe9d8071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.809+0000 7fe9dca00640 1 --2- 172.21.15.78:0/4217305485 >> v2:172.21.15.84:3300/0 conn(0x7fe9d80733d0 0x7fe9d8071910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.809+0000 7fe9dca00640 1 -- 172.21.15.78:0/4217305485 >> v1:172.21.15.78:6789/0 conn(0x7fe9d80c5980 legacy=0x7fe9d815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.809+0000 7fe9dca00640 1 -- 172.21.15.78:0/4217305485 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d80737e0 con 0x7fe9d81527a0 2024-05-21T14:43:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.809+0000 7fe9d7e00640 1 -- 172.21.15.78:0/4217305485 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 388541040 0 0) 0x7fe9d8071e50 con 0x7fe9d80c5980 2024-05-21T14:43:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.809+0000 7fe9dca00640 1 --2- 172.21.15.78:0/4217305485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9d81527a0 0x7fe9d80c5440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8072b00 tx=0x7fe9c401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f4a71476392624 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.809+0000 7fe9d7e00640 1 -- 172.21.15.78:0/4217305485 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c40b5070 con 0x7fe9d81527a0 2024-05-21T14:43:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.809+0000 7fe9d7e00640 1 -- 172.21.15.78:0/4217305485 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c40a8950 con 0x7fe9d81527a0 2024-05-21T14:43:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.809+0000 7fe9d7e00640 1 -- 172.21.15.78:0/4217305485 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c40a8d20 con 0x7fe9d81527a0 2024-05-21T14:43:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.813+0000 7fe9dfe00640 1 -- 172.21.15.78:0/4217305485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9d81527a0 msgr2=0x7fe9d80c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.813+0000 7fe9dfe00640 1 --2- 172.21.15.78:0/4217305485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9d81527a0 0x7fe9d80c5440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8072b00 tx=0x7fe9c401ec50 comp rx=0 tx=0).stop 2024-05-21T14:43:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.813+0000 7fe9dfe00640 1 -- 172.21.15.78:0/4217305485 shutdown_connections 2024-05-21T14:43:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.813+0000 7fe9dfe00640 1 --2- 172.21.15.78:0/4217305485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9d81527a0 0x7fe9d80c5440 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.813+0000 7fe9dfe00640 1 --2- 172.21.15.78:0/4217305485 >> v2:172.21.15.84:3300/0 conn(0x7fe9d80733d0 0x7fe9d8071910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.813+0000 7fe9dfe00640 1 -- 172.21.15.78:0/4217305485 >> 172.21.15.78:0/4217305485 conn(0x7fe9d80cd1e0 msgr2=0x7fe9d80c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.813+0000 7fe9dfe00640 1 -- 172.21.15.78:0/4217305485 shutdown_connections 2024-05-21T14:43:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.813+0000 7fe9dfe00640 1 -- 172.21.15.78:0/4217305485 wait complete. 2024-05-21T14:43:22.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.813+0000 7fe9dfe00640 1 Processor -- start 2024-05-21T14:43:22.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.813+0000 7fe9dfe00640 1 -- start start 2024-05-21T14:43:22.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.813+0000 7fe9dfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9d80733d0 0x7fe9d81efe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:22.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.813+0000 7fe9dfe00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9d80c5980 0x7fe9d81e40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:22.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.813+0000 7fe9dfe00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe9d81527a0 0x7fe9d80cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:22.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.813+0000 7fe9dfe00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d8074060 con 0x7fe9d80c5980 2024-05-21T14:43:22.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.813+0000 7fe9dfe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d8073d80 con 0x7fe9d80733d0 2024-05-21T14:43:22.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.813+0000 7fe9dfe00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe9d8072bd0 con 0x7fe9d81527a0 2024-05-21T14:43:22.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.813+0000 7fe9dca00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9d80c5980 0x7fe9d81e40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:22.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.817+0000 7fe9dca00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9d80c5980 0x7fe9d81e40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51714/0 (socket says 172.21.15.78:51714) 2024-05-21T14:43:22.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.817+0000 7fe9dca00640 1 -- 172.21.15.78:0/1071741701 learned_addr learned my addr 172.21.15.78:0/1071741701 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:22.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.817+0000 7fe9dd400640 1 --2- 172.21.15.78:0/1071741701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9d80733d0 0x7fe9d81efe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.817+0000 7fe9dde00640 1 --2- 172.21.15.78:0/1071741701 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe9d81527a0 0x7fe9d80cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.817+0000 7fe9dca00640 1 -- 172.21.15.78:0/1071741701 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe9d81527a0 msgr2=0x7fe9d80cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.817+0000 7fe9dca00640 1 --2- 172.21.15.78:0/1071741701 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe9d81527a0 0x7fe9d80cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.817+0000 7fe9dca00640 1 -- 172.21.15.78:0/1071741701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9d80733d0 msgr2=0x7fe9d81efe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.817+0000 7fe9dca00640 1 --2- 172.21.15.78:0/1071741701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9d80733d0 0x7fe9d81efe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.817+0000 7fe9dca00640 1 -- 172.21.15.78:0/1071741701 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d80c9b60 con 0x7fe9d80c5980 2024-05-21T14:43:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.817+0000 7fe9dca00640 1 --2- 172.21.15.78:0/1071741701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9d80c5980 0x7fe9d81e40d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe9c401b860 tx=0x7fe9c401b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.817+0000 7fe9d5600640 1 -- 172.21.15.78:0/1071741701 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c40b5040 con 0x7fe9d80c5980 2024-05-21T14:43:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.817+0000 7fe9d5600640 1 -- 172.21.15.78:0/1071741701 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c4004220 con 0x7fe9d80c5980 2024-05-21T14:43:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.817+0000 7fe9dfe00640 1 -- 172.21.15.78:0/1071741701 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d80c9680 con 0x7fe9d80c5980 2024-05-21T14:43:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.817+0000 7fe9d5600640 1 -- 172.21.15.78:0/1071741701 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4003620 con 0x7fe9d80c5980 2024-05-21T14:43:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.817+0000 7fe9dfe00640 1 -- 172.21.15.78:0/1071741701 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d81f3f70 con 0x7fe9d80c5980 2024-05-21T14:43:22.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.817+0000 7fe9dfe00640 1 -- 172.21.15.78:0/1071741701 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9d80c6a60 con 0x7fe9d80c5980 2024-05-21T14:43:22.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.817+0000 7fe9d5600640 1 -- 172.21.15.78:0/1071741701 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe9c40c2060 con 0x7fe9d80c5980 2024-05-21T14:43:22.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.821+0000 7fe9d5600640 1 --2- 172.21.15.78:0/1071741701 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9b80678c0 0x7fe9b8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:22.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.821+0000 7fe9d5600640 1 -- 172.21.15.78:0/1071741701 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe9c4122270 con 0x7fe9d80c5980 2024-05-21T14:43:22.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.821+0000 7fe9dd400640 1 --2- 172.21.15.78:0/1071741701 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9b80678c0 0x7fe9b8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:22.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.821+0000 7fe9dd400640 1 --2- 172.21.15.78:0/1071741701 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9b80678c0 0x7fe9b8069dd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80c6e40 tx=0x7fe9cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:22.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:22.825+0000 7fe9d5600640 1 -- 172.21.15.78:0/1071741701 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fe9c40187b0 con 0x7fe9d80c5980 2024-05-21T14:43:23.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.017+0000 7fe9dfe00640 1 -- 172.21.15.78:0/1071741701 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe9d80c8a20 con 0x7fe9d80c5980 2024-05-21T14:43:23.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.629+0000 7fe9d5600640 1 -- 172.21.15.78:0/1071741701 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7fe9c40f2d10 con 0x7fe9d80c5980 2024-05-21T14:43:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.629+0000 7fe9dfe00640 1 -- 172.21.15.78:0/1071741701 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9b80678c0 msgr2=0x7fe9b8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.629+0000 7fe9dfe00640 1 --2- 172.21.15.78:0/1071741701 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9b80678c0 0x7fe9b8069dd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80c6e40 tx=0x7fe9cc008040 comp rx=0 tx=0).stop 2024-05-21T14:43:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.629+0000 7fe9dfe00640 1 -- 172.21.15.78:0/1071741701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9d80c5980 msgr2=0x7fe9d81e40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.629+0000 7fe9dfe00640 1 --2- 172.21.15.78:0/1071741701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9d80c5980 0x7fe9d81e40d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe9c401b860 tx=0x7fe9c401b9f0 comp rx=0 tx=0).stop 2024-05-21T14:43:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.629+0000 7fe9dfe00640 1 -- 172.21.15.78:0/1071741701 shutdown_connections 2024-05-21T14:43:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.629+0000 7fe9dfe00640 1 --2- 172.21.15.78:0/1071741701 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9b80678c0 0x7fe9b8069dd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.629+0000 7fe9dfe00640 1 --2- 172.21.15.78:0/1071741701 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe9d81527a0 0x7fe9d80cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.629+0000 7fe9dfe00640 1 --2- 172.21.15.78:0/1071741701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9d80c5980 0x7fe9d81e40d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.629+0000 7fe9dfe00640 1 --2- 172.21.15.78:0/1071741701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9d80733d0 0x7fe9d81efe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.629+0000 7fe9dfe00640 1 -- 172.21.15.78:0/1071741701 >> 172.21.15.78:0/1071741701 conn(0x7fe9d80cd1e0 msgr2=0x7fe9d80c7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.629+0000 7fe9dfe00640 1 -- 172.21.15.78:0/1071741701 shutdown_connections 2024-05-21T14:43:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.629+0000 7fe9dfe00640 1 -- 172.21.15.78:0/1071741701 wait complete. 2024-05-21T14:43:23.662 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-21T14:43:23.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.805+0000 7f9083e00640 1 Processor -- start 2024-05-21T14:43:23.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.805+0000 7f9083e00640 1 -- start start 2024-05-21T14:43:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.809+0000 7f9083e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9084153910 0x7f90840c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.809+0000 7f9083e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f90841599f0 0x7f9084163f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.809+0000 7f9083e00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90840c9f50 con 0x7f90841595e0 2024-05-21T14:43:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.809+0000 7f9083e00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f9084153d20 con 0x7f9084153910 2024-05-21T14:43:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.809+0000 7f9083e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f9084159e00 con 0x7f90841599f0 2024-05-21T14:43:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.809+0000 7f9082a00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9084153910 0x7f90840c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.809+0000 7f907a000640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f90841595e0 0x7f9084070e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57358/0 (socket says 172.21.15.78:57358) 2024-05-21T14:43:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.809+0000 7f907a000640 1 -- 172.21.15.78:0/3767554345 learned_addr learned my addr 172.21.15.78:0/3767554345 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.809+0000 7f9083400640 1 --2- 172.21.15.78:0/3767554345 >> v2:172.21.15.84:3300/0 conn(0x7f90841599f0 0x7f9084163f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.809+0000 7f9082a00640 1 -- 172.21.15.78:0/3767554345 >> v2:172.21.15.84:3300/0 conn(0x7f90841599f0 msgr2=0x7f9084163f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.809+0000 7f9082a00640 1 --2- 172.21.15.78:0/3767554345 >> v2:172.21.15.84:3300/0 conn(0x7f90841599f0 0x7f9084163f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:23.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.809+0000 7f9082a00640 1 -- 172.21.15.78:0/3767554345 >> v1:172.21.15.78:6789/0 conn(0x7f90841595e0 legacy=0x7f9084070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:23.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.809+0000 7f9082a00640 1 -- 172.21.15.78:0/3767554345 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90840c8e10 con 0x7f9084153910 2024-05-21T14:43:23.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.809+0000 7f9082000640 1 -- 172.21.15.78:0/3767554345 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2611722931 0 0) 0x7f90840c9f50 con 0x7f90841595e0 2024-05-21T14:43:23.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.809+0000 7f9083400640 1 --2- 172.21.15.78:0/3767554345 >> v2:172.21.15.84:3300/0 conn(0x7f90841599f0 0x7f9084163f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:23.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.813+0000 7f9082a00640 1 --2- 172.21.15.78:0/3767554345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9084153910 0x7f90840c5e40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9084153ea0 tx=0x7f907401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ae4d96041788b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:23.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.813+0000 7f9082000640 1 -- 172.21.15.78:0/3767554345 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90740b4070 con 0x7f9084153910 2024-05-21T14:43:23.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.813+0000 7f9082000640 1 -- 172.21.15.78:0/3767554345 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90740af600 con 0x7f9084153910 2024-05-21T14:43:23.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.813+0000 7f9082000640 1 -- 172.21.15.78:0/3767554345 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90740af9d0 con 0x7f9084153910 2024-05-21T14:43:23.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.813+0000 7f9083e00640 1 -- 172.21.15.78:0/3767554345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9084153910 msgr2=0x7f90840c5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:23.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.813+0000 7f9083e00640 1 --2- 172.21.15.78:0/3767554345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9084153910 0x7f90840c5e40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9084153ea0 tx=0x7f907401f150 comp rx=0 tx=0).stop 2024-05-21T14:43:23.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.813+0000 7f9083e00640 1 -- 172.21.15.78:0/3767554345 shutdown_connections 2024-05-21T14:43:23.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.813+0000 7f9083e00640 1 --2- 172.21.15.78:0/3767554345 >> v2:172.21.15.84:3300/0 conn(0x7f90841599f0 0x7f9084163f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:23.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.813+0000 7f9083e00640 1 --2- 172.21.15.78:0/3767554345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9084153910 0x7f90840c5e40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:23.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.813+0000 7f9083e00640 1 -- 172.21.15.78:0/3767554345 >> 172.21.15.78:0/3767554345 conn(0x7f90840cbbb0 msgr2=0x7f90840ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:23.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.813+0000 7f9083e00640 1 -- 172.21.15.78:0/3767554345 shutdown_connections 2024-05-21T14:43:23.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.813+0000 7f9083e00640 1 -- 172.21.15.78:0/3767554345 wait complete. 2024-05-21T14:43:23.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f9083e00640 1 Processor -- start 2024-05-21T14:43:23.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f9083e00640 1 -- start start 2024-05-21T14:43:23.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f9083e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9084153910 0x7f908414d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:23.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f9083e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90841595e0 0x7f9084151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:23.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f9083e00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f90841599f0 0x7f9084073500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:23.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f9083e00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f90840c8b30 con 0x7f90841595e0 2024-05-21T14:43:23.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f9083e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f90840c8850 con 0x7f9084153910 2024-05-21T14:43:23.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f9083e00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f90840caa00 con 0x7f90841599f0 2024-05-21T14:43:23.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f907a000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90841595e0 0x7f9084151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:23.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f907a000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90841595e0 0x7f9084151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38068/0 (socket says 172.21.15.78:38068) 2024-05-21T14:43:23.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f907a000640 1 -- 172.21.15.78:0/3117684809 learned_addr learned my addr 172.21.15.78:0/3117684809 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:23.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f9083400640 1 --2- 172.21.15.78:0/3117684809 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f90841599f0 0x7f9084073500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:23.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f9082a00640 1 --2- 172.21.15.78:0/3117684809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9084153910 0x7f908414d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:23.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f907a000640 1 -- 172.21.15.78:0/3117684809 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f90841599f0 msgr2=0x7f9084073500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:23.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f907a000640 1 --2- 172.21.15.78:0/3117684809 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f90841599f0 0x7f9084073500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:23.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f907a000640 1 -- 172.21.15.78:0/3117684809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9084153910 msgr2=0x7f908414d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:23.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f907a000640 1 --2- 172.21.15.78:0/3117684809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9084153910 0x7f908414d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:23.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f907a000640 1 -- 172.21.15.78:0/3117684809 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908406df30 con 0x7f90841595e0 2024-05-21T14:43:23.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f907a000640 1 --2- 172.21.15.78:0/3117684809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90841595e0 0x7f9084151c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f906c00c4b0 tx=0x7f906c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:23.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f907b400640 1 -- 172.21.15.78:0/3117684809 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906c018070 con 0x7f90841595e0 2024-05-21T14:43:23.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f907b400640 1 -- 172.21.15.78:0/3117684809 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f906c007500 con 0x7f90841595e0 2024-05-21T14:43:23.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f907b400640 1 -- 172.21.15.78:0/3117684809 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906c004a30 con 0x7f90841595e0 2024-05-21T14:43:23.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f9083e00640 1 -- 172.21.15.78:0/3117684809 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908414dee0 con 0x7f90841595e0 2024-05-21T14:43:23.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f9083e00640 1 -- 172.21.15.78:0/3117684809 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f908406d970 con 0x7f90841595e0 2024-05-21T14:43:23.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.817+0000 7f9083e00640 1 -- 172.21.15.78:0/3117684809 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f908404f730 con 0x7f90841595e0 2024-05-21T14:43:23.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.821+0000 7f907b400640 1 -- 172.21.15.78:0/3117684809 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f906c004bd0 con 0x7f90841595e0 2024-05-21T14:43:23.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.821+0000 7f907b400640 1 --2- 172.21.15.78:0/3117684809 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f90600678c0 0x7f9060069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:23.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.821+0000 7f907b400640 1 -- 172.21.15.78:0/3117684809 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f906c084f90 con 0x7f90841595e0 2024-05-21T14:43:23.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.821+0000 7f9082a00640 1 --2- 172.21.15.78:0/3117684809 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f90600678c0 0x7f9060069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:23.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.821+0000 7f9082a00640 1 --2- 172.21.15.78:0/3117684809 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f90600678c0 0x7f9060069dd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f90740b1000 tx=0x7f90740aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:23.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:23.825+0000 7f907b400640 1 -- 172.21.15.78:0/3117684809 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f906c0559a0 con 0x7f90841595e0 2024-05-21T14:43:24.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.013+0000 7f9083e00640 1 -- 172.21.15.78:0/3117684809 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f90840c9c50 con 0x7f90841595e0 2024-05-21T14:43:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.645+0000 7f907b400640 1 -- 172.21.15.78:0/3117684809 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v8) ==== 115+0+0 (secure 0 0 0) 0x7f906c0552a0 con 0x7f90841595e0 2024-05-21T14:43:24.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.649+0000 7f9083e00640 1 -- 172.21.15.78:0/3117684809 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f90600678c0 msgr2=0x7f9060069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:24.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.649+0000 7f9083e00640 1 --2- 172.21.15.78:0/3117684809 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f90600678c0 0x7f9060069dd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f90740b1000 tx=0x7f90740aa000 comp rx=0 tx=0).stop 2024-05-21T14:43:24.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.649+0000 7f9083e00640 1 -- 172.21.15.78:0/3117684809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90841595e0 msgr2=0x7f9084151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:24.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.649+0000 7f9083e00640 1 --2- 172.21.15.78:0/3117684809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90841595e0 0x7f9084151c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f906c00c4b0 tx=0x7f906c00c970 comp rx=0 tx=0).stop 2024-05-21T14:43:24.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.649+0000 7f9083e00640 1 -- 172.21.15.78:0/3117684809 shutdown_connections 2024-05-21T14:43:24.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.649+0000 7f9083e00640 1 --2- 172.21.15.78:0/3117684809 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f90600678c0 0x7f9060069dd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:24.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.649+0000 7f9083e00640 1 --2- 172.21.15.78:0/3117684809 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f90841599f0 0x7f9084073500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:24.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.649+0000 7f9083e00640 1 --2- 172.21.15.78:0/3117684809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90841595e0 0x7f9084151c40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:24.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.649+0000 7f9083e00640 1 --2- 172.21.15.78:0/3117684809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9084153910 0x7f908414d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:24.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.649+0000 7f9083e00640 1 -- 172.21.15.78:0/3117684809 >> 172.21.15.78:0/3117684809 conn(0x7f90840cbbb0 msgr2=0x7f90841589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:24.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.649+0000 7f9083e00640 1 -- 172.21.15.78:0/3117684809 shutdown_connections 2024-05-21T14:43:24.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.649+0000 7f9083e00640 1 -- 172.21.15.78:0/3117684809 wait complete. 2024-05-21T14:43:24.677 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-21T14:43:24.678 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T14:43:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.817+0000 7f427ba00640 1 Processor -- start 2024-05-21T14:43:24.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.817+0000 7f427ba00640 1 -- start start 2024-05-21T14:43:24.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.821+0000 7f427ba00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f42740c8d40 0x7f4274159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:24.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.821+0000 7f427ba00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f427406b620 0x7f427406ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:24.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.821+0000 7f427ba00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42740c6470 con 0x7f4274072470 2024-05-21T14:43:24.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.821+0000 7f427ba00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f4274160340 con 0x7f42740c8d40 2024-05-21T14:43:24.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.821+0000 7f427ba00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f42740c9150 con 0x7f427406b620 2024-05-21T14:43:24.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.821+0000 7f426be00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f42740c8d40 0x7f4274159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:24.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.821+0000 7f426be00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f42740c8d40 0x7f4274159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38080/0 (socket says 172.21.15.78:38080) 2024-05-21T14:43:24.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.821+0000 7f426be00640 1 -- 172.21.15.78:0/3369125422 learned_addr learned my addr 172.21.15.78:0/3369125422 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:24.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.821+0000 7f4279a00640 1 --2- 172.21.15.78:0/3369125422 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f427406b620 0x7f427406ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:24.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.821+0000 7f426be00640 1 -- 172.21.15.78:0/3369125422 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f427406b620 msgr2=0x7f427406ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:24.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.821+0000 7f426be00640 1 --2- 172.21.15.78:0/3369125422 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f427406b620 0x7f427406ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:24.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.821+0000 7f426be00640 1 -- 172.21.15.78:0/3369125422 >> v1:172.21.15.84:6789/0 conn(0x7f4274072470 legacy=0x7f42741607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:24.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.821+0000 7f426be00640 1 -- 172.21.15.78:0/3369125422 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42740c6750 con 0x7f42740c8d40 2024-05-21T14:43:24.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.821+0000 7f4279a00640 1 --2- 172.21.15.78:0/3369125422 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f427406b620 0x7f427406ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:43:24.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.825+0000 7f426be00640 1 --2- 172.21.15.78:0/3369125422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42740c8d40 0x7f4274159fc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f425c009870 tx=0x7f425c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659dd26c224dc7b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:24.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.825+0000 7f4273e00640 1 -- 172.21.15.78:0/3369125422 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c0b2070 con 0x7f42740c8d40 2024-05-21T14:43:24.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.825+0000 7f4273e00640 1 -- 172.21.15.78:0/3369125422 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f425c0a9070 con 0x7f42740c8d40 2024-05-21T14:43:24.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.825+0000 7f4273e00640 1 -- 172.21.15.78:0/3369125422 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c0ad880 con 0x7f42740c8d40 2024-05-21T14:43:24.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.825+0000 7f427ba00640 1 -- 172.21.15.78:0/3369125422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42740c8d40 msgr2=0x7f4274159fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:24.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.825+0000 7f427ba00640 1 --2- 172.21.15.78:0/3369125422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42740c8d40 0x7f4274159fc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f425c009870 tx=0x7f425c01c560 comp rx=0 tx=0).stop 2024-05-21T14:43:24.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.825+0000 7f427ba00640 1 -- 172.21.15.78:0/3369125422 shutdown_connections 2024-05-21T14:43:24.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.825+0000 7f427ba00640 1 --2- 172.21.15.78:0/3369125422 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f427406b620 0x7f427406ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:24.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.825+0000 7f427ba00640 1 --2- 172.21.15.78:0/3369125422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42740c8d40 0x7f4274159fc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:24.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.825+0000 7f427ba00640 1 -- 172.21.15.78:0/3369125422 >> 172.21.15.78:0/3369125422 conn(0x7f42740c9380 msgr2=0x7f42740c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:24.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.825+0000 7f427ba00640 1 -- 172.21.15.78:0/3369125422 shutdown_connections 2024-05-21T14:43:24.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.825+0000 7f427ba00640 1 -- 172.21.15.78:0/3369125422 wait complete. 2024-05-21T14:43:24.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.825+0000 7f427ba00640 1 Processor -- start 2024-05-21T14:43:24.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.825+0000 7f427ba00640 1 -- start start 2024-05-21T14:43:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f427ba00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f427406b620 0x7f42741fcf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f427ba00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4274072470 0x7f42741f9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f427ba00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42740c8d40 0x7f42740cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f427ba00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f427406c750 con 0x7f42740c8d40 2024-05-21T14:43:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f427ba00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f427406c5d0 con 0x7f427406b620 2024-05-21T14:43:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f427ba00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f427416cea0 con 0x7f4274072470 2024-05-21T14:43:24.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f4279a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42740c8d40 0x7f42740cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:24.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f4279a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42740c8d40 0x7f42740cbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38086/0 (socket says 172.21.15.78:38086) 2024-05-21T14:43:24.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f4279a00640 1 -- 172.21.15.78:0/3686263132 learned_addr learned my addr 172.21.15.78:0/3686263132 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:24.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f4279000640 1 --2- 172.21.15.78:0/3686263132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f427406b620 0x7f42741fcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:24.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f426be00640 1 --2- 172.21.15.78:0/3686263132 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4274072470 0x7f42741f9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:24.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f4279a00640 1 -- 172.21.15.78:0/3686263132 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4274072470 msgr2=0x7f42741f9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:24.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f4279a00640 1 --2- 172.21.15.78:0/3686263132 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4274072470 0x7f42741f9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:24.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f4279a00640 1 -- 172.21.15.78:0/3686263132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f427406b620 msgr2=0x7f42741fcf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:24.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f4279a00640 1 --2- 172.21.15.78:0/3686263132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f427406b620 0x7f42741fcf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:24.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f4279a00640 1 -- 172.21.15.78:0/3686263132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42741fd450 con 0x7f42740c8d40 2024-05-21T14:43:24.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f4279a00640 1 --2- 172.21.15.78:0/3686263132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42740c8d40 0x7f42740cbb40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f426c00cd50 tx=0x7f426c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:24.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f4271600640 1 -- 172.21.15.78:0/3686263132 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c00f680 con 0x7f42740c8d40 2024-05-21T14:43:24.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f4271600640 1 -- 172.21.15.78:0/3686263132 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f426c00f840 con 0x7f42740c8d40 2024-05-21T14:43:24.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f4271600640 1 -- 172.21.15.78:0/3686263132 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c00fc30 con 0x7f42740c8d40 2024-05-21T14:43:24.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f427ba00640 1 -- 172.21.15.78:0/3686263132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427414d9c0 con 0x7f42740c8d40 2024-05-21T14:43:24.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f427ba00640 1 -- 172.21.15.78:0/3686263132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f427414df80 con 0x7f42740c8d40 2024-05-21T14:43:24.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.829+0000 7f427ba00640 1 -- 172.21.15.78:0/3686263132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f427414e1c0 con 0x7f42740c8d40 2024-05-21T14:43:24.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.833+0000 7f4271600640 1 -- 172.21.15.78:0/3686263132 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f426c0213f0 con 0x7f42740c8d40 2024-05-21T14:43:24.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.833+0000 7f4271600640 1 --2- 172.21.15.78:0/3686263132 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f42500678c0 0x7f4250069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:24.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.833+0000 7f4271600640 1 -- 172.21.15.78:0/3686263132 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f426c086910 con 0x7f42740c8d40 2024-05-21T14:43:24.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.833+0000 7f4279000640 1 --2- 172.21.15.78:0/3686263132 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f42500678c0 0x7f4250069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:24.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.833+0000 7f4279000640 1 --2- 172.21.15.78:0/3686263132 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f42500678c0 0x7f4250069dd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4264001770 tx=0x7f4264009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:24.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:24.837+0000 7f4271600640 1 -- 172.21.15.78:0/3686263132 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f426c014030 con 0x7f42740c8d40 2024-05-21T14:43:25.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.029+0000 7f427ba00640 1 -- 172.21.15.78:0/3686263132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f427404f730 con 0x7f42740c8d40 2024-05-21T14:43:25.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.029+0000 7f4271600640 1 -- 172.21.15.78:0/3686263132 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6840 (secure 0 0 0) 0x7f426c056e00 con 0x7f42740c8d40 2024-05-21T14:43:25.036 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:25.036 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1952345794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1952345794},{"type":"v1","addr":"172.21.15.78:6833","nonce":1952345794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/3517628193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3517628193},{"type":"v1","addr":"172.21.15.78:6836","nonce":3517628193}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3155872080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3155872080},{"type":"v1","addr":"172.21.15.84:6835","nonce":3155872080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6838/1750816366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1750816366},{"type":"v1","addr":"172.21.15.84:6838","nonce":1750816366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T14:43:18.985546+0000","modified":"2024-05-21T14:43:24.651767+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4321,"mds_1":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.84:6839/4232079477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6837","nonce":4232079477},{"type":"v1","addr":"172.21.15.84:6839","nonce":4232079477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6837/1924967428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1924967428},{"type":"v1","addr":"172.21.15.78:6837","nonce":1924967428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4321]},"id":1}]} 2024-05-21T14:43:25.037 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2024-05-21T14:43:25.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.029+0000 7f427ba00640 1 -- 172.21.15.78:0/3686263132 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f42500678c0 msgr2=0x7f4250069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.029+0000 7f427ba00640 1 --2- 172.21.15.78:0/3686263132 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f42500678c0 0x7f4250069dd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4264001770 tx=0x7f4264009040 comp rx=0 tx=0).stop 2024-05-21T14:43:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.029+0000 7f427ba00640 1 -- 172.21.15.78:0/3686263132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42740c8d40 msgr2=0x7f42740cbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.029+0000 7f427ba00640 1 --2- 172.21.15.78:0/3686263132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42740c8d40 0x7f42740cbb40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f426c00cd50 tx=0x7f426c00a650 comp rx=0 tx=0).stop 2024-05-21T14:43:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.029+0000 7f427ba00640 1 -- 172.21.15.78:0/3686263132 shutdown_connections 2024-05-21T14:43:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.029+0000 7f427ba00640 1 --2- 172.21.15.78:0/3686263132 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f42500678c0 0x7f4250069dd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.029+0000 7f427ba00640 1 --2- 172.21.15.78:0/3686263132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42740c8d40 0x7f42740cbb40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.029+0000 7f427ba00640 1 --2- 172.21.15.78:0/3686263132 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4274072470 0x7f42741f9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.029+0000 7f427ba00640 1 --2- 172.21.15.78:0/3686263132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f427406b620 0x7f42741fcf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.029+0000 7f427ba00640 1 -- 172.21.15.78:0/3686263132 >> 172.21.15.78:0/3686263132 conn(0x7f42740c9380 msgr2=0x7f42740c5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.029+0000 7f427ba00640 1 -- 172.21.15.78:0/3686263132 shutdown_connections 2024-05-21T14:43:25.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.029+0000 7f427ba00640 1 -- 172.21.15.78:0/3686263132 wait complete. 2024-05-21T14:43:25.058 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:43:25.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.197+0000 7fb05e000640 1 Processor -- start 2024-05-21T14:43:25.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.197+0000 7fb05e000640 1 -- start start 2024-05-21T14:43:25.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.197+0000 7fb05e000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb05815c380 0x7fb058163fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.197+0000 7fb05e000640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb05806cc00 con 0x7fb0580c4e30 2024-05-21T14:43:25.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.197+0000 7fb05e000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb05806cee0 con 0x7fb058073200 2024-05-21T14:43:25.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.197+0000 7fb05e000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fb058072ce0 con 0x7fb05815c380 2024-05-21T14:43:25.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.197+0000 7fb056a00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb0580c4e30 0x7fb05815bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57374/0 (socket says 172.21.15.78:57374) 2024-05-21T14:43:25.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.197+0000 7fb056a00640 1 -- 172.21.15.78:0/633615021 learned_addr learned my addr 172.21.15.78:0/633615021 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:25.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.197+0000 7fb057e00640 1 --2- 172.21.15.78:0/633615021 >> v2:172.21.15.84:3300/0 conn(0x7fb05815c380 0x7fb058163fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.197+0000 7fb056000640 1 -- 172.21.15.78:0/633615021 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3847373248 0 0) 0x7fb05806cc00 con 0x7fb0580c4e30 2024-05-21T14:43:25.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.197+0000 7fb056000640 1 -- 172.21.15.78:0/633615021 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb03c005740 con 0x7fb0580c4e30 2024-05-21T14:43:25.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.197+0000 7fb056000640 1 -- 172.21.15.78:0/633615021 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2003573526 0 0) 0x7fb03c005740 con 0x7fb0580c4e30 2024-05-21T14:43:25.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.197+0000 7fb057e00640 1 -- 172.21.15.78:0/633615021 >> v1:172.21.15.84:6789/0 conn(0x7fb058073200 legacy=0x7fb0580c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.197+0000 7fb057e00640 1 -- 172.21.15.78:0/633615021 >> v1:172.21.15.78:6789/0 conn(0x7fb0580c4e30 legacy=0x7fb05815bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.197+0000 7fb057e00640 1 -- 172.21.15.78:0/633615021 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb058072690 con 0x7fb05815c380 2024-05-21T14:43:25.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.201+0000 7fb057e00640 1 --2- 172.21.15.78:0/633615021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb05815c380 0x7fb058163fb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb0500097c0 tx=0x7fb05001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aa4ecec98ea207e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:25.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.201+0000 7fb056000640 1 -- 172.21.15.78:0/633615021 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0500b0070 con 0x7fb05815c380 2024-05-21T14:43:25.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.201+0000 7fb056000640 1 -- 172.21.15.78:0/633615021 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0500ab400 con 0x7fb05815c380 2024-05-21T14:43:25.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.201+0000 7fb056000640 1 -- 172.21.15.78:0/633615021 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb044001680 con 0x7fb05815c380 2024-05-21T14:43:25.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.205+0000 7fb05e000640 1 -- 172.21.15.78:0/633615021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb05815c380 msgr2=0x7fb058163fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.205+0000 7fb05e000640 1 --2- 172.21.15.78:0/633615021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb05815c380 0x7fb058163fb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb0500097c0 tx=0x7fb05001c3c0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.205+0000 7fb05e000640 1 -- 172.21.15.78:0/633615021 shutdown_connections 2024-05-21T14:43:25.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.205+0000 7fb05e000640 1 --2- 172.21.15.78:0/633615021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb05815c380 0x7fb058163fb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.205+0000 7fb05e000640 1 -- 172.21.15.78:0/633615021 >> 172.21.15.78:0/633615021 conn(0x7fb058070940 msgr2=0x7fb0580ca430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:25.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.205+0000 7fb05e000640 1 -- 172.21.15.78:0/633615021 shutdown_connections 2024-05-21T14:43:25.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.205+0000 7fb05e000640 1 -- 172.21.15.78:0/633615021 wait complete. 2024-05-21T14:43:25.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.205+0000 7fb05e000640 1 Processor -- start 2024-05-21T14:43:25.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.205+0000 7fb05e000640 1 -- start start 2024-05-21T14:43:25.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.205+0000 7fb05e000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb058073200 0x7fb0581f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb05e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0580c4e30 0x7fb0581454d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb05e000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0581513d0 0x7fb058147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb05e000640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb05806bfb0 con 0x7fb0581513d0 2024-05-21T14:43:25.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb05e000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb05806be30 con 0x7fb0580c4e30 2024-05-21T14:43:25.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb05e000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb05806c130 con 0x7fb058073200 2024-05-21T14:43:25.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb057e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0581513d0 0x7fb058147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb056a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0580c4e30 0x7fb0581454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb056a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0580c4e30 0x7fb0581454d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:42504/0 (socket says 172.21.15.78:42504) 2024-05-21T14:43:25.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb057400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb058073200 0x7fb0581f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb056a00640 1 -- 172.21.15.78:0/3558782844 learned_addr learned my addr 172.21.15.78:0/3558782844 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:25.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb057e00640 1 -- 172.21.15.78:0/3558782844 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb058073200 msgr2=0x7fb0581f3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb057e00640 1 --2- 172.21.15.78:0/3558782844 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb058073200 0x7fb0581f3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb057e00640 1 -- 172.21.15.78:0/3558782844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0580c4e30 msgr2=0x7fb0581454d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb057e00640 1 --2- 172.21.15.78:0/3558782844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0580c4e30 0x7fb0581454d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb057e00640 1 -- 172.21.15.78:0/3558782844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05814f9b0 con 0x7fb0581513d0 2024-05-21T14:43:25.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb057e00640 1 --2- 172.21.15.78:0/3558782844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0581513d0 0x7fb058147eb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb0500ab000 tx=0x7fb050019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:25.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb04f400640 1 -- 172.21.15.78:0/3558782844 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0500ba070 con 0x7fb0581513d0 2024-05-21T14:43:25.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb04f400640 1 -- 172.21.15.78:0/3558782844 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb050003820 con 0x7fb0581513d0 2024-05-21T14:43:25.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb04f400640 1 -- 172.21.15.78:0/3558782844 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0500b0040 con 0x7fb0581513d0 2024-05-21T14:43:25.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb05e000640 1 -- 172.21.15.78:0/3558782844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0581508d0 con 0x7fb0581513d0 2024-05-21T14:43:25.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb05e000640 1 -- 172.21.15.78:0/3558782844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0581f4520 con 0x7fb0581513d0 2024-05-21T14:43:25.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb05e000640 1 -- 172.21.15.78:0/3558782844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0581f4350 con 0x7fb0581513d0 2024-05-21T14:43:25.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.209+0000 7fb04f400640 1 -- 172.21.15.78:0/3558782844 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb0500bd070 con 0x7fb0581513d0 2024-05-21T14:43:25.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.213+0000 7fb04f400640 1 --2- 172.21.15.78:0/3558782844 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb0380678c0 0x7fb038069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.213+0000 7fb04f400640 1 -- 172.21.15.78:0/3558782844 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb05011ea90 con 0x7fb0581513d0 2024-05-21T14:43:25.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.213+0000 7fb057400640 1 --2- 172.21.15.78:0/3558782844 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb0380678c0 0x7fb038069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.213+0000 7fb057400640 1 --2- 172.21.15.78:0/3558782844 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb0380678c0 0x7fb038069dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb0480012f0 tx=0x7fb048009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:25.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.217+0000 7fb04f400640 1 -- 172.21.15.78:0/3558782844 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb050015fb0 con 0x7fb0581513d0 2024-05-21T14:43:25.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.373+0000 7fb05e000640 1 -- 172.21.15.78:0/3558782844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb05804f730 con 0x7fb0581513d0 2024-05-21T14:43:25.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.373+0000 7fb04f400640 1 -- 172.21.15.78:0/3558782844 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16537 (secure 0 0 0) 0x7fb0500eeee0 con 0x7fb0581513d0 2024-05-21T14:43:25.381 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:25.381 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:20.573644+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T14:43:17.088549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T14:43:18.012571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:43:25.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.373+0000 7fb05e000640 1 -- 172.21.15.78:0/3558782844 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb0380678c0 msgr2=0x7fb038069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.373+0000 7fb05e000640 1 --2- 172.21.15.78:0/3558782844 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb0380678c0 0x7fb038069dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb0480012f0 tx=0x7fb048009040 comp rx=0 tx=0).stop 2024-05-21T14:43:25.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.373+0000 7fb05e000640 1 -- 172.21.15.78:0/3558782844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0581513d0 msgr2=0x7fb058147eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.373+0000 7fb05e000640 1 --2- 172.21.15.78:0/3558782844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0581513d0 0x7fb058147eb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb0500ab000 tx=0x7fb050019160 comp rx=0 tx=0).stop 2024-05-21T14:43:25.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.373+0000 7fb05e000640 1 -- 172.21.15.78:0/3558782844 shutdown_connections 2024-05-21T14:43:25.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.373+0000 7fb05e000640 1 --2- 172.21.15.78:0/3558782844 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb0380678c0 0x7fb038069dd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.373+0000 7fb05e000640 1 --2- 172.21.15.78:0/3558782844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0581513d0 0x7fb058147eb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.373+0000 7fb05e000640 1 --2- 172.21.15.78:0/3558782844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0580c4e30 0x7fb0581454d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.373+0000 7fb05e000640 1 --2- 172.21.15.78:0/3558782844 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb058073200 0x7fb0581f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.373+0000 7fb05e000640 1 -- 172.21.15.78:0/3558782844 >> 172.21.15.78:0/3558782844 conn(0x7fb058070940 msgr2=0x7fb0580cbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:25.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.377+0000 7fb05e000640 1 -- 172.21.15.78:0/3558782844 shutdown_connections 2024-05-21T14:43:25.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.377+0000 7fb05e000640 1 -- 172.21.15.78:0/3558782844 wait complete. 2024-05-21T14:43:25.403 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-21T14:43:25.403 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T14:43:25.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.541+0000 7fef22800640 1 Processor -- start 2024-05-21T14:43:25.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.541+0000 7fef22800640 1 -- start start 2024-05-21T14:43:25.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef22800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fef1c0736d0 0x7fef1c073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef22800640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef1c153cd0 con 0x7fef1c159810 2024-05-21T14:43:25.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef22800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef1c15cdf0 con 0x7fef1c0c6760 2024-05-21T14:43:25.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef22800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fef1c15cbb0 con 0x7fef1c0736d0 2024-05-21T14:43:25.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1be00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fef1c159810 0x7fef1c159c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57384/0 (socket says 172.21.15.78:57384) 2024-05-21T14:43:25.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1be00640 1 -- 172.21.15.78:0/3281063436 learned_addr learned my addr 172.21.15.78:0/3281063436 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:25.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef12a00640 1 --2- 172.21.15.78:0/3281063436 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fef1c0736d0 0x7fef1c073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1aa00640 1 -- 172.21.15.78:0/3281063436 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2736926876 0 0) 0x7fef1c153cd0 con 0x7fef1c159810 2024-05-21T14:43:25.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1aa00640 1 -- 172.21.15.78:0/3281063436 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef00003530 con 0x7fef1c159810 2024-05-21T14:43:25.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1aa00640 1 -- 172.21.15.78:0/3281063436 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2987949964 0 0) 0x7fef1c15cdf0 con 0x7fef1c0c6760 2024-05-21T14:43:25.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1aa00640 1 -- 172.21.15.78:0/3281063436 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef1c153cd0 con 0x7fef1c0c6760 2024-05-21T14:43:25.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1aa00640 1 -- 172.21.15.78:0/3281063436 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3903491147 0 0) 0x7fef00003530 con 0x7fef1c159810 2024-05-21T14:43:25.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1aa00640 1 -- 172.21.15.78:0/3281063436 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fef1c0736d0 msgr2=0x7fef1c073ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:25.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1aa00640 1 --2- 172.21.15.78:0/3281063436 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fef1c0736d0 0x7fef1c073ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1aa00640 1 -- 172.21.15.78:0/3281063436 >> v1:172.21.15.84:6789/0 conn(0x7fef1c0c6760 legacy=0x7fef1c0c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1aa00640 1 -- 172.21.15.78:0/3281063436 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1c15d0d0 con 0x7fef1c159810 2024-05-21T14:43:25.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1aa00640 1 -- 172.21.15.78:0/3281063436 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7fef14001680 con 0x7fef1c159810 2024-05-21T14:43:25.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1aa00640 1 -- 172.21.15.78:0/3281063436 >> v1:172.21.15.78:6789/0 conn(0x7fef1c159810 legacy=0x7fef1c159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1aa00640 1 --2- 172.21.15.78:0/3281063436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef00003b80 0x7fef00003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1aa00640 1 --2- 172.21.15.78:0/3281063436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef00004810 0x7fef00004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1aa00640 1 --2- 172.21.15.78:0/3281063436 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fef1c0736d0 0x7fef00005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1aa00640 1 -- 172.21.15.78:0/3281063436 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c15cbb0 con 0x7fef00004810 2024-05-21T14:43:25.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1aa00640 1 -- 172.21.15.78:0/3281063436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fef0000bb10 con 0x7fef00003b80 2024-05-21T14:43:25.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1aa00640 1 -- 172.21.15.78:0/3281063436 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fef0000bd10 con 0x7fef1c0736d0 2024-05-21T14:43:25.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef12a00640 1 --2- 172.21.15.78:0/3281063436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef00004810 0x7fef00004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1b400640 1 --2- 172.21.15.78:0/3281063436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef00003b80 0x7fef00003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef1be00640 1 --2- 172.21.15.78:0/3281063436 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fef1c0736d0 0x7fef00005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef12a00640 1 -- 172.21.15.78:0/3281063436 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fef1c0736d0 msgr2=0x7fef00005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:25.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef12a00640 1 --2- 172.21.15.78:0/3281063436 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fef1c0736d0 0x7fef00005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef12a00640 1 -- 172.21.15.78:0/3281063436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef00003b80 msgr2=0x7fef00003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:25.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef12a00640 1 --2- 172.21.15.78:0/3281063436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef00003b80 0x7fef00003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.545+0000 7fef12a00640 1 -- 172.21.15.78:0/3281063436 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef00003530 con 0x7fef00004810 2024-05-21T14:43:25.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.549+0000 7fef12a00640 1 --2- 172.21.15.78:0/3281063436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef00004810 0x7fef00004c20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fef04009ab0 tx=0x7fef0401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2bbdf52cd98cb85 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:25.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.549+0000 7fef1aa00640 1 -- 172.21.15.78:0/3281063436 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef040b2070 con 0x7fef00004810 2024-05-21T14:43:25.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.549+0000 7fef1aa00640 1 -- 172.21.15.78:0/3281063436 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef040a5660 con 0x7fef00004810 2024-05-21T14:43:25.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.549+0000 7fef1aa00640 1 -- 172.21.15.78:0/3281063436 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef040096b0 con 0x7fef00004810 2024-05-21T14:43:25.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.549+0000 7fef22800640 1 -- 172.21.15.78:0/3281063436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef00004810 msgr2=0x7fef00004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.549+0000 7fef22800640 1 --2- 172.21.15.78:0/3281063436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef00004810 0x7fef00004c20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fef04009ab0 tx=0x7fef0401ca70 comp rx=0 tx=0).stop 2024-05-21T14:43:25.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.549+0000 7fef1be00640 1 -- 172.21.15.78:0/3281063436 reap_dead start 2024-05-21T14:43:25.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.549+0000 7fef22800640 1 -- 172.21.15.78:0/3281063436 shutdown_connections 2024-05-21T14:43:25.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.549+0000 7fef22800640 1 -- 172.21.15.78:0/3281063436 >> 172.21.15.78:0/3281063436 conn(0x7fef1c0c9380 msgr2=0x7fef1c0c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:25.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.549+0000 7fef22800640 1 -- 172.21.15.78:0/3281063436 shutdown_connections 2024-05-21T14:43:25.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.549+0000 7fef22800640 1 -- 172.21.15.78:0/3281063436 wait complete. 2024-05-21T14:43:25.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef22800640 1 Processor -- start 2024-05-21T14:43:25.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef22800640 1 -- start start 2024-05-21T14:43:25.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef22800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fef00004810 0x7fef1c1f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef22800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef1c15b1c0 0x7fef1c1e7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef22800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef1c0714c0 0x7fef1c14c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef22800640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c15d970 con 0x7fef1c0714c0 2024-05-21T14:43:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef22800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c15d690 con 0x7fef1c15b1c0 2024-05-21T14:43:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef22800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fef1c0c6b70 con 0x7fef00004810 2024-05-21T14:43:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef1be00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef1c0714c0 0x7fef1c14c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef1be00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef1c0714c0 0x7fef1c14c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38098/0 (socket says 172.21.15.78:38098) 2024-05-21T14:43:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef1be00640 1 -- 172.21.15.78:0/2507167509 learned_addr learned my addr 172.21.15.78:0/2507167509 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef12a00640 1 --2- 172.21.15.78:0/2507167509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef1c15b1c0 0x7fef1c1e7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef1b400640 1 --2- 172.21.15.78:0/2507167509 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fef00004810 0x7fef1c1f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef1be00640 1 -- 172.21.15.78:0/2507167509 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fef00004810 msgr2=0x7fef1c1f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef1be00640 1 --2- 172.21.15.78:0/2507167509 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fef00004810 0x7fef1c1f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef1be00640 1 -- 172.21.15.78:0/2507167509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef1c15b1c0 msgr2=0x7fef1c1e7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef1be00640 1 --2- 172.21.15.78:0/2507167509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef1c15b1c0 0x7fef1c1e7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef1be00640 1 -- 172.21.15.78:0/2507167509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1c1f2880 con 0x7fef1c0714c0 2024-05-21T14:43:25.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef1be00640 1 --2- 172.21.15.78:0/2507167509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef1c0714c0 0x7fef1c14c930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0c5bc0 tx=0x7fef1400e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:25.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef13e00640 1 -- 172.21.15.78:0/2507167509 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef14019070 con 0x7fef1c0714c0 2024-05-21T14:43:25.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef13e00640 1 -- 172.21.15.78:0/2507167509 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef14010510 con 0x7fef1c0714c0 2024-05-21T14:43:25.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef13e00640 1 -- 172.21.15.78:0/2507167509 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef14010900 con 0x7fef1c0714c0 2024-05-21T14:43:25.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef22800640 1 -- 172.21.15.78:0/2507167509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef1c0cbe80 con 0x7fef1c0714c0 2024-05-21T14:43:25.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.553+0000 7fef22800640 1 -- 172.21.15.78:0/2507167509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef1c0cc120 con 0x7fef1c0714c0 2024-05-21T14:43:25.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.557+0000 7fef22800640 1 -- 172.21.15.78:0/2507167509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef1c157010 con 0x7fef1c0714c0 2024-05-21T14:43:25.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.557+0000 7fef13e00640 1 -- 172.21.15.78:0/2507167509 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fef1401c070 con 0x7fef1c0714c0 2024-05-21T14:43:25.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.557+0000 7fef13e00640 1 --2- 172.21.15.78:0/2507167509 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7feef80678c0 0x7feef8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.557+0000 7fef13e00640 1 -- 172.21.15.78:0/2507167509 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fef14085280 con 0x7fef1c0714c0 2024-05-21T14:43:25.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.557+0000 7fef1b400640 1 --2- 172.21.15.78:0/2507167509 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7feef80678c0 0x7feef8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.557+0000 7fef1b400640 1 --2- 172.21.15.78:0/2507167509 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7feef80678c0 0x7feef8069dd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0059b0 tx=0x7fef0c001b90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:25.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.561+0000 7fef13e00640 1 -- 172.21.15.78:0/2507167509 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fef14055640 con 0x7fef1c0714c0 2024-05-21T14:43:25.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.717+0000 7fef22800640 1 -- 172.21.15.78:0/2507167509 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef1c0c7d00 con 0x7feef80678c0 2024-05-21T14:43:25.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.737+0000 7fef13e00640 1 -- 172.21.15.78:0/2507167509 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251897 (secure 0 0 0) 0x7fef1c0c7d00 con 0x7feef80678c0 2024-05-21T14:43:25.747 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:25.749 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-05-21T14:43:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.741+0000 7fef22800640 1 -- 172.21.15.78:0/2507167509 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7feef80678c0 msgr2=0x7feef8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.741+0000 7fef22800640 1 --2- 172.21.15.78:0/2507167509 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7feef80678c0 0x7feef8069dd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0059b0 tx=0x7fef0c001b90 comp rx=0 tx=0).stop 2024-05-21T14:43:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.741+0000 7fef22800640 1 -- 172.21.15.78:0/2507167509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef1c0714c0 msgr2=0x7fef1c14c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.741+0000 7fef22800640 1 --2- 172.21.15.78:0/2507167509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef1c0714c0 0x7fef1c14c930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0c5bc0 tx=0x7fef1400e9e0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.741+0000 7fef22800640 1 -- 172.21.15.78:0/2507167509 shutdown_connections 2024-05-21T14:43:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.741+0000 7fef22800640 1 --2- 172.21.15.78:0/2507167509 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7feef80678c0 0x7feef8069dd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.741+0000 7fef22800640 1 --2- 172.21.15.78:0/2507167509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef1c0714c0 0x7fef1c14c930 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.741+0000 7fef22800640 1 --2- 172.21.15.78:0/2507167509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef1c15b1c0 0x7fef1c1e7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.741+0000 7fef22800640 1 --2- 172.21.15.78:0/2507167509 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fef00004810 0x7fef1c1f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.741+0000 7fef22800640 1 -- 172.21.15.78:0/2507167509 >> 172.21.15.78:0/2507167509 conn(0x7fef1c0c9380 msgr2=0x7fef1c06b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:25.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.741+0000 7fef22800640 1 -- 172.21.15.78:0/2507167509 shutdown_connections 2024-05-21T14:43:25.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.741+0000 7fef22800640 1 -- 172.21.15.78:0/2507167509 wait complete. 2024-05-21T14:43:25.768 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-05-21T14:43:24.487780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218072,"kb_used_data":1868,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756648,"statfs":{"total":773094113280,"available":772870807552,"internally_reserved":0,"allocated":1912832,"data_stored":1786516,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002306"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.611784+0000","last_change":"2024-05-21T14:43:19.606707+0000","last_active":"2024-05-21T14:43:19.611784+0000","last_peered":"2024-05-21T14:43:19.611784+0000","last_clean":"2024-05-21T14:43:19.611784+0000","last_became_active":"2024-05-21T14:43:19.606365+0000","last_became_peered":"2024-05-21T14:43:19.606365+0000","last_unstale":"2024-05-21T14:43:19.611784+0000","last_undegraded":"2024-05-21T14:43:19.611784+0000","last_fullsized":"2024-05-21T14:43:19.611784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:52:11.131429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.636507+0000","last_change":"2024-05-21T14:43:19.632879+0000","last_active":"2024-05-21T14:43:19.636507+0000","last_peered":"2024-05-21T14:43:19.636507+0000","last_clean":"2024-05-21T14:43:19.636507+0000","last_became_active":"2024-05-21T14:43:19.632218+0000","last_became_peered":"2024-05-21T14:43:19.632218+0000","last_unstale":"2024-05-21T14:43:19.636507+0000","last_undegraded":"2024-05-21T14:43:19.636507+0000","last_fullsized":"2024-05-21T14:43:19.636507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:58:32.304837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.628497+0000","last_change":"2024-05-21T14:43:19.620214+0000","last_active":"2024-05-21T14:43:19.628497+0000","last_peered":"2024-05-21T14:43:19.628497+0000","last_clean":"2024-05-21T14:43:19.628497+0000","last_became_active":"2024-05-21T14:43:19.619012+0000","last_became_peered":"2024-05-21T14:43:19.619012+0000","last_unstale":"2024-05-21T14:43:19.628497+0000","last_undegraded":"2024-05-21T14:43:19.628497+0000","last_fullsized":"2024-05-21T14:43:19.628497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:28:33.872706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.613169+0000","last_change":"2024-05-21T14:43:19.602199+0000","last_active":"2024-05-21T14:43:19.613169+0000","last_peered":"2024-05-21T14:43:19.613169+0000","last_clean":"2024-05-21T14:43:19.613169+0000","last_became_active":"2024-05-21T14:43:19.601797+0000","last_became_peered":"2024-05-21T14:43:19.601797+0000","last_unstale":"2024-05-21T14:43:19.613169+0000","last_undegraded":"2024-05-21T14:43:19.613169+0000","last_fullsized":"2024-05-21T14:43:19.613169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:16:06.695971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.624438+0000","last_change":"2024-05-21T14:43:19.623449+0000","last_active":"2024-05-21T14:43:19.624438+0000","last_peered":"2024-05-21T14:43:19.624438+0000","last_clean":"2024-05-21T14:43:19.624438+0000","last_became_active":"2024-05-21T14:43:19.623125+0000","last_became_peered":"2024-05-21T14:43:19.623125+0000","last_unstale":"2024-05-21T14:43:19.624438+0000","last_undegraded":"2024-05-21T14:43:19.624438+0000","last_fullsized":"2024-05-21T14:43:19.624438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:55:00.274958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.608123+0000","last_change":"2024-05-21T14:43:19.591222+0000","last_active":"2024-05-21T14:43:19.608123+0000","last_peered":"2024-05-21T14:43:19.608123+0000","last_clean":"2024-05-21T14:43:19.608123+0000","last_became_active":"2024-05-21T14:43:19.590858+0000","last_became_peered":"2024-05-21T14:43:19.590858+0000","last_unstale":"2024-05-21T14:43:19.608123+0000","last_undegraded":"2024-05-21T14:43:19.608123+0000","last_fullsized":"2024-05-21T14:43:19.608123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:34:01.304739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.621809+0000","last_change":"2024-05-21T14:43:19.614716+0000","last_active":"2024-05-21T14:43:19.621809+0000","last_peered":"2024-05-21T14:43:19.621809+0000","last_clean":"2024-05-21T14:43:19.621809+0000","last_became_active":"2024-05-21T14:43:19.614451+0000","last_became_peered":"2024-05-21T14:43:19.614451+0000","last_unstale":"2024-05-21T14:43:19.621809+0000","last_undegraded":"2024-05-21T14:43:19.621809+0000","last_fullsized":"2024-05-21T14:43:19.621809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:14:59.635330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.621337+0000","last_change":"2024-05-21T14:43:19.604029+0000","last_active":"2024-05-21T14:43:19.621337+0000","last_peered":"2024-05-21T14:43:19.621337+0000","last_clean":"2024-05-21T14:43:19.621337+0000","last_became_active":"2024-05-21T14:43:19.603164+0000","last_became_peered":"2024-05-21T14:43:19.603164+0000","last_unstale":"2024-05-21T14:43:19.621337+0000","last_undegraded":"2024-05-21T14:43:19.621337+0000","last_fullsized":"2024-05-21T14:43:19.621337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:10:26.141584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578218+0000","last_change":"2024-05-21T14:43:19.613765+0000","last_active":"2024-05-21T14:43:20.578218+0000","last_peered":"2024-05-21T14:43:20.578218+0000","last_clean":"2024-05-21T14:43:20.578218+0000","last_became_active":"2024-05-21T14:43:19.613429+0000","last_became_peered":"2024-05-21T14:43:19.613429+0000","last_unstale":"2024-05-21T14:43:20.578218+0000","last_undegraded":"2024-05-21T14:43:20.578218+0000","last_fullsized":"2024-05-21T14:43:20.578218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:29:16.905434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.611829+0000","last_change":"2024-05-21T14:43:19.607400+0000","last_active":"2024-05-21T14:43:19.611829+0000","last_peered":"2024-05-21T14:43:19.611829+0000","last_clean":"2024-05-21T14:43:19.611829+0000","last_became_active":"2024-05-21T14:43:19.607105+0000","last_became_peered":"2024-05-21T14:43:19.607105+0000","last_unstale":"2024-05-21T14:43:19.611829+0000","last_undegraded":"2024-05-21T14:43:19.611829+0000","last_fullsized":"2024-05-21T14:43:19.611829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:57:38.146049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.611860+0000","last_change":"2024-05-21T14:43:19.606534+0000","last_active":"2024-05-21T14:43:19.611860+0000","last_peered":"2024-05-21T14:43:19.611860+0000","last_clean":"2024-05-21T14:43:19.611860+0000","last_became_active":"2024-05-21T14:43:19.606029+0000","last_became_peered":"2024-05-21T14:43:19.606029+0000","last_unstale":"2024-05-21T14:43:19.611860+0000","last_undegraded":"2024-05-21T14:43:19.611860+0000","last_fullsized":"2024-05-21T14:43:19.611860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:02:43.511861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.614637+0000","last_change":"2024-05-21T14:43:19.609910+0000","last_active":"2024-05-21T14:43:19.614637+0000","last_peered":"2024-05-21T14:43:19.614637+0000","last_clean":"2024-05-21T14:43:19.614637+0000","last_became_active":"2024-05-21T14:43:19.609616+0000","last_became_peered":"2024-05-21T14:43:19.609616+0000","last_unstale":"2024-05-21T14:43:19.614637+0000","last_undegraded":"2024-05-21T14:43:19.614637+0000","last_fullsized":"2024-05-21T14:43:19.614637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:41:09.843165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581855+0000","last_change":"2024-05-21T14:43:19.604001+0000","last_active":"2024-05-21T14:43:20.581855+0000","last_peered":"2024-05-21T14:43:20.581855+0000","last_clean":"2024-05-21T14:43:20.581855+0000","last_became_active":"2024-05-21T14:43:19.596859+0000","last_became_peered":"2024-05-21T14:43:19.596859+0000","last_unstale":"2024-05-21T14:43:20.581855+0000","last_undegraded":"2024-05-21T14:43:20.581855+0000","last_fullsized":"2024-05-21T14:43:20.581855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:45:43.431420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580379+0000","last_change":"2024-05-21T14:43:19.626837+0000","last_active":"2024-05-21T14:43:20.580379+0000","last_peered":"2024-05-21T14:43:20.580379+0000","last_clean":"2024-05-21T14:43:20.580379+0000","last_became_active":"2024-05-21T14:43:19.626213+0000","last_became_peered":"2024-05-21T14:43:19.626213+0000","last_unstale":"2024-05-21T14:43:20.580379+0000","last_undegraded":"2024-05-21T14:43:20.580379+0000","last_fullsized":"2024-05-21T14:43:20.580379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:51.705474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.621876+0000","last_change":"2024-05-21T14:43:19.613483+0000","last_active":"2024-05-21T14:43:19.621876+0000","last_peered":"2024-05-21T14:43:19.621876+0000","last_clean":"2024-05-21T14:43:19.621876+0000","last_became_active":"2024-05-21T14:43:19.612581+0000","last_became_peered":"2024-05-21T14:43:19.612581+0000","last_unstale":"2024-05-21T14:43:19.621876+0000","last_undegraded":"2024-05-21T14:43:19.621876+0000","last_fullsized":"2024-05-21T14:43:19.621876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:27:08.530937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797569+0000","last_change":"2024-05-21T14:43:19.609126+0000","last_active":"2024-05-21T14:43:20.797569+0000","last_peered":"2024-05-21T14:43:20.797569+0000","last_clean":"2024-05-21T14:43:20.797569+0000","last_became_active":"2024-05-21T14:43:19.607967+0000","last_became_peered":"2024-05-21T14:43:19.607967+0000","last_unstale":"2024-05-21T14:43:20.797569+0000","last_undegraded":"2024-05-21T14:43:20.797569+0000","last_fullsized":"2024-05-21T14:43:20.797569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:35.881039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798283+0000","last_change":"2024-05-21T14:43:19.613487+0000","last_active":"2024-05-21T14:43:20.798283+0000","last_peered":"2024-05-21T14:43:20.798283+0000","last_clean":"2024-05-21T14:43:20.798283+0000","last_became_active":"2024-05-21T14:43:19.611280+0000","last_became_peered":"2024-05-21T14:43:19.611280+0000","last_unstale":"2024-05-21T14:43:20.798283+0000","last_undegraded":"2024-05-21T14:43:20.798283+0000","last_fullsized":"2024-05-21T14:43:20.798283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:51:21.887715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581838+0000","last_change":"2024-05-21T14:43:19.607601+0000","last_active":"2024-05-21T14:43:20.581838+0000","last_peered":"2024-05-21T14:43:20.581838+0000","last_clean":"2024-05-21T14:43:20.581838+0000","last_became_active":"2024-05-21T14:43:19.606719+0000","last_became_peered":"2024-05-21T14:43:19.606719+0000","last_unstale":"2024-05-21T14:43:20.581838+0000","last_undegraded":"2024-05-21T14:43:20.581838+0000","last_fullsized":"2024-05-21T14:43:20.581838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:04:32.310805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798234+0000","last_change":"2024-05-21T14:43:19.618470+0000","last_active":"2024-05-21T14:43:20.798234+0000","last_peered":"2024-05-21T14:43:20.798234+0000","last_clean":"2024-05-21T14:43:20.798234+0000","last_became_active":"2024-05-21T14:43:19.617408+0000","last_became_peered":"2024-05-21T14:43:19.617408+0000","last_unstale":"2024-05-21T14:43:20.798234+0000","last_undegraded":"2024-05-21T14:43:20.798234+0000","last_fullsized":"2024-05-21T14:43:20.798234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:53:58.877306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.614613+0000","last_change":"2024-05-21T14:43:19.609835+0000","last_active":"2024-05-21T14:43:19.614613+0000","last_peered":"2024-05-21T14:43:19.614613+0000","last_clean":"2024-05-21T14:43:19.614613+0000","last_became_active":"2024-05-21T14:43:19.609525+0000","last_became_peered":"2024-05-21T14:43:19.609525+0000","last_unstale":"2024-05-21T14:43:19.614613+0000","last_undegraded":"2024-05-21T14:43:19.614613+0000","last_fullsized":"2024-05-21T14:43:19.614613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:45:09.341754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.616061+0000","last_change":"2024-05-21T14:43:19.607732+0000","last_active":"2024-05-21T14:43:19.616061+0000","last_peered":"2024-05-21T14:43:19.616061+0000","last_clean":"2024-05-21T14:43:19.616061+0000","last_became_active":"2024-05-21T14:43:19.606839+0000","last_became_peered":"2024-05-21T14:43:19.606839+0000","last_unstale":"2024-05-21T14:43:19.616061+0000","last_undegraded":"2024-05-21T14:43:19.616061+0000","last_fullsized":"2024-05-21T14:43:19.616061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:09:47.599514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578145+0000","last_change":"2024-05-21T14:43:19.601108+0000","last_active":"2024-05-21T14:43:20.578145+0000","last_peered":"2024-05-21T14:43:20.578145+0000","last_clean":"2024-05-21T14:43:20.578145+0000","last_became_active":"2024-05-21T14:43:19.600780+0000","last_became_peered":"2024-05-21T14:43:19.600780+0000","last_unstale":"2024-05-21T14:43:20.578145+0000","last_undegraded":"2024-05-21T14:43:20.578145+0000","last_fullsized":"2024-05-21T14:43:20.578145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:47:19.062733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.629698+0000","last_change":"2024-05-21T14:43:19.620463+0000","last_active":"2024-05-21T14:43:19.629698+0000","last_peered":"2024-05-21T14:43:19.629698+0000","last_clean":"2024-05-21T14:43:19.629698+0000","last_became_active":"2024-05-21T14:43:19.614489+0000","last_became_peered":"2024-05-21T14:43:19.614489+0000","last_unstale":"2024-05-21T14:43:19.629698+0000","last_undegraded":"2024-05-21T14:43:19.629698+0000","last_fullsized":"2024-05-21T14:43:19.629698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:46:30.260642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797590+0000","last_change":"2024-05-21T14:43:19.624683+0000","last_active":"2024-05-21T14:43:20.797590+0000","last_peered":"2024-05-21T14:43:20.797590+0000","last_clean":"2024-05-21T14:43:20.797590+0000","last_became_active":"2024-05-21T14:43:19.624304+0000","last_became_peered":"2024-05-21T14:43:19.624304+0000","last_unstale":"2024-05-21T14:43:20.797590+0000","last_undegraded":"2024-05-21T14:43:20.797590+0000","last_fullsized":"2024-05-21T14:43:20.797590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:53.874968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.629911+0000","last_change":"2024-05-21T14:43:19.621030+0000","last_active":"2024-05-21T14:43:19.629911+0000","last_peered":"2024-05-21T14:43:19.629911+0000","last_clean":"2024-05-21T14:43:19.629911+0000","last_became_active":"2024-05-21T14:43:19.619072+0000","last_became_peered":"2024-05-21T14:43:19.619072+0000","last_unstale":"2024-05-21T14:43:19.629911+0000","last_undegraded":"2024-05-21T14:43:19.629911+0000","last_fullsized":"2024-05-21T14:43:19.629911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:42:01.412992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.613133+0000","last_change":"2024-05-21T14:43:19.602880+0000","last_active":"2024-05-21T14:43:19.613133+0000","last_peered":"2024-05-21T14:43:19.613133+0000","last_clean":"2024-05-21T14:43:19.613133+0000","last_became_active":"2024-05-21T14:43:19.602577+0000","last_became_peered":"2024-05-21T14:43:19.602577+0000","last_unstale":"2024-05-21T14:43:19.613133+0000","last_undegraded":"2024-05-21T14:43:19.613133+0000","last_fullsized":"2024-05-21T14:43:19.613133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:26:49.337697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582914+0000","last_change":"2024-05-21T14:43:19.632328+0000","last_active":"2024-05-21T14:43:20.582914+0000","last_peered":"2024-05-21T14:43:20.582914+0000","last_clean":"2024-05-21T14:43:20.582914+0000","last_became_active":"2024-05-21T14:43:19.631351+0000","last_became_peered":"2024-05-21T14:43:19.631351+0000","last_unstale":"2024-05-21T14:43:20.582914+0000","last_undegraded":"2024-05-21T14:43:20.582914+0000","last_fullsized":"2024-05-21T14:43:20.582914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:36:18.467070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582481+0000","last_change":"2024-05-21T14:43:19.632282+0000","last_active":"2024-05-21T14:43:20.582481+0000","last_peered":"2024-05-21T14:43:20.582481+0000","last_clean":"2024-05-21T14:43:20.582481+0000","last_became_active":"2024-05-21T14:43:19.631522+0000","last_became_peered":"2024-05-21T14:43:19.631522+0000","last_unstale":"2024-05-21T14:43:20.582481+0000","last_undegraded":"2024-05-21T14:43:20.582481+0000","last_fullsized":"2024-05-21T14:43:20.582481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:23:32.646087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.629820+0000","last_change":"2024-05-21T14:43:19.620046+0000","last_active":"2024-05-21T14:43:19.629820+0000","last_peered":"2024-05-21T14:43:19.629820+0000","last_clean":"2024-05-21T14:43:19.629820+0000","last_became_active":"2024-05-21T14:43:19.612428+0000","last_became_peered":"2024-05-21T14:43:19.612428+0000","last_unstale":"2024-05-21T14:43:19.629820+0000","last_undegraded":"2024-05-21T14:43:19.629820+0000","last_fullsized":"2024-05-21T14:43:19.629820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:00:17.098253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797667+0000","last_change":"2024-05-21T14:43:19.618198+0000","last_active":"2024-05-21T14:43:20.797667+0000","last_peered":"2024-05-21T14:43:20.797667+0000","last_clean":"2024-05-21T14:43:20.797667+0000","last_became_active":"2024-05-21T14:43:19.617903+0000","last_became_peered":"2024-05-21T14:43:19.617903+0000","last_unstale":"2024-05-21T14:43:20.797667+0000","last_undegraded":"2024-05-21T14:43:20.797667+0000","last_fullsized":"2024-05-21T14:43:20.797667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:59.606862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580507+0000","last_change":"2024-05-21T14:43:19.613942+0000","last_active":"2024-05-21T14:43:20.580507+0000","last_peered":"2024-05-21T14:43:20.580507+0000","last_clean":"2024-05-21T14:43:20.580507+0000","last_became_active":"2024-05-21T14:43:19.613035+0000","last_became_peered":"2024-05-21T14:43:19.613035+0000","last_unstale":"2024-05-21T14:43:20.580507+0000","last_undegraded":"2024-05-21T14:43:20.580507+0000","last_fullsized":"2024-05-21T14:43:20.580507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:47:46.462547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.628660+0000","last_change":"2024-05-21T14:43:19.626414+0000","last_active":"2024-05-21T14:43:19.628660+0000","last_peered":"2024-05-21T14:43:19.628660+0000","last_clean":"2024-05-21T14:43:19.628660+0000","last_became_active":"2024-05-21T14:43:19.626080+0000","last_became_peered":"2024-05-21T14:43:19.626080+0000","last_unstale":"2024-05-21T14:43:19.628660+0000","last_undegraded":"2024-05-21T14:43:19.628660+0000","last_fullsized":"2024-05-21T14:43:19.628660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:37:36.970091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578382+0000","last_change":"2024-05-21T14:43:19.620806+0000","last_active":"2024-05-21T14:43:20.578382+0000","last_peered":"2024-05-21T14:43:20.578382+0000","last_clean":"2024-05-21T14:43:20.578382+0000","last_became_active":"2024-05-21T14:43:19.620449+0000","last_became_peered":"2024-05-21T14:43:19.620449+0000","last_unstale":"2024-05-21T14:43:20.578382+0000","last_undegraded":"2024-05-21T14:43:20.578382+0000","last_fullsized":"2024-05-21T14:43:20.578382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:43:52.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.593679+0000","last_change":"2024-05-21T14:43:18.603028+0000","last_active":"2024-05-21T14:43:19.593679+0000","last_peered":"2024-05-21T14:43:19.593679+0000","last_clean":"2024-05-21T14:43:19.593679+0000","last_became_active":"2024-05-21T14:43:18.602036+0000","last_became_peered":"2024-05-21T14:43:18.602036+0000","last_unstale":"2024-05-21T14:43:19.593679+0000","last_undegraded":"2024-05-21T14:43:19.593679+0000","last_fullsized":"2024-05-21T14:43:19.593679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:15:25.384197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.612610+0000","last_change":"2024-05-21T14:43:19.599725+0000","last_active":"2024-05-21T14:43:19.612610+0000","last_peered":"2024-05-21T14:43:19.612610+0000","last_clean":"2024-05-21T14:43:19.612610+0000","last_became_active":"2024-05-21T14:43:19.598972+0000","last_became_peered":"2024-05-21T14:43:19.598972+0000","last_unstale":"2024-05-21T14:43:19.612610+0000","last_undegraded":"2024-05-21T14:43:19.612610+0000","last_fullsized":"2024-05-21T14:43:19.612610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:35:47.007541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797779+0000","last_change":"2024-05-21T14:43:18.615934+0000","last_active":"2024-05-21T14:43:20.797779+0000","last_peered":"2024-05-21T14:43:20.797779+0000","last_clean":"2024-05-21T14:43:20.797779+0000","last_became_active":"2024-05-21T14:43:18.615568+0000","last_became_peered":"2024-05-21T14:43:18.615568+0000","last_unstale":"2024-05-21T14:43:20.797779+0000","last_undegraded":"2024-05-21T14:43:20.797779+0000","last_fullsized":"2024-05-21T14:43:20.797779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:28:54.494319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580346+0000","last_change":"2024-05-21T14:43:18.615154+0000","last_active":"2024-05-21T14:43:20.580346+0000","last_peered":"2024-05-21T14:43:20.580346+0000","last_clean":"2024-05-21T14:43:20.580346+0000","last_became_active":"2024-05-21T14:43:18.613838+0000","last_became_peered":"2024-05-21T14:43:18.613838+0000","last_unstale":"2024-05-21T14:43:20.580346+0000","last_undegraded":"2024-05-21T14:43:20.580346+0000","last_fullsized":"2024-05-21T14:43:20.580346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:32:09.174124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.636851+0000","last_change":"2024-05-21T14:43:19.633585+0000","last_active":"2024-05-21T14:43:19.636851+0000","last_peered":"2024-05-21T14:43:19.636851+0000","last_clean":"2024-05-21T14:43:19.636851+0000","last_became_active":"2024-05-21T14:43:19.632476+0000","last_became_peered":"2024-05-21T14:43:19.632476+0000","last_unstale":"2024-05-21T14:43:19.636851+0000","last_undegraded":"2024-05-21T14:43:19.636851+0000","last_fullsized":"2024-05-21T14:43:19.636851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:26:49.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797713+0000","last_change":"2024-05-21T14:43:18.585548+0000","last_active":"2024-05-21T14:43:20.797713+0000","last_peered":"2024-05-21T14:43:20.797713+0000","last_clean":"2024-05-21T14:43:20.797713+0000","last_became_active":"2024-05-21T14:43:18.585099+0000","last_became_peered":"2024-05-21T14:43:18.585099+0000","last_unstale":"2024-05-21T14:43:20.797713+0000","last_undegraded":"2024-05-21T14:43:20.797713+0000","last_fullsized":"2024-05-21T14:43:20.797713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:20:16.856225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.621078+0000","last_change":"2024-05-21T14:43:19.614884+0000","last_active":"2024-05-21T14:43:19.621078+0000","last_peered":"2024-05-21T14:43:19.621078+0000","last_clean":"2024-05-21T14:43:19.621078+0000","last_became_active":"2024-05-21T14:43:19.614064+0000","last_became_peered":"2024-05-21T14:43:19.614064+0000","last_unstale":"2024-05-21T14:43:19.621078+0000","last_undegraded":"2024-05-21T14:43:19.621078+0000","last_fullsized":"2024-05-21T14:43:19.621078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:36:30.945895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578207+0000","last_change":"2024-05-21T14:43:18.602794+0000","last_active":"2024-05-21T14:43:20.578207+0000","last_peered":"2024-05-21T14:43:20.578207+0000","last_clean":"2024-05-21T14:43:20.578207+0000","last_became_active":"2024-05-21T14:43:18.602429+0000","last_became_peered":"2024-05-21T14:43:18.602429+0000","last_unstale":"2024-05-21T14:43:20.578207+0000","last_undegraded":"2024-05-21T14:43:20.578207+0000","last_fullsized":"2024-05-21T14:43:20.578207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:50:14.465202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.613108+0000","last_change":"2024-05-21T14:43:19.602663+0000","last_active":"2024-05-21T14:43:19.613108+0000","last_peered":"2024-05-21T14:43:19.613108+0000","last_clean":"2024-05-21T14:43:19.613108+0000","last_became_active":"2024-05-21T14:43:19.602294+0000","last_became_peered":"2024-05-21T14:43:19.602294+0000","last_unstale":"2024-05-21T14:43:19.613108+0000","last_undegraded":"2024-05-21T14:43:19.613108+0000","last_fullsized":"2024-05-21T14:43:19.613108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:52:34.816423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.595048+0000","last_change":"2024-05-21T14:43:18.604601+0000","last_active":"2024-05-21T14:43:19.595048+0000","last_peered":"2024-05-21T14:43:19.595048+0000","last_clean":"2024-05-21T14:43:19.595048+0000","last_became_active":"2024-05-21T14:43:18.604262+0000","last_became_peered":"2024-05-21T14:43:18.604262+0000","last_unstale":"2024-05-21T14:43:19.595048+0000","last_undegraded":"2024-05-21T14:43:19.595048+0000","last_fullsized":"2024-05-21T14:43:19.595048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:15.490579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.627752+0000","last_change":"2024-05-21T14:43:19.613952+0000","last_active":"2024-05-21T14:43:19.627752+0000","last_peered":"2024-05-21T14:43:19.627752+0000","last_clean":"2024-05-21T14:43:19.627752+0000","last_became_active":"2024-05-21T14:43:19.613093+0000","last_became_peered":"2024-05-21T14:43:19.613093+0000","last_unstale":"2024-05-21T14:43:19.627752+0000","last_undegraded":"2024-05-21T14:43:19.627752+0000","last_fullsized":"2024-05-21T14:43:19.627752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:32:40.371835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580684+0000","last_change":"2024-05-21T14:43:18.602343+0000","last_active":"2024-05-21T14:43:20.580684+0000","last_peered":"2024-05-21T14:43:20.580684+0000","last_clean":"2024-05-21T14:43:20.580684+0000","last_became_active":"2024-05-21T14:43:18.601500+0000","last_became_peered":"2024-05-21T14:43:18.601500+0000","last_unstale":"2024-05-21T14:43:20.580684+0000","last_undegraded":"2024-05-21T14:43:20.580684+0000","last_fullsized":"2024-05-21T14:43:20.580684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:54:21.960430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798025+0000","last_change":"2024-05-21T14:43:19.608580+0000","last_active":"2024-05-21T14:43:20.798025+0000","last_peered":"2024-05-21T14:43:20.798025+0000","last_clean":"2024-05-21T14:43:20.798025+0000","last_became_active":"2024-05-21T14:43:19.608038+0000","last_became_peered":"2024-05-21T14:43:19.608038+0000","last_unstale":"2024-05-21T14:43:20.798025+0000","last_undegraded":"2024-05-21T14:43:20.798025+0000","last_fullsized":"2024-05-21T14:43:20.798025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:19.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.578905+0000","last_change":"2024-05-21T14:43:18.606824+0000","last_active":"2024-05-21T14:43:19.578905+0000","last_peered":"2024-05-21T14:43:19.578905+0000","last_clean":"2024-05-21T14:43:19.578905+0000","last_became_active":"2024-05-21T14:43:18.606449+0000","last_became_peered":"2024-05-21T14:43:18.606449+0000","last_unstale":"2024-05-21T14:43:19.578905+0000","last_undegraded":"2024-05-21T14:43:19.578905+0000","last_fullsized":"2024-05-21T14:43:19.578905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:43:41.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.637234+0000","last_change":"2024-05-21T14:43:19.634014+0000","last_active":"2024-05-21T14:43:19.637234+0000","last_peered":"2024-05-21T14:43:19.637234+0000","last_clean":"2024-05-21T14:43:19.637234+0000","last_became_active":"2024-05-21T14:43:19.633664+0000","last_became_peered":"2024-05-21T14:43:19.633664+0000","last_unstale":"2024-05-21T14:43:19.637234+0000","last_undegraded":"2024-05-21T14:43:19.637234+0000","last_fullsized":"2024-05-21T14:43:19.637234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:06:31.443201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581596+0000","last_change":"2024-05-21T14:43:18.614764+0000","last_active":"2024-05-21T14:43:20.581596+0000","last_peered":"2024-05-21T14:43:20.581596+0000","last_clean":"2024-05-21T14:43:20.581596+0000","last_became_active":"2024-05-21T14:43:18.614214+0000","last_became_peered":"2024-05-21T14:43:18.614214+0000","last_unstale":"2024-05-21T14:43:20.581596+0000","last_undegraded":"2024-05-21T14:43:20.581596+0000","last_fullsized":"2024-05-21T14:43:20.581596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:34:40.294756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580771+0000","last_change":"2024-05-21T14:43:19.625313+0000","last_active":"2024-05-21T14:43:20.580771+0000","last_peered":"2024-05-21T14:43:20.580771+0000","last_clean":"2024-05-21T14:43:20.580771+0000","last_became_active":"2024-05-21T14:43:19.624474+0000","last_became_peered":"2024-05-21T14:43:19.624474+0000","last_unstale":"2024-05-21T14:43:20.580771+0000","last_undegraded":"2024-05-21T14:43:20.580771+0000","last_fullsized":"2024-05-21T14:43:20.580771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:28.280456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797927+0000","last_change":"2024-05-21T14:43:18.600736+0000","last_active":"2024-05-21T14:43:20.797927+0000","last_peered":"2024-05-21T14:43:20.797927+0000","last_clean":"2024-05-21T14:43:20.797927+0000","last_became_active":"2024-05-21T14:43:18.600415+0000","last_became_peered":"2024-05-21T14:43:18.600415+0000","last_unstale":"2024-05-21T14:43:20.797927+0000","last_undegraded":"2024-05-21T14:43:20.797927+0000","last_fullsized":"2024-05-21T14:43:20.797927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:03:57.207603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797724+0000","last_change":"2024-05-21T14:43:19.599637+0000","last_active":"2024-05-21T14:43:20.797724+0000","last_peered":"2024-05-21T14:43:20.797724+0000","last_clean":"2024-05-21T14:43:20.797724+0000","last_became_active":"2024-05-21T14:43:19.599195+0000","last_became_peered":"2024-05-21T14:43:19.599195+0000","last_unstale":"2024-05-21T14:43:20.797724+0000","last_undegraded":"2024-05-21T14:43:20.797724+0000","last_fullsized":"2024-05-21T14:43:20.797724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:17.350821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.594502+0000","last_change":"2024-05-21T14:43:18.603064+0000","last_active":"2024-05-21T14:43:19.594502+0000","last_peered":"2024-05-21T14:43:19.594502+0000","last_clean":"2024-05-21T14:43:19.594502+0000","last_became_active":"2024-05-21T14:43:18.602658+0000","last_became_peered":"2024-05-21T14:43:18.602658+0000","last_unstale":"2024-05-21T14:43:19.594502+0000","last_undegraded":"2024-05-21T14:43:19.594502+0000","last_fullsized":"2024-05-21T14:43:19.594502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:09:28.623131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.577809+0000","last_change":"2024-05-21T14:43:19.620760+0000","last_active":"2024-05-21T14:43:20.577809+0000","last_peered":"2024-05-21T14:43:20.577809+0000","last_clean":"2024-05-21T14:43:20.577809+0000","last_became_active":"2024-05-21T14:43:19.620409+0000","last_became_peered":"2024-05-21T14:43:19.620409+0000","last_unstale":"2024-05-21T14:43:20.577809+0000","last_undegraded":"2024-05-21T14:43:20.577809+0000","last_fullsized":"2024-05-21T14:43:20.577809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:49:59.051131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.581050+0000","last_change":"2024-05-21T14:43:18.594225+0000","last_active":"2024-05-21T14:43:19.581050+0000","last_peered":"2024-05-21T14:43:19.581050+0000","last_clean":"2024-05-21T14:43:19.581050+0000","last_became_active":"2024-05-21T14:43:18.592335+0000","last_became_peered":"2024-05-21T14:43:18.592335+0000","last_unstale":"2024-05-21T14:43:19.581050+0000","last_undegraded":"2024-05-21T14:43:19.581050+0000","last_fullsized":"2024-05-21T14:43:19.581050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:00:58.772091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797667+0000","last_change":"2024-05-21T14:43:19.612442+0000","last_active":"2024-05-21T14:43:20.797667+0000","last_peered":"2024-05-21T14:43:20.797667+0000","last_clean":"2024-05-21T14:43:20.797667+0000","last_became_active":"2024-05-21T14:43:19.612110+0000","last_became_peered":"2024-05-21T14:43:19.612110+0000","last_unstale":"2024-05-21T14:43:20.797667+0000","last_undegraded":"2024-05-21T14:43:20.797667+0000","last_fullsized":"2024-05-21T14:43:20.797667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:53.451513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.606105+0000","last_change":"2024-05-21T14:43:18.613433+0000","last_active":"2024-05-21T14:43:19.606105+0000","last_peered":"2024-05-21T14:43:19.606105+0000","last_clean":"2024-05-21T14:43:19.606105+0000","last_became_active":"2024-05-21T14:43:18.613048+0000","last_became_peered":"2024-05-21T14:43:18.613048+0000","last_unstale":"2024-05-21T14:43:19.606105+0000","last_undegraded":"2024-05-21T14:43:19.606105+0000","last_fullsized":"2024-05-21T14:43:19.606105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:00:16.454574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.606736+0000","last_change":"2024-05-21T14:43:19.597079+0000","last_active":"2024-05-21T14:43:19.606736+0000","last_peered":"2024-05-21T14:43:19.606736+0000","last_clean":"2024-05-21T14:43:19.606736+0000","last_became_active":"2024-05-21T14:43:19.596736+0000","last_became_peered":"2024-05-21T14:43:19.596736+0000","last_unstale":"2024-05-21T14:43:19.606736+0000","last_undegraded":"2024-05-21T14:43:19.606736+0000","last_fullsized":"2024-05-21T14:43:19.606736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:40:53.911145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.584585+0000","last_change":"2024-05-21T14:43:18.620603+0000","last_active":"2024-05-21T14:43:19.584585+0000","last_peered":"2024-05-21T14:43:19.584585+0000","last_clean":"2024-05-21T14:43:19.584585+0000","last_became_active":"2024-05-21T14:43:18.619762+0000","last_became_peered":"2024-05-21T14:43:18.619762+0000","last_unstale":"2024-05-21T14:43:19.584585+0000","last_undegraded":"2024-05-21T14:43:19.584585+0000","last_fullsized":"2024-05-21T14:43:19.584585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:31:49.257435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.619464+0000","last_change":"2024-05-21T14:43:19.611608+0000","last_active":"2024-05-21T14:43:19.619464+0000","last_peered":"2024-05-21T14:43:19.619464+0000","last_clean":"2024-05-21T14:43:19.619464+0000","last_became_active":"2024-05-21T14:43:19.610774+0000","last_became_peered":"2024-05-21T14:43:19.610774+0000","last_unstale":"2024-05-21T14:43:19.619464+0000","last_undegraded":"2024-05-21T14:43:19.619464+0000","last_fullsized":"2024-05-21T14:43:19.619464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:21:25.127827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.604792+0000","last_change":"2024-05-21T14:43:18.610121+0000","last_active":"2024-05-21T14:43:19.604792+0000","last_peered":"2024-05-21T14:43:19.604792+0000","last_clean":"2024-05-21T14:43:19.604792+0000","last_became_active":"2024-05-21T14:43:18.609349+0000","last_became_peered":"2024-05-21T14:43:18.609349+0000","last_unstale":"2024-05-21T14:43:19.604792+0000","last_undegraded":"2024-05-21T14:43:19.604792+0000","last_fullsized":"2024-05-21T14:43:19.604792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:48.330067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.611903+0000","last_change":"2024-05-21T14:43:19.605193+0000","last_active":"2024-05-21T14:43:19.611903+0000","last_peered":"2024-05-21T14:43:19.611903+0000","last_clean":"2024-05-21T14:43:19.611903+0000","last_became_active":"2024-05-21T14:43:19.604869+0000","last_became_peered":"2024-05-21T14:43:19.604869+0000","last_unstale":"2024-05-21T14:43:19.611903+0000","last_undegraded":"2024-05-21T14:43:19.611903+0000","last_fullsized":"2024-05-21T14:43:19.611903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:01.096215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582847+0000","last_change":"2024-05-21T14:43:18.616535+0000","last_active":"2024-05-21T14:43:20.582847+0000","last_peered":"2024-05-21T14:43:20.582847+0000","last_clean":"2024-05-21T14:43:20.582847+0000","last_became_active":"2024-05-21T14:43:18.615734+0000","last_became_peered":"2024-05-21T14:43:18.615734+0000","last_unstale":"2024-05-21T14:43:20.582847+0000","last_undegraded":"2024-05-21T14:43:20.582847+0000","last_fullsized":"2024-05-21T14:43:20.582847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:10:27.821535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798116+0000","last_change":"2024-05-21T14:43:19.615424+0000","last_active":"2024-05-21T14:43:20.798116+0000","last_peered":"2024-05-21T14:43:20.798116+0000","last_clean":"2024-05-21T14:43:20.798116+0000","last_became_active":"2024-05-21T14:43:19.614915+0000","last_became_peered":"2024-05-21T14:43:19.614915+0000","last_unstale":"2024-05-21T14:43:20.798116+0000","last_undegraded":"2024-05-21T14:43:20.798116+0000","last_fullsized":"2024-05-21T14:43:20.798116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:25:09.153430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.577738+0000","last_change":"2024-05-21T14:43:08.080234+0000","last_active":"2024-05-21T14:43:20.577738+0000","last_peered":"2024-05-21T14:43:20.577738+0000","last_clean":"2024-05-21T14:43:20.577738+0000","last_became_active":"2024-05-21T14:43:08.079934+0000","last_became_peered":"2024-05-21T14:43:08.079934+0000","last_unstale":"2024-05-21T14:43:20.577738+0000","last_undegraded":"2024-05-21T14:43:20.577738+0000","last_fullsized":"2024-05-21T14:43:20.577738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_clean_scrub_stamp":"2024-05-21T14:43:07.046978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:54:57.347768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797966+0000","last_change":"2024-05-21T14:43:18.599850+0000","last_active":"2024-05-21T14:43:20.797966+0000","last_peered":"2024-05-21T14:43:20.797966+0000","last_clean":"2024-05-21T14:43:20.797966+0000","last_became_active":"2024-05-21T14:43:18.599347+0000","last_became_peered":"2024-05-21T14:43:18.599347+0000","last_unstale":"2024-05-21T14:43:20.797966+0000","last_undegraded":"2024-05-21T14:43:20.797966+0000","last_fullsized":"2024-05-21T14:43:20.797966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:01:06.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.620999+0000","last_change":"2024-05-21T14:43:19.613056+0000","last_active":"2024-05-21T14:43:19.620999+0000","last_peered":"2024-05-21T14:43:19.620999+0000","last_clean":"2024-05-21T14:43:19.620999+0000","last_became_active":"2024-05-21T14:43:19.611889+0000","last_became_peered":"2024-05-21T14:43:19.611889+0000","last_unstale":"2024-05-21T14:43:19.620999+0000","last_undegraded":"2024-05-21T14:43:19.620999+0000","last_fullsized":"2024-05-21T14:43:19.620999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:25.723296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797781+0000","last_change":"2024-05-21T14:43:18.621482+0000","last_active":"2024-05-21T14:43:20.797781+0000","last_peered":"2024-05-21T14:43:20.797781+0000","last_clean":"2024-05-21T14:43:20.797781+0000","last_became_active":"2024-05-21T14:43:18.621229+0000","last_became_peered":"2024-05-21T14:43:18.621229+0000","last_unstale":"2024-05-21T14:43:20.797781+0000","last_undegraded":"2024-05-21T14:43:20.797781+0000","last_fullsized":"2024-05-21T14:43:20.797781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:30:04.326588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580381+0000","last_change":"2024-05-21T14:43:19.625038+0000","last_active":"2024-05-21T14:43:20.580381+0000","last_peered":"2024-05-21T14:43:20.580381+0000","last_clean":"2024-05-21T14:43:20.580381+0000","last_became_active":"2024-05-21T14:43:19.624114+0000","last_became_peered":"2024-05-21T14:43:19.624114+0000","last_unstale":"2024-05-21T14:43:20.580381+0000","last_undegraded":"2024-05-21T14:43:20.580381+0000","last_fullsized":"2024-05-21T14:43:20.580381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:11.854243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580843+0000","last_change":"2024-05-21T14:43:18.618518+0000","last_active":"2024-05-21T14:43:20.580843+0000","last_peered":"2024-05-21T14:43:20.580843+0000","last_clean":"2024-05-21T14:43:20.580843+0000","last_became_active":"2024-05-21T14:43:18.617756+0000","last_became_peered":"2024-05-21T14:43:18.617756+0000","last_unstale":"2024-05-21T14:43:20.580843+0000","last_undegraded":"2024-05-21T14:43:20.580843+0000","last_fullsized":"2024-05-21T14:43:20.580843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:52:12.999877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.628737+0000","last_change":"2024-05-21T14:43:19.613595+0000","last_active":"2024-05-21T14:43:19.628737+0000","last_peered":"2024-05-21T14:43:19.628737+0000","last_clean":"2024-05-21T14:43:19.628737+0000","last_became_active":"2024-05-21T14:43:19.612730+0000","last_became_peered":"2024-05-21T14:43:19.612730+0000","last_unstale":"2024-05-21T14:43:19.628737+0000","last_undegraded":"2024-05-21T14:43:19.628737+0000","last_fullsized":"2024-05-21T14:43:19.628737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:33:07.887382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797922+0000","last_change":"2024-05-21T14:43:18.608596+0000","last_active":"2024-05-21T14:43:20.797922+0000","last_peered":"2024-05-21T14:43:20.797922+0000","last_clean":"2024-05-21T14:43:20.797922+0000","last_became_active":"2024-05-21T14:43:18.608262+0000","last_became_peered":"2024-05-21T14:43:18.608262+0000","last_unstale":"2024-05-21T14:43:20.797922+0000","last_undegraded":"2024-05-21T14:43:20.797922+0000","last_fullsized":"2024-05-21T14:43:20.797922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:14.962554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.611880+0000","last_change":"2024-05-21T14:43:19.607815+0000","last_active":"2024-05-21T14:43:19.611880+0000","last_peered":"2024-05-21T14:43:19.611880+0000","last_clean":"2024-05-21T14:43:19.611880+0000","last_became_active":"2024-05-21T14:43:19.607513+0000","last_became_peered":"2024-05-21T14:43:19.607513+0000","last_unstale":"2024-05-21T14:43:19.611880+0000","last_undegraded":"2024-05-21T14:43:19.611880+0000","last_fullsized":"2024-05-21T14:43:19.611880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:25:41.611597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.600507+0000","last_change":"2024-05-21T14:43:18.603626+0000","last_active":"2024-05-21T14:43:19.600507+0000","last_peered":"2024-05-21T14:43:19.600507+0000","last_clean":"2024-05-21T14:43:19.600507+0000","last_became_active":"2024-05-21T14:43:18.602704+0000","last_became_peered":"2024-05-21T14:43:18.602704+0000","last_unstale":"2024-05-21T14:43:19.600507+0000","last_undegraded":"2024-05-21T14:43:19.600507+0000","last_fullsized":"2024-05-21T14:43:19.600507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:03.976820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.637396+0000","last_change":"2024-05-21T14:43:19.634449+0000","last_active":"2024-05-21T14:43:19.637396+0000","last_peered":"2024-05-21T14:43:19.637396+0000","last_clean":"2024-05-21T14:43:19.637396+0000","last_became_active":"2024-05-21T14:43:19.633751+0000","last_became_peered":"2024-05-21T14:43:19.633751+0000","last_unstale":"2024-05-21T14:43:19.637396+0000","last_undegraded":"2024-05-21T14:43:19.637396+0000","last_fullsized":"2024-05-21T14:43:19.637396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:03:27.048216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798236+0000","last_change":"2024-05-21T14:43:18.608335+0000","last_active":"2024-05-21T14:43:20.798236+0000","last_peered":"2024-05-21T14:43:20.798236+0000","last_clean":"2024-05-21T14:43:20.798236+0000","last_became_active":"2024-05-21T14:43:18.607999+0000","last_became_peered":"2024-05-21T14:43:18.607999+0000","last_unstale":"2024-05-21T14:43:20.798236+0000","last_undegraded":"2024-05-21T14:43:20.798236+0000","last_fullsized":"2024-05-21T14:43:20.798236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:21.325953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582549+0000","last_change":"2024-05-21T14:43:19.626742+0000","last_active":"2024-05-21T14:43:20.582549+0000","last_peered":"2024-05-21T14:43:20.582549+0000","last_clean":"2024-05-21T14:43:20.582549+0000","last_became_active":"2024-05-21T14:43:19.626024+0000","last_became_peered":"2024-05-21T14:43:19.626024+0000","last_unstale":"2024-05-21T14:43:20.582549+0000","last_undegraded":"2024-05-21T14:43:20.582549+0000","last_fullsized":"2024-05-21T14:43:20.582549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:48:15.426224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.585058+0000","last_change":"2024-05-21T14:43:18.616913+0000","last_active":"2024-05-21T14:43:19.585058+0000","last_peered":"2024-05-21T14:43:19.585058+0000","last_clean":"2024-05-21T14:43:19.585058+0000","last_became_active":"2024-05-21T14:43:18.616214+0000","last_became_peered":"2024-05-21T14:43:18.616214+0000","last_unstale":"2024-05-21T14:43:19.585058+0000","last_undegraded":"2024-05-21T14:43:19.585058+0000","last_fullsized":"2024-05-21T14:43:19.585058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:22.112018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.615955+0000","last_change":"2024-05-21T14:43:19.607521+0000","last_active":"2024-05-21T14:43:19.615955+0000","last_peered":"2024-05-21T14:43:19.615955+0000","last_clean":"2024-05-21T14:43:19.615955+0000","last_became_active":"2024-05-21T14:43:19.606673+0000","last_became_peered":"2024-05-21T14:43:19.606673+0000","last_unstale":"2024-05-21T14:43:19.615955+0000","last_undegraded":"2024-05-21T14:43:19.615955+0000","last_fullsized":"2024-05-21T14:43:19.615955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:10:05.239647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798313+0000","last_change":"2024-05-21T14:43:18.615846+0000","last_active":"2024-05-21T14:43:20.798313+0000","last_peered":"2024-05-21T14:43:20.798313+0000","last_clean":"2024-05-21T14:43:20.798313+0000","last_became_active":"2024-05-21T14:43:18.615506+0000","last_became_peered":"2024-05-21T14:43:18.615506+0000","last_unstale":"2024-05-21T14:43:20.798313+0000","last_undegraded":"2024-05-21T14:43:20.798313+0000","last_fullsized":"2024-05-21T14:43:20.798313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:07:17.030757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.616157+0000","last_change":"2024-05-21T14:43:19.611473+0000","last_active":"2024-05-21T14:43:19.616157+0000","last_peered":"2024-05-21T14:43:19.616157+0000","last_clean":"2024-05-21T14:43:19.616157+0000","last_became_active":"2024-05-21T14:43:19.610600+0000","last_became_peered":"2024-05-21T14:43:19.610600+0000","last_unstale":"2024-05-21T14:43:19.616157+0000","last_undegraded":"2024-05-21T14:43:19.616157+0000","last_fullsized":"2024-05-21T14:43:19.616157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:52:08.240959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.594071+0000","last_change":"2024-05-21T14:43:18.604951+0000","last_active":"2024-05-21T14:43:19.594071+0000","last_peered":"2024-05-21T14:43:19.594071+0000","last_clean":"2024-05-21T14:43:19.594071+0000","last_became_active":"2024-05-21T14:43:18.602186+0000","last_became_peered":"2024-05-21T14:43:18.602186+0000","last_unstale":"2024-05-21T14:43:19.594071+0000","last_undegraded":"2024-05-21T14:43:19.594071+0000","last_fullsized":"2024-05-21T14:43:19.594071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:34:10.395484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797647+0000","last_change":"2024-05-21T14:43:19.600827+0000","last_active":"2024-05-21T14:43:20.797647+0000","last_peered":"2024-05-21T14:43:20.797647+0000","last_clean":"2024-05-21T14:43:20.797647+0000","last_became_active":"2024-05-21T14:43:19.600499+0000","last_became_peered":"2024-05-21T14:43:19.600499+0000","last_unstale":"2024-05-21T14:43:20.797647+0000","last_undegraded":"2024-05-21T14:43:20.797647+0000","last_fullsized":"2024-05-21T14:43:20.797647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:55:36.231321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.583134+0000","last_change":"2024-05-21T14:43:18.615190+0000","last_active":"2024-05-21T14:43:19.583134+0000","last_peered":"2024-05-21T14:43:19.583134+0000","last_clean":"2024-05-21T14:43:19.583134+0000","last_became_active":"2024-05-21T14:43:18.614306+0000","last_became_peered":"2024-05-21T14:43:18.614306+0000","last_unstale":"2024-05-21T14:43:19.583134+0000","last_undegraded":"2024-05-21T14:43:19.583134+0000","last_fullsized":"2024-05-21T14:43:19.583134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:53.472559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.618339+0000","last_change":"2024-05-21T14:43:19.610903+0000","last_active":"2024-05-21T14:43:19.618339+0000","last_peered":"2024-05-21T14:43:19.618339+0000","last_clean":"2024-05-21T14:43:19.618339+0000","last_became_active":"2024-05-21T14:43:19.610101+0000","last_became_peered":"2024-05-21T14:43:19.610101+0000","last_unstale":"2024-05-21T14:43:19.618339+0000","last_undegraded":"2024-05-21T14:43:19.618339+0000","last_fullsized":"2024-05-21T14:43:19.618339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:46:19.554016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581222+0000","last_change":"2024-05-21T14:43:18.617785+0000","last_active":"2024-05-21T14:43:20.581222+0000","last_peered":"2024-05-21T14:43:20.581222+0000","last_clean":"2024-05-21T14:43:20.581222+0000","last_became_active":"2024-05-21T14:43:18.617041+0000","last_became_peered":"2024-05-21T14:43:18.617041+0000","last_unstale":"2024-05-21T14:43:20.581222+0000","last_undegraded":"2024-05-21T14:43:20.581222+0000","last_fullsized":"2024-05-21T14:43:20.581222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:02:50.837158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581606+0000","last_change":"2024-05-21T14:43:19.627096+0000","last_active":"2024-05-21T14:43:20.581606+0000","last_peered":"2024-05-21T14:43:20.581606+0000","last_clean":"2024-05-21T14:43:20.581606+0000","last_became_active":"2024-05-21T14:43:19.626265+0000","last_became_peered":"2024-05-21T14:43:19.626265+0000","last_unstale":"2024-05-21T14:43:20.581606+0000","last_undegraded":"2024-05-21T14:43:20.581606+0000","last_fullsized":"2024-05-21T14:43:20.581606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:23:47.818120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797832+0000","last_change":"2024-05-21T14:43:18.599635+0000","last_active":"2024-05-21T14:43:20.797832+0000","last_peered":"2024-05-21T14:43:20.797832+0000","last_clean":"2024-05-21T14:43:20.797832+0000","last_became_active":"2024-05-21T14:43:18.598996+0000","last_became_peered":"2024-05-21T14:43:18.598996+0000","last_unstale":"2024-05-21T14:43:20.797832+0000","last_undegraded":"2024-05-21T14:43:20.797832+0000","last_fullsized":"2024-05-21T14:43:20.797832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:17:09.383291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797767+0000","last_change":"2024-05-21T14:43:19.617686+0000","last_active":"2024-05-21T14:43:20.797767+0000","last_peered":"2024-05-21T14:43:20.797767+0000","last_clean":"2024-05-21T14:43:20.797767+0000","last_became_active":"2024-05-21T14:43:19.617398+0000","last_became_peered":"2024-05-21T14:43:19.617398+0000","last_unstale":"2024-05-21T14:43:20.797767+0000","last_undegraded":"2024-05-21T14:43:20.797767+0000","last_fullsized":"2024-05-21T14:43:20.797767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:21:06.527871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798047+0000","last_change":"2024-05-21T14:43:19.601673+0000","last_active":"2024-05-21T14:43:20.798047+0000","last_peered":"2024-05-21T14:43:20.798047+0000","last_clean":"2024-05-21T14:43:20.798047+0000","last_became_active":"2024-05-21T14:43:19.601286+0000","last_became_peered":"2024-05-21T14:43:19.601286+0000","last_unstale":"2024-05-21T14:43:20.798047+0000","last_undegraded":"2024-05-21T14:43:20.798047+0000","last_fullsized":"2024-05-21T14:43:20.798047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:21:22.955055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.595034+0000","last_change":"2024-05-21T14:43:18.613555+0000","last_active":"2024-05-21T14:43:19.595034+0000","last_peered":"2024-05-21T14:43:19.595034+0000","last_clean":"2024-05-21T14:43:19.595034+0000","last_became_active":"2024-05-21T14:43:18.613117+0000","last_became_peered":"2024-05-21T14:43:18.613117+0000","last_unstale":"2024-05-21T14:43:19.595034+0000","last_undegraded":"2024-05-21T14:43:19.595034+0000","last_fullsized":"2024-05-21T14:43:19.595034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:38.151165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578450+0000","last_change":"2024-05-21T14:43:19.596736+0000","last_active":"2024-05-21T14:43:20.578450+0000","last_peered":"2024-05-21T14:43:20.578450+0000","last_clean":"2024-05-21T14:43:20.578450+0000","last_became_active":"2024-05-21T14:43:19.596157+0000","last_became_peered":"2024-05-21T14:43:19.596157+0000","last_unstale":"2024-05-21T14:43:20.578450+0000","last_undegraded":"2024-05-21T14:43:20.578450+0000","last_fullsized":"2024-05-21T14:43:20.578450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:22:14.002930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.597491+0000","last_change":"2024-05-21T14:43:18.614044+0000","last_active":"2024-05-21T14:43:19.597491+0000","last_peered":"2024-05-21T14:43:19.597491+0000","last_clean":"2024-05-21T14:43:19.597491+0000","last_became_active":"2024-05-21T14:43:18.613730+0000","last_became_peered":"2024-05-21T14:43:18.613730+0000","last_unstale":"2024-05-21T14:43:19.597491+0000","last_undegraded":"2024-05-21T14:43:19.597491+0000","last_fullsized":"2024-05-21T14:43:19.597491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:41:34.787779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.629965+0000","last_change":"2024-05-21T14:43:19.621999+0000","last_active":"2024-05-21T14:43:19.629965+0000","last_peered":"2024-05-21T14:43:19.629965+0000","last_clean":"2024-05-21T14:43:19.629965+0000","last_became_active":"2024-05-21T14:43:19.614744+0000","last_became_peered":"2024-05-21T14:43:19.614744+0000","last_unstale":"2024-05-21T14:43:19.629965+0000","last_undegraded":"2024-05-21T14:43:19.629965+0000","last_fullsized":"2024-05-21T14:43:19.629965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:30:33.727601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.601384+0000","last_change":"2024-05-21T14:43:18.614193+0000","last_active":"2024-05-21T14:43:19.601384+0000","last_peered":"2024-05-21T14:43:19.601384+0000","last_clean":"2024-05-21T14:43:19.601384+0000","last_became_active":"2024-05-21T14:43:18.609797+0000","last_became_peered":"2024-05-21T14:43:18.609797+0000","last_unstale":"2024-05-21T14:43:19.601384+0000","last_undegraded":"2024-05-21T14:43:19.601384+0000","last_fullsized":"2024-05-21T14:43:19.601384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:39:55.623816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.621805+0000","last_change":"2024-05-21T14:43:19.610578+0000","last_active":"2024-05-21T14:43:19.621805+0000","last_peered":"2024-05-21T14:43:19.621805+0000","last_clean":"2024-05-21T14:43:19.621805+0000","last_became_active":"2024-05-21T14:43:19.606575+0000","last_became_peered":"2024-05-21T14:43:19.606575+0000","last_unstale":"2024-05-21T14:43:19.621805+0000","last_undegraded":"2024-05-21T14:43:19.621805+0000","last_fullsized":"2024-05-21T14:43:19.621805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:06:01.278748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.587219+0000","last_change":"2024-05-21T14:43:18.601862+0000","last_active":"2024-05-21T14:43:19.587219+0000","last_peered":"2024-05-21T14:43:19.587219+0000","last_clean":"2024-05-21T14:43:19.587219+0000","last_became_active":"2024-05-21T14:43:18.601311+0000","last_became_peered":"2024-05-21T14:43:18.601311+0000","last_unstale":"2024-05-21T14:43:19.587219+0000","last_undegraded":"2024-05-21T14:43:19.587219+0000","last_fullsized":"2024-05-21T14:43:19.587219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:02.736061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":665303,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":665303,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T14:43:25.772 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T14:43:25.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.949+0000 7ff5d5e00640 1 Processor -- start 2024-05-21T14:43:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.949+0000 7ff5d5e00640 1 -- start start 2024-05-21T14:43:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.949+0000 7ff5d5e00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff5d00c6760 0x7ff5d00c7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.949+0000 7ff5d5e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5d0159f20 0x7ff5d0073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.949+0000 7ff5d5e00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d0153cd0 con 0x7ff5d00736d0 2024-05-21T14:43:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.949+0000 7ff5d5e00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7ff5d015cbb0 con 0x7ff5d0159f20 2024-05-21T14:43:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.949+0000 7ff5d5e00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d015cdf0 con 0x7ff5d00c6760 2024-05-21T14:43:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.949+0000 7ff5c6000640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff5d00736d0 0x7ff5d0159810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57390/0 (socket says 172.21.15.78:57390) 2024-05-21T14:43:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.949+0000 7ff5c6000640 1 -- 172.21.15.78:0/319465803 learned_addr learned my addr 172.21.15.78:0/319465803 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.949+0000 7ff5cf400640 1 --2- 172.21.15.78:0/319465803 >> v2:172.21.15.78:3300/0 conn(0x7ff5d0159f20 0x7ff5d0073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.949+0000 7ff5cea00640 1 --2- 172.21.15.78:0/319465803 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff5d00c6760 0x7ff5d00c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.949+0000 7ff5ce000640 1 -- 172.21.15.78:0/319465803 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2740726021 0 0) 0x7ff5d0153cd0 con 0x7ff5d00736d0 2024-05-21T14:43:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.949+0000 7ff5ce000640 1 -- 172.21.15.78:0/319465803 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5b4003530 con 0x7ff5d00736d0 2024-05-21T14:43:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.949+0000 7ff5cf400640 1 -- 172.21.15.78:0/319465803 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff5d00c6760 msgr2=0x7ff5d00c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:25.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.949+0000 7ff5cf400640 1 --2- 172.21.15.78:0/319465803 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff5d00c6760 0x7ff5d00c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.949+0000 7ff5cf400640 1 -- 172.21.15.78:0/319465803 >> v1:172.21.15.78:6789/0 conn(0x7ff5d00736d0 legacy=0x7ff5d0159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.949+0000 7ff5cf400640 1 -- 172.21.15.78:0/319465803 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d015d0d0 con 0x7ff5d0159f20 2024-05-21T14:43:25.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.953+0000 7ff5cf400640 1 --2- 172.21.15.78:0/319465803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d0159f20 0x7ff5d0073ae0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8009d90 tx=0x7ff5c801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4381db24f6db326 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:25.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.953+0000 7ff5ce000640 1 -- 172.21.15.78:0/319465803 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c80b2070 con 0x7ff5d0159f20 2024-05-21T14:43:25.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.953+0000 7ff5ce000640 1 -- 172.21.15.78:0/319465803 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c80a5830 con 0x7ff5d0159f20 2024-05-21T14:43:25.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.953+0000 7ff5ce000640 1 -- 172.21.15.78:0/319465803 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c80a5be0 con 0x7ff5d0159f20 2024-05-21T14:43:25.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.953+0000 7ff5d5e00640 1 -- 172.21.15.78:0/319465803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d0159f20 msgr2=0x7ff5d0073ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.953+0000 7ff5d5e00640 1 --2- 172.21.15.78:0/319465803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d0159f20 0x7ff5d0073ae0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8009d90 tx=0x7ff5c801c970 comp rx=0 tx=0).stop 2024-05-21T14:43:25.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.953+0000 7ff5d5e00640 1 -- 172.21.15.78:0/319465803 shutdown_connections 2024-05-21T14:43:25.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.953+0000 7ff5d5e00640 1 --2- 172.21.15.78:0/319465803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d0159f20 0x7ff5d0073ae0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.953+0000 7ff5d5e00640 1 --2- 172.21.15.78:0/319465803 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff5d00c6760 0x7ff5d00c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.953+0000 7ff5d5e00640 1 -- 172.21.15.78:0/319465803 >> 172.21.15.78:0/319465803 conn(0x7ff5d00c9380 msgr2=0x7ff5d00c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:25.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.953+0000 7ff5d5e00640 1 -- 172.21.15.78:0/319465803 shutdown_connections 2024-05-21T14:43:25.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.953+0000 7ff5d5e00640 1 -- 172.21.15.78:0/319465803 wait complete. 2024-05-21T14:43:25.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5d5e00640 1 Processor -- start 2024-05-21T14:43:25.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5d5e00640 1 -- start start 2024-05-21T14:43:25.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5d5e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d00736d0 0x7ff5d00cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5d5e00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff5d00c6760 0x7ff5d0148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5d5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d0159f20 0x7ff5d01440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5d5e00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d00c79d0 con 0x7ff5d00736d0 2024-05-21T14:43:25.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5d5e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d00c7850 con 0x7ff5d0159f20 2024-05-21T14:43:25.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5d5e00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d00c6b70 con 0x7ff5d00c6760 2024-05-21T14:43:25.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5cea00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d00736d0 0x7ff5d00cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5cea00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d00736d0 0x7ff5d00cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38116/0 (socket says 172.21.15.78:38116) 2024-05-21T14:43:25.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5cea00640 1 -- 172.21.15.78:0/3113973256 learned_addr learned my addr 172.21.15.78:0/3113973256 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:25.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5cf400640 1 --2- 172.21.15.78:0/3113973256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d0159f20 0x7ff5d01440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5c6000640 1 --2- 172.21.15.78:0/3113973256 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff5d00c6760 0x7ff5d0148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5cea00640 1 -- 172.21.15.78:0/3113973256 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff5d00c6760 msgr2=0x7ff5d0148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5cea00640 1 --2- 172.21.15.78:0/3113973256 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff5d00c6760 0x7ff5d0148af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5cea00640 1 -- 172.21.15.78:0/3113973256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d0159f20 msgr2=0x7ff5d01440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:25.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5cea00640 1 --2- 172.21.15.78:0/3113973256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d0159f20 0x7ff5d01440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:25.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.957+0000 7ff5cea00640 1 -- 172.21.15.78:0/3113973256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d015c120 con 0x7ff5d00736d0 2024-05-21T14:43:25.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.961+0000 7ff5cea00640 1 --2- 172.21.15.78:0/3113973256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d00736d0 0x7ff5d00cbf70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000e870 tx=0x7ff5c000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:25.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.961+0000 7ff5c7e00640 1 -- 172.21.15.78:0/3113973256 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0017070 con 0x7ff5d00736d0 2024-05-21T14:43:25.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.961+0000 7ff5c7e00640 1 -- 172.21.15.78:0/3113973256 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c000c940 con 0x7ff5d00736d0 2024-05-21T14:43:25.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.961+0000 7ff5d5e00640 1 -- 172.21.15.78:0/3113973256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d015c790 con 0x7ff5d00736d0 2024-05-21T14:43:25.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.961+0000 7ff5c7e00640 1 -- 172.21.15.78:0/3113973256 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c000ccf0 con 0x7ff5d00736d0 2024-05-21T14:43:25.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.961+0000 7ff5d5e00640 1 -- 172.21.15.78:0/3113973256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d015be40 con 0x7ff5d00736d0 2024-05-21T14:43:25.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.961+0000 7ff5d5e00640 1 -- 172.21.15.78:0/3113973256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d00c4fa0 con 0x7ff5d00736d0 2024-05-21T14:43:25.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.961+0000 7ff5c7e00640 1 -- 172.21.15.78:0/3113973256 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff5c001a070 con 0x7ff5d00736d0 2024-05-21T14:43:25.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.961+0000 7ff5c7e00640 1 --2- 172.21.15.78:0/3113973256 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff5ac0678f0 0x7ff5ac069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:25.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.961+0000 7ff5c7e00640 1 -- 172.21.15.78:0/3113973256 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff5c0085ca0 con 0x7ff5d00736d0 2024-05-21T14:43:25.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.961+0000 7ff5c6000640 1 --2- 172.21.15.78:0/3113973256 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff5ac0678f0 0x7ff5ac069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:25.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.965+0000 7ff5c6000640 1 --2- 172.21.15.78:0/3113973256 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff5ac0678f0 0x7ff5ac069e00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0163240 tx=0x7ff5b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:25.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:25.965+0000 7ff5c7e00640 1 -- 172.21.15.78:0/3113973256 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7ff5c00566b0 con 0x7ff5d00736d0 2024-05-21T14:43:26.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.121+0000 7ff5d5e00640 1 -- 172.21.15.78:0/3113973256 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff5d01637c0 con 0x7ff5ac0678f0 2024-05-21T14:43:26.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.141+0000 7ff5c7e00640 1 -- 172.21.15.78:0/3113973256 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251897 (secure 0 0 0) 0x7ff5d01637c0 con 0x7ff5ac0678f0 2024-05-21T14:43:26.150 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:26.151 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-05-21T14:43:26.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.141+0000 7ff5d5e00640 1 -- 172.21.15.78:0/3113973256 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff5ac0678f0 msgr2=0x7ff5ac069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:26.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.141+0000 7ff5d5e00640 1 --2- 172.21.15.78:0/3113973256 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff5ac0678f0 0x7ff5ac069e00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0163240 tx=0x7ff5b8009040 comp rx=0 tx=0).stop 2024-05-21T14:43:26.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.141+0000 7ff5d5e00640 1 -- 172.21.15.78:0/3113973256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d00736d0 msgr2=0x7ff5d00cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:26.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.141+0000 7ff5d5e00640 1 --2- 172.21.15.78:0/3113973256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d00736d0 0x7ff5d00cbf70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000e870 tx=0x7ff5c000ec70 comp rx=0 tx=0).stop 2024-05-21T14:43:26.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.145+0000 7ff5d5e00640 1 -- 172.21.15.78:0/3113973256 shutdown_connections 2024-05-21T14:43:26.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.145+0000 7ff5d5e00640 1 --2- 172.21.15.78:0/3113973256 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff5ac0678f0 0x7ff5ac069e00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.145+0000 7ff5d5e00640 1 --2- 172.21.15.78:0/3113973256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d0159f20 0x7ff5d01440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.145+0000 7ff5d5e00640 1 --2- 172.21.15.78:0/3113973256 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff5d00c6760 0x7ff5d0148af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.145+0000 7ff5d5e00640 1 --2- 172.21.15.78:0/3113973256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5d00736d0 0x7ff5d00cbf70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.145+0000 7ff5d5e00640 1 -- 172.21.15.78:0/3113973256 >> 172.21.15.78:0/3113973256 conn(0x7ff5d00c9380 msgr2=0x7ff5d00c4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:26.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.145+0000 7ff5d5e00640 1 -- 172.21.15.78:0/3113973256 shutdown_connections 2024-05-21T14:43:26.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.145+0000 7ff5d5e00640 1 -- 172.21.15.78:0/3113973256 wait complete. 2024-05-21T14:43:26.170 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-05-21T14:43:24.487780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218072,"kb_used_data":1868,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756648,"statfs":{"total":773094113280,"available":772870807552,"internally_reserved":0,"allocated":1912832,"data_stored":1786516,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002306"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.611784+0000","last_change":"2024-05-21T14:43:19.606707+0000","last_active":"2024-05-21T14:43:19.611784+0000","last_peered":"2024-05-21T14:43:19.611784+0000","last_clean":"2024-05-21T14:43:19.611784+0000","last_became_active":"2024-05-21T14:43:19.606365+0000","last_became_peered":"2024-05-21T14:43:19.606365+0000","last_unstale":"2024-05-21T14:43:19.611784+0000","last_undegraded":"2024-05-21T14:43:19.611784+0000","last_fullsized":"2024-05-21T14:43:19.611784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:52:11.131429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.636507+0000","last_change":"2024-05-21T14:43:19.632879+0000","last_active":"2024-05-21T14:43:19.636507+0000","last_peered":"2024-05-21T14:43:19.636507+0000","last_clean":"2024-05-21T14:43:19.636507+0000","last_became_active":"2024-05-21T14:43:19.632218+0000","last_became_peered":"2024-05-21T14:43:19.632218+0000","last_unstale":"2024-05-21T14:43:19.636507+0000","last_undegraded":"2024-05-21T14:43:19.636507+0000","last_fullsized":"2024-05-21T14:43:19.636507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:58:32.304837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.628497+0000","last_change":"2024-05-21T14:43:19.620214+0000","last_active":"2024-05-21T14:43:19.628497+0000","last_peered":"2024-05-21T14:43:19.628497+0000","last_clean":"2024-05-21T14:43:19.628497+0000","last_became_active":"2024-05-21T14:43:19.619012+0000","last_became_peered":"2024-05-21T14:43:19.619012+0000","last_unstale":"2024-05-21T14:43:19.628497+0000","last_undegraded":"2024-05-21T14:43:19.628497+0000","last_fullsized":"2024-05-21T14:43:19.628497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:28:33.872706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.613169+0000","last_change":"2024-05-21T14:43:19.602199+0000","last_active":"2024-05-21T14:43:19.613169+0000","last_peered":"2024-05-21T14:43:19.613169+0000","last_clean":"2024-05-21T14:43:19.613169+0000","last_became_active":"2024-05-21T14:43:19.601797+0000","last_became_peered":"2024-05-21T14:43:19.601797+0000","last_unstale":"2024-05-21T14:43:19.613169+0000","last_undegraded":"2024-05-21T14:43:19.613169+0000","last_fullsized":"2024-05-21T14:43:19.613169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:16:06.695971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.624438+0000","last_change":"2024-05-21T14:43:19.623449+0000","last_active":"2024-05-21T14:43:19.624438+0000","last_peered":"2024-05-21T14:43:19.624438+0000","last_clean":"2024-05-21T14:43:19.624438+0000","last_became_active":"2024-05-21T14:43:19.623125+0000","last_became_peered":"2024-05-21T14:43:19.623125+0000","last_unstale":"2024-05-21T14:43:19.624438+0000","last_undegraded":"2024-05-21T14:43:19.624438+0000","last_fullsized":"2024-05-21T14:43:19.624438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:55:00.274958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.608123+0000","last_change":"2024-05-21T14:43:19.591222+0000","last_active":"2024-05-21T14:43:19.608123+0000","last_peered":"2024-05-21T14:43:19.608123+0000","last_clean":"2024-05-21T14:43:19.608123+0000","last_became_active":"2024-05-21T14:43:19.590858+0000","last_became_peered":"2024-05-21T14:43:19.590858+0000","last_unstale":"2024-05-21T14:43:19.608123+0000","last_undegraded":"2024-05-21T14:43:19.608123+0000","last_fullsized":"2024-05-21T14:43:19.608123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:34:01.304739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.621809+0000","last_change":"2024-05-21T14:43:19.614716+0000","last_active":"2024-05-21T14:43:19.621809+0000","last_peered":"2024-05-21T14:43:19.621809+0000","last_clean":"2024-05-21T14:43:19.621809+0000","last_became_active":"2024-05-21T14:43:19.614451+0000","last_became_peered":"2024-05-21T14:43:19.614451+0000","last_unstale":"2024-05-21T14:43:19.621809+0000","last_undegraded":"2024-05-21T14:43:19.621809+0000","last_fullsized":"2024-05-21T14:43:19.621809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:14:59.635330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.621337+0000","last_change":"2024-05-21T14:43:19.604029+0000","last_active":"2024-05-21T14:43:19.621337+0000","last_peered":"2024-05-21T14:43:19.621337+0000","last_clean":"2024-05-21T14:43:19.621337+0000","last_became_active":"2024-05-21T14:43:19.603164+0000","last_became_peered":"2024-05-21T14:43:19.603164+0000","last_unstale":"2024-05-21T14:43:19.621337+0000","last_undegraded":"2024-05-21T14:43:19.621337+0000","last_fullsized":"2024-05-21T14:43:19.621337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:10:26.141584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578218+0000","last_change":"2024-05-21T14:43:19.613765+0000","last_active":"2024-05-21T14:43:20.578218+0000","last_peered":"2024-05-21T14:43:20.578218+0000","last_clean":"2024-05-21T14:43:20.578218+0000","last_became_active":"2024-05-21T14:43:19.613429+0000","last_became_peered":"2024-05-21T14:43:19.613429+0000","last_unstale":"2024-05-21T14:43:20.578218+0000","last_undegraded":"2024-05-21T14:43:20.578218+0000","last_fullsized":"2024-05-21T14:43:20.578218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:29:16.905434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.611829+0000","last_change":"2024-05-21T14:43:19.607400+0000","last_active":"2024-05-21T14:43:19.611829+0000","last_peered":"2024-05-21T14:43:19.611829+0000","last_clean":"2024-05-21T14:43:19.611829+0000","last_became_active":"2024-05-21T14:43:19.607105+0000","last_became_peered":"2024-05-21T14:43:19.607105+0000","last_unstale":"2024-05-21T14:43:19.611829+0000","last_undegraded":"2024-05-21T14:43:19.611829+0000","last_fullsized":"2024-05-21T14:43:19.611829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:57:38.146049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.611860+0000","last_change":"2024-05-21T14:43:19.606534+0000","last_active":"2024-05-21T14:43:19.611860+0000","last_peered":"2024-05-21T14:43:19.611860+0000","last_clean":"2024-05-21T14:43:19.611860+0000","last_became_active":"2024-05-21T14:43:19.606029+0000","last_became_peered":"2024-05-21T14:43:19.606029+0000","last_unstale":"2024-05-21T14:43:19.611860+0000","last_undegraded":"2024-05-21T14:43:19.611860+0000","last_fullsized":"2024-05-21T14:43:19.611860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:02:43.511861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.614637+0000","last_change":"2024-05-21T14:43:19.609910+0000","last_active":"2024-05-21T14:43:19.614637+0000","last_peered":"2024-05-21T14:43:19.614637+0000","last_clean":"2024-05-21T14:43:19.614637+0000","last_became_active":"2024-05-21T14:43:19.609616+0000","last_became_peered":"2024-05-21T14:43:19.609616+0000","last_unstale":"2024-05-21T14:43:19.614637+0000","last_undegraded":"2024-05-21T14:43:19.614637+0000","last_fullsized":"2024-05-21T14:43:19.614637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:41:09.843165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581855+0000","last_change":"2024-05-21T14:43:19.604001+0000","last_active":"2024-05-21T14:43:20.581855+0000","last_peered":"2024-05-21T14:43:20.581855+0000","last_clean":"2024-05-21T14:43:20.581855+0000","last_became_active":"2024-05-21T14:43:19.596859+0000","last_became_peered":"2024-05-21T14:43:19.596859+0000","last_unstale":"2024-05-21T14:43:20.581855+0000","last_undegraded":"2024-05-21T14:43:20.581855+0000","last_fullsized":"2024-05-21T14:43:20.581855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:45:43.431420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580379+0000","last_change":"2024-05-21T14:43:19.626837+0000","last_active":"2024-05-21T14:43:20.580379+0000","last_peered":"2024-05-21T14:43:20.580379+0000","last_clean":"2024-05-21T14:43:20.580379+0000","last_became_active":"2024-05-21T14:43:19.626213+0000","last_became_peered":"2024-05-21T14:43:19.626213+0000","last_unstale":"2024-05-21T14:43:20.580379+0000","last_undegraded":"2024-05-21T14:43:20.580379+0000","last_fullsized":"2024-05-21T14:43:20.580379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:51.705474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.621876+0000","last_change":"2024-05-21T14:43:19.613483+0000","last_active":"2024-05-21T14:43:19.621876+0000","last_peered":"2024-05-21T14:43:19.621876+0000","last_clean":"2024-05-21T14:43:19.621876+0000","last_became_active":"2024-05-21T14:43:19.612581+0000","last_became_peered":"2024-05-21T14:43:19.612581+0000","last_unstale":"2024-05-21T14:43:19.621876+0000","last_undegraded":"2024-05-21T14:43:19.621876+0000","last_fullsized":"2024-05-21T14:43:19.621876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:27:08.530937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797569+0000","last_change":"2024-05-21T14:43:19.609126+0000","last_active":"2024-05-21T14:43:20.797569+0000","last_peered":"2024-05-21T14:43:20.797569+0000","last_clean":"2024-05-21T14:43:20.797569+0000","last_became_active":"2024-05-21T14:43:19.607967+0000","last_became_peered":"2024-05-21T14:43:19.607967+0000","last_unstale":"2024-05-21T14:43:20.797569+0000","last_undegraded":"2024-05-21T14:43:20.797569+0000","last_fullsized":"2024-05-21T14:43:20.797569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:35.881039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798283+0000","last_change":"2024-05-21T14:43:19.613487+0000","last_active":"2024-05-21T14:43:20.798283+0000","last_peered":"2024-05-21T14:43:20.798283+0000","last_clean":"2024-05-21T14:43:20.798283+0000","last_became_active":"2024-05-21T14:43:19.611280+0000","last_became_peered":"2024-05-21T14:43:19.611280+0000","last_unstale":"2024-05-21T14:43:20.798283+0000","last_undegraded":"2024-05-21T14:43:20.798283+0000","last_fullsized":"2024-05-21T14:43:20.798283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:51:21.887715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581838+0000","last_change":"2024-05-21T14:43:19.607601+0000","last_active":"2024-05-21T14:43:20.581838+0000","last_peered":"2024-05-21T14:43:20.581838+0000","last_clean":"2024-05-21T14:43:20.581838+0000","last_became_active":"2024-05-21T14:43:19.606719+0000","last_became_peered":"2024-05-21T14:43:19.606719+0000","last_unstale":"2024-05-21T14:43:20.581838+0000","last_undegraded":"2024-05-21T14:43:20.581838+0000","last_fullsized":"2024-05-21T14:43:20.581838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:04:32.310805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798234+0000","last_change":"2024-05-21T14:43:19.618470+0000","last_active":"2024-05-21T14:43:20.798234+0000","last_peered":"2024-05-21T14:43:20.798234+0000","last_clean":"2024-05-21T14:43:20.798234+0000","last_became_active":"2024-05-21T14:43:19.617408+0000","last_became_peered":"2024-05-21T14:43:19.617408+0000","last_unstale":"2024-05-21T14:43:20.798234+0000","last_undegraded":"2024-05-21T14:43:20.798234+0000","last_fullsized":"2024-05-21T14:43:20.798234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:53:58.877306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.614613+0000","last_change":"2024-05-21T14:43:19.609835+0000","last_active":"2024-05-21T14:43:19.614613+0000","last_peered":"2024-05-21T14:43:19.614613+0000","last_clean":"2024-05-21T14:43:19.614613+0000","last_became_active":"2024-05-21T14:43:19.609525+0000","last_became_peered":"2024-05-21T14:43:19.609525+0000","last_unstale":"2024-05-21T14:43:19.614613+0000","last_undegraded":"2024-05-21T14:43:19.614613+0000","last_fullsized":"2024-05-21T14:43:19.614613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:45:09.341754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.616061+0000","last_change":"2024-05-21T14:43:19.607732+0000","last_active":"2024-05-21T14:43:19.616061+0000","last_peered":"2024-05-21T14:43:19.616061+0000","last_clean":"2024-05-21T14:43:19.616061+0000","last_became_active":"2024-05-21T14:43:19.606839+0000","last_became_peered":"2024-05-21T14:43:19.606839+0000","last_unstale":"2024-05-21T14:43:19.616061+0000","last_undegraded":"2024-05-21T14:43:19.616061+0000","last_fullsized":"2024-05-21T14:43:19.616061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:09:47.599514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578145+0000","last_change":"2024-05-21T14:43:19.601108+0000","last_active":"2024-05-21T14:43:20.578145+0000","last_peered":"2024-05-21T14:43:20.578145+0000","last_clean":"2024-05-21T14:43:20.578145+0000","last_became_active":"2024-05-21T14:43:19.600780+0000","last_became_peered":"2024-05-21T14:43:19.600780+0000","last_unstale":"2024-05-21T14:43:20.578145+0000","last_undegraded":"2024-05-21T14:43:20.578145+0000","last_fullsized":"2024-05-21T14:43:20.578145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:47:19.062733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.629698+0000","last_change":"2024-05-21T14:43:19.620463+0000","last_active":"2024-05-21T14:43:19.629698+0000","last_peered":"2024-05-21T14:43:19.629698+0000","last_clean":"2024-05-21T14:43:19.629698+0000","last_became_active":"2024-05-21T14:43:19.614489+0000","last_became_peered":"2024-05-21T14:43:19.614489+0000","last_unstale":"2024-05-21T14:43:19.629698+0000","last_undegraded":"2024-05-21T14:43:19.629698+0000","last_fullsized":"2024-05-21T14:43:19.629698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:46:30.260642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797590+0000","last_change":"2024-05-21T14:43:19.624683+0000","last_active":"2024-05-21T14:43:20.797590+0000","last_peered":"2024-05-21T14:43:20.797590+0000","last_clean":"2024-05-21T14:43:20.797590+0000","last_became_active":"2024-05-21T14:43:19.624304+0000","last_became_peered":"2024-05-21T14:43:19.624304+0000","last_unstale":"2024-05-21T14:43:20.797590+0000","last_undegraded":"2024-05-21T14:43:20.797590+0000","last_fullsized":"2024-05-21T14:43:20.797590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:53.874968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.629911+0000","last_change":"2024-05-21T14:43:19.621030+0000","last_active":"2024-05-21T14:43:19.629911+0000","last_peered":"2024-05-21T14:43:19.629911+0000","last_clean":"2024-05-21T14:43:19.629911+0000","last_became_active":"2024-05-21T14:43:19.619072+0000","last_became_peered":"2024-05-21T14:43:19.619072+0000","last_unstale":"2024-05-21T14:43:19.629911+0000","last_undegraded":"2024-05-21T14:43:19.629911+0000","last_fullsized":"2024-05-21T14:43:19.629911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:42:01.412992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.613133+0000","last_change":"2024-05-21T14:43:19.602880+0000","last_active":"2024-05-21T14:43:19.613133+0000","last_peered":"2024-05-21T14:43:19.613133+0000","last_clean":"2024-05-21T14:43:19.613133+0000","last_became_active":"2024-05-21T14:43:19.602577+0000","last_became_peered":"2024-05-21T14:43:19.602577+0000","last_unstale":"2024-05-21T14:43:19.613133+0000","last_undegraded":"2024-05-21T14:43:19.613133+0000","last_fullsized":"2024-05-21T14:43:19.613133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:26:49.337697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582914+0000","last_change":"2024-05-21T14:43:19.632328+0000","last_active":"2024-05-21T14:43:20.582914+0000","last_peered":"2024-05-21T14:43:20.582914+0000","last_clean":"2024-05-21T14:43:20.582914+0000","last_became_active":"2024-05-21T14:43:19.631351+0000","last_became_peered":"2024-05-21T14:43:19.631351+0000","last_unstale":"2024-05-21T14:43:20.582914+0000","last_undegraded":"2024-05-21T14:43:20.582914+0000","last_fullsized":"2024-05-21T14:43:20.582914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:36:18.467070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582481+0000","last_change":"2024-05-21T14:43:19.632282+0000","last_active":"2024-05-21T14:43:20.582481+0000","last_peered":"2024-05-21T14:43:20.582481+0000","last_clean":"2024-05-21T14:43:20.582481+0000","last_became_active":"2024-05-21T14:43:19.631522+0000","last_became_peered":"2024-05-21T14:43:19.631522+0000","last_unstale":"2024-05-21T14:43:20.582481+0000","last_undegraded":"2024-05-21T14:43:20.582481+0000","last_fullsized":"2024-05-21T14:43:20.582481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:23:32.646087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.629820+0000","last_change":"2024-05-21T14:43:19.620046+0000","last_active":"2024-05-21T14:43:19.629820+0000","last_peered":"2024-05-21T14:43:19.629820+0000","last_clean":"2024-05-21T14:43:19.629820+0000","last_became_active":"2024-05-21T14:43:19.612428+0000","last_became_peered":"2024-05-21T14:43:19.612428+0000","last_unstale":"2024-05-21T14:43:19.629820+0000","last_undegraded":"2024-05-21T14:43:19.629820+0000","last_fullsized":"2024-05-21T14:43:19.629820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:00:17.098253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797667+0000","last_change":"2024-05-21T14:43:19.618198+0000","last_active":"2024-05-21T14:43:20.797667+0000","last_peered":"2024-05-21T14:43:20.797667+0000","last_clean":"2024-05-21T14:43:20.797667+0000","last_became_active":"2024-05-21T14:43:19.617903+0000","last_became_peered":"2024-05-21T14:43:19.617903+0000","last_unstale":"2024-05-21T14:43:20.797667+0000","last_undegraded":"2024-05-21T14:43:20.797667+0000","last_fullsized":"2024-05-21T14:43:20.797667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:59.606862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580507+0000","last_change":"2024-05-21T14:43:19.613942+0000","last_active":"2024-05-21T14:43:20.580507+0000","last_peered":"2024-05-21T14:43:20.580507+0000","last_clean":"2024-05-21T14:43:20.580507+0000","last_became_active":"2024-05-21T14:43:19.613035+0000","last_became_peered":"2024-05-21T14:43:19.613035+0000","last_unstale":"2024-05-21T14:43:20.580507+0000","last_undegraded":"2024-05-21T14:43:20.580507+0000","last_fullsized":"2024-05-21T14:43:20.580507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:47:46.462547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.628660+0000","last_change":"2024-05-21T14:43:19.626414+0000","last_active":"2024-05-21T14:43:19.628660+0000","last_peered":"2024-05-21T14:43:19.628660+0000","last_clean":"2024-05-21T14:43:19.628660+0000","last_became_active":"2024-05-21T14:43:19.626080+0000","last_became_peered":"2024-05-21T14:43:19.626080+0000","last_unstale":"2024-05-21T14:43:19.628660+0000","last_undegraded":"2024-05-21T14:43:19.628660+0000","last_fullsized":"2024-05-21T14:43:19.628660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:37:36.970091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578382+0000","last_change":"2024-05-21T14:43:19.620806+0000","last_active":"2024-05-21T14:43:20.578382+0000","last_peered":"2024-05-21T14:43:20.578382+0000","last_clean":"2024-05-21T14:43:20.578382+0000","last_became_active":"2024-05-21T14:43:19.620449+0000","last_became_peered":"2024-05-21T14:43:19.620449+0000","last_unstale":"2024-05-21T14:43:20.578382+0000","last_undegraded":"2024-05-21T14:43:20.578382+0000","last_fullsized":"2024-05-21T14:43:20.578382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:43:52.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.593679+0000","last_change":"2024-05-21T14:43:18.603028+0000","last_active":"2024-05-21T14:43:19.593679+0000","last_peered":"2024-05-21T14:43:19.593679+0000","last_clean":"2024-05-21T14:43:19.593679+0000","last_became_active":"2024-05-21T14:43:18.602036+0000","last_became_peered":"2024-05-21T14:43:18.602036+0000","last_unstale":"2024-05-21T14:43:19.593679+0000","last_undegraded":"2024-05-21T14:43:19.593679+0000","last_fullsized":"2024-05-21T14:43:19.593679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:15:25.384197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.612610+0000","last_change":"2024-05-21T14:43:19.599725+0000","last_active":"2024-05-21T14:43:19.612610+0000","last_peered":"2024-05-21T14:43:19.612610+0000","last_clean":"2024-05-21T14:43:19.612610+0000","last_became_active":"2024-05-21T14:43:19.598972+0000","last_became_peered":"2024-05-21T14:43:19.598972+0000","last_unstale":"2024-05-21T14:43:19.612610+0000","last_undegraded":"2024-05-21T14:43:19.612610+0000","last_fullsized":"2024-05-21T14:43:19.612610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:35:47.007541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797779+0000","last_change":"2024-05-21T14:43:18.615934+0000","last_active":"2024-05-21T14:43:20.797779+0000","last_peered":"2024-05-21T14:43:20.797779+0000","last_clean":"2024-05-21T14:43:20.797779+0000","last_became_active":"2024-05-21T14:43:18.615568+0000","last_became_peered":"2024-05-21T14:43:18.615568+0000","last_unstale":"2024-05-21T14:43:20.797779+0000","last_undegraded":"2024-05-21T14:43:20.797779+0000","last_fullsized":"2024-05-21T14:43:20.797779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:28:54.494319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580346+0000","last_change":"2024-05-21T14:43:18.615154+0000","last_active":"2024-05-21T14:43:20.580346+0000","last_peered":"2024-05-21T14:43:20.580346+0000","last_clean":"2024-05-21T14:43:20.580346+0000","last_became_active":"2024-05-21T14:43:18.613838+0000","last_became_peered":"2024-05-21T14:43:18.613838+0000","last_unstale":"2024-05-21T14:43:20.580346+0000","last_undegraded":"2024-05-21T14:43:20.580346+0000","last_fullsized":"2024-05-21T14:43:20.580346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:32:09.174124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.636851+0000","last_change":"2024-05-21T14:43:19.633585+0000","last_active":"2024-05-21T14:43:19.636851+0000","last_peered":"2024-05-21T14:43:19.636851+0000","last_clean":"2024-05-21T14:43:19.636851+0000","last_became_active":"2024-05-21T14:43:19.632476+0000","last_became_peered":"2024-05-21T14:43:19.632476+0000","last_unstale":"2024-05-21T14:43:19.636851+0000","last_undegraded":"2024-05-21T14:43:19.636851+0000","last_fullsized":"2024-05-21T14:43:19.636851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:26:49.703250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797713+0000","last_change":"2024-05-21T14:43:18.585548+0000","last_active":"2024-05-21T14:43:20.797713+0000","last_peered":"2024-05-21T14:43:20.797713+0000","last_clean":"2024-05-21T14:43:20.797713+0000","last_became_active":"2024-05-21T14:43:18.585099+0000","last_became_peered":"2024-05-21T14:43:18.585099+0000","last_unstale":"2024-05-21T14:43:20.797713+0000","last_undegraded":"2024-05-21T14:43:20.797713+0000","last_fullsized":"2024-05-21T14:43:20.797713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:20:16.856225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.621078+0000","last_change":"2024-05-21T14:43:19.614884+0000","last_active":"2024-05-21T14:43:19.621078+0000","last_peered":"2024-05-21T14:43:19.621078+0000","last_clean":"2024-05-21T14:43:19.621078+0000","last_became_active":"2024-05-21T14:43:19.614064+0000","last_became_peered":"2024-05-21T14:43:19.614064+0000","last_unstale":"2024-05-21T14:43:19.621078+0000","last_undegraded":"2024-05-21T14:43:19.621078+0000","last_fullsized":"2024-05-21T14:43:19.621078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:36:30.945895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578207+0000","last_change":"2024-05-21T14:43:18.602794+0000","last_active":"2024-05-21T14:43:20.578207+0000","last_peered":"2024-05-21T14:43:20.578207+0000","last_clean":"2024-05-21T14:43:20.578207+0000","last_became_active":"2024-05-21T14:43:18.602429+0000","last_became_peered":"2024-05-21T14:43:18.602429+0000","last_unstale":"2024-05-21T14:43:20.578207+0000","last_undegraded":"2024-05-21T14:43:20.578207+0000","last_fullsized":"2024-05-21T14:43:20.578207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:50:14.465202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.613108+0000","last_change":"2024-05-21T14:43:19.602663+0000","last_active":"2024-05-21T14:43:19.613108+0000","last_peered":"2024-05-21T14:43:19.613108+0000","last_clean":"2024-05-21T14:43:19.613108+0000","last_became_active":"2024-05-21T14:43:19.602294+0000","last_became_peered":"2024-05-21T14:43:19.602294+0000","last_unstale":"2024-05-21T14:43:19.613108+0000","last_undegraded":"2024-05-21T14:43:19.613108+0000","last_fullsized":"2024-05-21T14:43:19.613108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:52:34.816423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.595048+0000","last_change":"2024-05-21T14:43:18.604601+0000","last_active":"2024-05-21T14:43:19.595048+0000","last_peered":"2024-05-21T14:43:19.595048+0000","last_clean":"2024-05-21T14:43:19.595048+0000","last_became_active":"2024-05-21T14:43:18.604262+0000","last_became_peered":"2024-05-21T14:43:18.604262+0000","last_unstale":"2024-05-21T14:43:19.595048+0000","last_undegraded":"2024-05-21T14:43:19.595048+0000","last_fullsized":"2024-05-21T14:43:19.595048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:15.490579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.627752+0000","last_change":"2024-05-21T14:43:19.613952+0000","last_active":"2024-05-21T14:43:19.627752+0000","last_peered":"2024-05-21T14:43:19.627752+0000","last_clean":"2024-05-21T14:43:19.627752+0000","last_became_active":"2024-05-21T14:43:19.613093+0000","last_became_peered":"2024-05-21T14:43:19.613093+0000","last_unstale":"2024-05-21T14:43:19.627752+0000","last_undegraded":"2024-05-21T14:43:19.627752+0000","last_fullsized":"2024-05-21T14:43:19.627752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:32:40.371835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580684+0000","last_change":"2024-05-21T14:43:18.602343+0000","last_active":"2024-05-21T14:43:20.580684+0000","last_peered":"2024-05-21T14:43:20.580684+0000","last_clean":"2024-05-21T14:43:20.580684+0000","last_became_active":"2024-05-21T14:43:18.601500+0000","last_became_peered":"2024-05-21T14:43:18.601500+0000","last_unstale":"2024-05-21T14:43:20.580684+0000","last_undegraded":"2024-05-21T14:43:20.580684+0000","last_fullsized":"2024-05-21T14:43:20.580684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:54:21.960430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798025+0000","last_change":"2024-05-21T14:43:19.608580+0000","last_active":"2024-05-21T14:43:20.798025+0000","last_peered":"2024-05-21T14:43:20.798025+0000","last_clean":"2024-05-21T14:43:20.798025+0000","last_became_active":"2024-05-21T14:43:19.608038+0000","last_became_peered":"2024-05-21T14:43:19.608038+0000","last_unstale":"2024-05-21T14:43:20.798025+0000","last_undegraded":"2024-05-21T14:43:20.798025+0000","last_fullsized":"2024-05-21T14:43:20.798025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:19.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.578905+0000","last_change":"2024-05-21T14:43:18.606824+0000","last_active":"2024-05-21T14:43:19.578905+0000","last_peered":"2024-05-21T14:43:19.578905+0000","last_clean":"2024-05-21T14:43:19.578905+0000","last_became_active":"2024-05-21T14:43:18.606449+0000","last_became_peered":"2024-05-21T14:43:18.606449+0000","last_unstale":"2024-05-21T14:43:19.578905+0000","last_undegraded":"2024-05-21T14:43:19.578905+0000","last_fullsized":"2024-05-21T14:43:19.578905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:43:41.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.637234+0000","last_change":"2024-05-21T14:43:19.634014+0000","last_active":"2024-05-21T14:43:19.637234+0000","last_peered":"2024-05-21T14:43:19.637234+0000","last_clean":"2024-05-21T14:43:19.637234+0000","last_became_active":"2024-05-21T14:43:19.633664+0000","last_became_peered":"2024-05-21T14:43:19.633664+0000","last_unstale":"2024-05-21T14:43:19.637234+0000","last_undegraded":"2024-05-21T14:43:19.637234+0000","last_fullsized":"2024-05-21T14:43:19.637234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:06:31.443201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581596+0000","last_change":"2024-05-21T14:43:18.614764+0000","last_active":"2024-05-21T14:43:20.581596+0000","last_peered":"2024-05-21T14:43:20.581596+0000","last_clean":"2024-05-21T14:43:20.581596+0000","last_became_active":"2024-05-21T14:43:18.614214+0000","last_became_peered":"2024-05-21T14:43:18.614214+0000","last_unstale":"2024-05-21T14:43:20.581596+0000","last_undegraded":"2024-05-21T14:43:20.581596+0000","last_fullsized":"2024-05-21T14:43:20.581596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:34:40.294756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580771+0000","last_change":"2024-05-21T14:43:19.625313+0000","last_active":"2024-05-21T14:43:20.580771+0000","last_peered":"2024-05-21T14:43:20.580771+0000","last_clean":"2024-05-21T14:43:20.580771+0000","last_became_active":"2024-05-21T14:43:19.624474+0000","last_became_peered":"2024-05-21T14:43:19.624474+0000","last_unstale":"2024-05-21T14:43:20.580771+0000","last_undegraded":"2024-05-21T14:43:20.580771+0000","last_fullsized":"2024-05-21T14:43:20.580771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:28.280456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797927+0000","last_change":"2024-05-21T14:43:18.600736+0000","last_active":"2024-05-21T14:43:20.797927+0000","last_peered":"2024-05-21T14:43:20.797927+0000","last_clean":"2024-05-21T14:43:20.797927+0000","last_became_active":"2024-05-21T14:43:18.600415+0000","last_became_peered":"2024-05-21T14:43:18.600415+0000","last_unstale":"2024-05-21T14:43:20.797927+0000","last_undegraded":"2024-05-21T14:43:20.797927+0000","last_fullsized":"2024-05-21T14:43:20.797927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:03:57.207603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797724+0000","last_change":"2024-05-21T14:43:19.599637+0000","last_active":"2024-05-21T14:43:20.797724+0000","last_peered":"2024-05-21T14:43:20.797724+0000","last_clean":"2024-05-21T14:43:20.797724+0000","last_became_active":"2024-05-21T14:43:19.599195+0000","last_became_peered":"2024-05-21T14:43:19.599195+0000","last_unstale":"2024-05-21T14:43:20.797724+0000","last_undegraded":"2024-05-21T14:43:20.797724+0000","last_fullsized":"2024-05-21T14:43:20.797724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:17.350821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.594502+0000","last_change":"2024-05-21T14:43:18.603064+0000","last_active":"2024-05-21T14:43:19.594502+0000","last_peered":"2024-05-21T14:43:19.594502+0000","last_clean":"2024-05-21T14:43:19.594502+0000","last_became_active":"2024-05-21T14:43:18.602658+0000","last_became_peered":"2024-05-21T14:43:18.602658+0000","last_unstale":"2024-05-21T14:43:19.594502+0000","last_undegraded":"2024-05-21T14:43:19.594502+0000","last_fullsized":"2024-05-21T14:43:19.594502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:09:28.623131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.577809+0000","last_change":"2024-05-21T14:43:19.620760+0000","last_active":"2024-05-21T14:43:20.577809+0000","last_peered":"2024-05-21T14:43:20.577809+0000","last_clean":"2024-05-21T14:43:20.577809+0000","last_became_active":"2024-05-21T14:43:19.620409+0000","last_became_peered":"2024-05-21T14:43:19.620409+0000","last_unstale":"2024-05-21T14:43:20.577809+0000","last_undegraded":"2024-05-21T14:43:20.577809+0000","last_fullsized":"2024-05-21T14:43:20.577809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:49:59.051131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.581050+0000","last_change":"2024-05-21T14:43:18.594225+0000","last_active":"2024-05-21T14:43:19.581050+0000","last_peered":"2024-05-21T14:43:19.581050+0000","last_clean":"2024-05-21T14:43:19.581050+0000","last_became_active":"2024-05-21T14:43:18.592335+0000","last_became_peered":"2024-05-21T14:43:18.592335+0000","last_unstale":"2024-05-21T14:43:19.581050+0000","last_undegraded":"2024-05-21T14:43:19.581050+0000","last_fullsized":"2024-05-21T14:43:19.581050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:00:58.772091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797667+0000","last_change":"2024-05-21T14:43:19.612442+0000","last_active":"2024-05-21T14:43:20.797667+0000","last_peered":"2024-05-21T14:43:20.797667+0000","last_clean":"2024-05-21T14:43:20.797667+0000","last_became_active":"2024-05-21T14:43:19.612110+0000","last_became_peered":"2024-05-21T14:43:19.612110+0000","last_unstale":"2024-05-21T14:43:20.797667+0000","last_undegraded":"2024-05-21T14:43:20.797667+0000","last_fullsized":"2024-05-21T14:43:20.797667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:53.451513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.606105+0000","last_change":"2024-05-21T14:43:18.613433+0000","last_active":"2024-05-21T14:43:19.606105+0000","last_peered":"2024-05-21T14:43:19.606105+0000","last_clean":"2024-05-21T14:43:19.606105+0000","last_became_active":"2024-05-21T14:43:18.613048+0000","last_became_peered":"2024-05-21T14:43:18.613048+0000","last_unstale":"2024-05-21T14:43:19.606105+0000","last_undegraded":"2024-05-21T14:43:19.606105+0000","last_fullsized":"2024-05-21T14:43:19.606105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:00:16.454574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.606736+0000","last_change":"2024-05-21T14:43:19.597079+0000","last_active":"2024-05-21T14:43:19.606736+0000","last_peered":"2024-05-21T14:43:19.606736+0000","last_clean":"2024-05-21T14:43:19.606736+0000","last_became_active":"2024-05-21T14:43:19.596736+0000","last_became_peered":"2024-05-21T14:43:19.596736+0000","last_unstale":"2024-05-21T14:43:19.606736+0000","last_undegraded":"2024-05-21T14:43:19.606736+0000","last_fullsized":"2024-05-21T14:43:19.606736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:40:53.911145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.584585+0000","last_change":"2024-05-21T14:43:18.620603+0000","last_active":"2024-05-21T14:43:19.584585+0000","last_peered":"2024-05-21T14:43:19.584585+0000","last_clean":"2024-05-21T14:43:19.584585+0000","last_became_active":"2024-05-21T14:43:18.619762+0000","last_became_peered":"2024-05-21T14:43:18.619762+0000","last_unstale":"2024-05-21T14:43:19.584585+0000","last_undegraded":"2024-05-21T14:43:19.584585+0000","last_fullsized":"2024-05-21T14:43:19.584585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:31:49.257435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.619464+0000","last_change":"2024-05-21T14:43:19.611608+0000","last_active":"2024-05-21T14:43:19.619464+0000","last_peered":"2024-05-21T14:43:19.619464+0000","last_clean":"2024-05-21T14:43:19.619464+0000","last_became_active":"2024-05-21T14:43:19.610774+0000","last_became_peered":"2024-05-21T14:43:19.610774+0000","last_unstale":"2024-05-21T14:43:19.619464+0000","last_undegraded":"2024-05-21T14:43:19.619464+0000","last_fullsized":"2024-05-21T14:43:19.619464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:21:25.127827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.604792+0000","last_change":"2024-05-21T14:43:18.610121+0000","last_active":"2024-05-21T14:43:19.604792+0000","last_peered":"2024-05-21T14:43:19.604792+0000","last_clean":"2024-05-21T14:43:19.604792+0000","last_became_active":"2024-05-21T14:43:18.609349+0000","last_became_peered":"2024-05-21T14:43:18.609349+0000","last_unstale":"2024-05-21T14:43:19.604792+0000","last_undegraded":"2024-05-21T14:43:19.604792+0000","last_fullsized":"2024-05-21T14:43:19.604792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:48.330067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.611903+0000","last_change":"2024-05-21T14:43:19.605193+0000","last_active":"2024-05-21T14:43:19.611903+0000","last_peered":"2024-05-21T14:43:19.611903+0000","last_clean":"2024-05-21T14:43:19.611903+0000","last_became_active":"2024-05-21T14:43:19.604869+0000","last_became_peered":"2024-05-21T14:43:19.604869+0000","last_unstale":"2024-05-21T14:43:19.611903+0000","last_undegraded":"2024-05-21T14:43:19.611903+0000","last_fullsized":"2024-05-21T14:43:19.611903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:01.096215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582847+0000","last_change":"2024-05-21T14:43:18.616535+0000","last_active":"2024-05-21T14:43:20.582847+0000","last_peered":"2024-05-21T14:43:20.582847+0000","last_clean":"2024-05-21T14:43:20.582847+0000","last_became_active":"2024-05-21T14:43:18.615734+0000","last_became_peered":"2024-05-21T14:43:18.615734+0000","last_unstale":"2024-05-21T14:43:20.582847+0000","last_undegraded":"2024-05-21T14:43:20.582847+0000","last_fullsized":"2024-05-21T14:43:20.582847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:10:27.821535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798116+0000","last_change":"2024-05-21T14:43:19.615424+0000","last_active":"2024-05-21T14:43:20.798116+0000","last_peered":"2024-05-21T14:43:20.798116+0000","last_clean":"2024-05-21T14:43:20.798116+0000","last_became_active":"2024-05-21T14:43:19.614915+0000","last_became_peered":"2024-05-21T14:43:19.614915+0000","last_unstale":"2024-05-21T14:43:20.798116+0000","last_undegraded":"2024-05-21T14:43:20.798116+0000","last_fullsized":"2024-05-21T14:43:20.798116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:25:09.153430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.577738+0000","last_change":"2024-05-21T14:43:08.080234+0000","last_active":"2024-05-21T14:43:20.577738+0000","last_peered":"2024-05-21T14:43:20.577738+0000","last_clean":"2024-05-21T14:43:20.577738+0000","last_became_active":"2024-05-21T14:43:08.079934+0000","last_became_peered":"2024-05-21T14:43:08.079934+0000","last_unstale":"2024-05-21T14:43:20.577738+0000","last_undegraded":"2024-05-21T14:43:20.577738+0000","last_fullsized":"2024-05-21T14:43:20.577738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_clean_scrub_stamp":"2024-05-21T14:43:07.046978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:54:57.347768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797966+0000","last_change":"2024-05-21T14:43:18.599850+0000","last_active":"2024-05-21T14:43:20.797966+0000","last_peered":"2024-05-21T14:43:20.797966+0000","last_clean":"2024-05-21T14:43:20.797966+0000","last_became_active":"2024-05-21T14:43:18.599347+0000","last_became_peered":"2024-05-21T14:43:18.599347+0000","last_unstale":"2024-05-21T14:43:20.797966+0000","last_undegraded":"2024-05-21T14:43:20.797966+0000","last_fullsized":"2024-05-21T14:43:20.797966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:01:06.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.620999+0000","last_change":"2024-05-21T14:43:19.613056+0000","last_active":"2024-05-21T14:43:19.620999+0000","last_peered":"2024-05-21T14:43:19.620999+0000","last_clean":"2024-05-21T14:43:19.620999+0000","last_became_active":"2024-05-21T14:43:19.611889+0000","last_became_peered":"2024-05-21T14:43:19.611889+0000","last_unstale":"2024-05-21T14:43:19.620999+0000","last_undegraded":"2024-05-21T14:43:19.620999+0000","last_fullsized":"2024-05-21T14:43:19.620999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:25.723296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797781+0000","last_change":"2024-05-21T14:43:18.621482+0000","last_active":"2024-05-21T14:43:20.797781+0000","last_peered":"2024-05-21T14:43:20.797781+0000","last_clean":"2024-05-21T14:43:20.797781+0000","last_became_active":"2024-05-21T14:43:18.621229+0000","last_became_peered":"2024-05-21T14:43:18.621229+0000","last_unstale":"2024-05-21T14:43:20.797781+0000","last_undegraded":"2024-05-21T14:43:20.797781+0000","last_fullsized":"2024-05-21T14:43:20.797781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:30:04.326588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580381+0000","last_change":"2024-05-21T14:43:19.625038+0000","last_active":"2024-05-21T14:43:20.580381+0000","last_peered":"2024-05-21T14:43:20.580381+0000","last_clean":"2024-05-21T14:43:20.580381+0000","last_became_active":"2024-05-21T14:43:19.624114+0000","last_became_peered":"2024-05-21T14:43:19.624114+0000","last_unstale":"2024-05-21T14:43:20.580381+0000","last_undegraded":"2024-05-21T14:43:20.580381+0000","last_fullsized":"2024-05-21T14:43:20.580381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:11.854243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580843+0000","last_change":"2024-05-21T14:43:18.618518+0000","last_active":"2024-05-21T14:43:20.580843+0000","last_peered":"2024-05-21T14:43:20.580843+0000","last_clean":"2024-05-21T14:43:20.580843+0000","last_became_active":"2024-05-21T14:43:18.617756+0000","last_became_peered":"2024-05-21T14:43:18.617756+0000","last_unstale":"2024-05-21T14:43:20.580843+0000","last_undegraded":"2024-05-21T14:43:20.580843+0000","last_fullsized":"2024-05-21T14:43:20.580843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:52:12.999877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.628737+0000","last_change":"2024-05-21T14:43:19.613595+0000","last_active":"2024-05-21T14:43:19.628737+0000","last_peered":"2024-05-21T14:43:19.628737+0000","last_clean":"2024-05-21T14:43:19.628737+0000","last_became_active":"2024-05-21T14:43:19.612730+0000","last_became_peered":"2024-05-21T14:43:19.612730+0000","last_unstale":"2024-05-21T14:43:19.628737+0000","last_undegraded":"2024-05-21T14:43:19.628737+0000","last_fullsized":"2024-05-21T14:43:19.628737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:33:07.887382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797922+0000","last_change":"2024-05-21T14:43:18.608596+0000","last_active":"2024-05-21T14:43:20.797922+0000","last_peered":"2024-05-21T14:43:20.797922+0000","last_clean":"2024-05-21T14:43:20.797922+0000","last_became_active":"2024-05-21T14:43:18.608262+0000","last_became_peered":"2024-05-21T14:43:18.608262+0000","last_unstale":"2024-05-21T14:43:20.797922+0000","last_undegraded":"2024-05-21T14:43:20.797922+0000","last_fullsized":"2024-05-21T14:43:20.797922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:14.962554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.611880+0000","last_change":"2024-05-21T14:43:19.607815+0000","last_active":"2024-05-21T14:43:19.611880+0000","last_peered":"2024-05-21T14:43:19.611880+0000","last_clean":"2024-05-21T14:43:19.611880+0000","last_became_active":"2024-05-21T14:43:19.607513+0000","last_became_peered":"2024-05-21T14:43:19.607513+0000","last_unstale":"2024-05-21T14:43:19.611880+0000","last_undegraded":"2024-05-21T14:43:19.611880+0000","last_fullsized":"2024-05-21T14:43:19.611880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:25:41.611597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.600507+0000","last_change":"2024-05-21T14:43:18.603626+0000","last_active":"2024-05-21T14:43:19.600507+0000","last_peered":"2024-05-21T14:43:19.600507+0000","last_clean":"2024-05-21T14:43:19.600507+0000","last_became_active":"2024-05-21T14:43:18.602704+0000","last_became_peered":"2024-05-21T14:43:18.602704+0000","last_unstale":"2024-05-21T14:43:19.600507+0000","last_undegraded":"2024-05-21T14:43:19.600507+0000","last_fullsized":"2024-05-21T14:43:19.600507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:03.976820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.637396+0000","last_change":"2024-05-21T14:43:19.634449+0000","last_active":"2024-05-21T14:43:19.637396+0000","last_peered":"2024-05-21T14:43:19.637396+0000","last_clean":"2024-05-21T14:43:19.637396+0000","last_became_active":"2024-05-21T14:43:19.633751+0000","last_became_peered":"2024-05-21T14:43:19.633751+0000","last_unstale":"2024-05-21T14:43:19.637396+0000","last_undegraded":"2024-05-21T14:43:19.637396+0000","last_fullsized":"2024-05-21T14:43:19.637396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:03:27.048216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798236+0000","last_change":"2024-05-21T14:43:18.608335+0000","last_active":"2024-05-21T14:43:20.798236+0000","last_peered":"2024-05-21T14:43:20.798236+0000","last_clean":"2024-05-21T14:43:20.798236+0000","last_became_active":"2024-05-21T14:43:18.607999+0000","last_became_peered":"2024-05-21T14:43:18.607999+0000","last_unstale":"2024-05-21T14:43:20.798236+0000","last_undegraded":"2024-05-21T14:43:20.798236+0000","last_fullsized":"2024-05-21T14:43:20.798236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:21.325953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582549+0000","last_change":"2024-05-21T14:43:19.626742+0000","last_active":"2024-05-21T14:43:20.582549+0000","last_peered":"2024-05-21T14:43:20.582549+0000","last_clean":"2024-05-21T14:43:20.582549+0000","last_became_active":"2024-05-21T14:43:19.626024+0000","last_became_peered":"2024-05-21T14:43:19.626024+0000","last_unstale":"2024-05-21T14:43:20.582549+0000","last_undegraded":"2024-05-21T14:43:20.582549+0000","last_fullsized":"2024-05-21T14:43:20.582549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:48:15.426224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.585058+0000","last_change":"2024-05-21T14:43:18.616913+0000","last_active":"2024-05-21T14:43:19.585058+0000","last_peered":"2024-05-21T14:43:19.585058+0000","last_clean":"2024-05-21T14:43:19.585058+0000","last_became_active":"2024-05-21T14:43:18.616214+0000","last_became_peered":"2024-05-21T14:43:18.616214+0000","last_unstale":"2024-05-21T14:43:19.585058+0000","last_undegraded":"2024-05-21T14:43:19.585058+0000","last_fullsized":"2024-05-21T14:43:19.585058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:22.112018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.615955+0000","last_change":"2024-05-21T14:43:19.607521+0000","last_active":"2024-05-21T14:43:19.615955+0000","last_peered":"2024-05-21T14:43:19.615955+0000","last_clean":"2024-05-21T14:43:19.615955+0000","last_became_active":"2024-05-21T14:43:19.606673+0000","last_became_peered":"2024-05-21T14:43:19.606673+0000","last_unstale":"2024-05-21T14:43:19.615955+0000","last_undegraded":"2024-05-21T14:43:19.615955+0000","last_fullsized":"2024-05-21T14:43:19.615955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:10:05.239647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798313+0000","last_change":"2024-05-21T14:43:18.615846+0000","last_active":"2024-05-21T14:43:20.798313+0000","last_peered":"2024-05-21T14:43:20.798313+0000","last_clean":"2024-05-21T14:43:20.798313+0000","last_became_active":"2024-05-21T14:43:18.615506+0000","last_became_peered":"2024-05-21T14:43:18.615506+0000","last_unstale":"2024-05-21T14:43:20.798313+0000","last_undegraded":"2024-05-21T14:43:20.798313+0000","last_fullsized":"2024-05-21T14:43:20.798313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:07:17.030757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.616157+0000","last_change":"2024-05-21T14:43:19.611473+0000","last_active":"2024-05-21T14:43:19.616157+0000","last_peered":"2024-05-21T14:43:19.616157+0000","last_clean":"2024-05-21T14:43:19.616157+0000","last_became_active":"2024-05-21T14:43:19.610600+0000","last_became_peered":"2024-05-21T14:43:19.610600+0000","last_unstale":"2024-05-21T14:43:19.616157+0000","last_undegraded":"2024-05-21T14:43:19.616157+0000","last_fullsized":"2024-05-21T14:43:19.616157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:52:08.240959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.594071+0000","last_change":"2024-05-21T14:43:18.604951+0000","last_active":"2024-05-21T14:43:19.594071+0000","last_peered":"2024-05-21T14:43:19.594071+0000","last_clean":"2024-05-21T14:43:19.594071+0000","last_became_active":"2024-05-21T14:43:18.602186+0000","last_became_peered":"2024-05-21T14:43:18.602186+0000","last_unstale":"2024-05-21T14:43:19.594071+0000","last_undegraded":"2024-05-21T14:43:19.594071+0000","last_fullsized":"2024-05-21T14:43:19.594071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:34:10.395484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797647+0000","last_change":"2024-05-21T14:43:19.600827+0000","last_active":"2024-05-21T14:43:20.797647+0000","last_peered":"2024-05-21T14:43:20.797647+0000","last_clean":"2024-05-21T14:43:20.797647+0000","last_became_active":"2024-05-21T14:43:19.600499+0000","last_became_peered":"2024-05-21T14:43:19.600499+0000","last_unstale":"2024-05-21T14:43:20.797647+0000","last_undegraded":"2024-05-21T14:43:20.797647+0000","last_fullsized":"2024-05-21T14:43:20.797647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:55:36.231321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.583134+0000","last_change":"2024-05-21T14:43:18.615190+0000","last_active":"2024-05-21T14:43:19.583134+0000","last_peered":"2024-05-21T14:43:19.583134+0000","last_clean":"2024-05-21T14:43:19.583134+0000","last_became_active":"2024-05-21T14:43:18.614306+0000","last_became_peered":"2024-05-21T14:43:18.614306+0000","last_unstale":"2024-05-21T14:43:19.583134+0000","last_undegraded":"2024-05-21T14:43:19.583134+0000","last_fullsized":"2024-05-21T14:43:19.583134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:53.472559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.618339+0000","last_change":"2024-05-21T14:43:19.610903+0000","last_active":"2024-05-21T14:43:19.618339+0000","last_peered":"2024-05-21T14:43:19.618339+0000","last_clean":"2024-05-21T14:43:19.618339+0000","last_became_active":"2024-05-21T14:43:19.610101+0000","last_became_peered":"2024-05-21T14:43:19.610101+0000","last_unstale":"2024-05-21T14:43:19.618339+0000","last_undegraded":"2024-05-21T14:43:19.618339+0000","last_fullsized":"2024-05-21T14:43:19.618339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:46:19.554016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581222+0000","last_change":"2024-05-21T14:43:18.617785+0000","last_active":"2024-05-21T14:43:20.581222+0000","last_peered":"2024-05-21T14:43:20.581222+0000","last_clean":"2024-05-21T14:43:20.581222+0000","last_became_active":"2024-05-21T14:43:18.617041+0000","last_became_peered":"2024-05-21T14:43:18.617041+0000","last_unstale":"2024-05-21T14:43:20.581222+0000","last_undegraded":"2024-05-21T14:43:20.581222+0000","last_fullsized":"2024-05-21T14:43:20.581222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:02:50.837158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581606+0000","last_change":"2024-05-21T14:43:19.627096+0000","last_active":"2024-05-21T14:43:20.581606+0000","last_peered":"2024-05-21T14:43:20.581606+0000","last_clean":"2024-05-21T14:43:20.581606+0000","last_became_active":"2024-05-21T14:43:19.626265+0000","last_became_peered":"2024-05-21T14:43:19.626265+0000","last_unstale":"2024-05-21T14:43:20.581606+0000","last_undegraded":"2024-05-21T14:43:20.581606+0000","last_fullsized":"2024-05-21T14:43:20.581606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:23:47.818120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797832+0000","last_change":"2024-05-21T14:43:18.599635+0000","last_active":"2024-05-21T14:43:20.797832+0000","last_peered":"2024-05-21T14:43:20.797832+0000","last_clean":"2024-05-21T14:43:20.797832+0000","last_became_active":"2024-05-21T14:43:18.598996+0000","last_became_peered":"2024-05-21T14:43:18.598996+0000","last_unstale":"2024-05-21T14:43:20.797832+0000","last_undegraded":"2024-05-21T14:43:20.797832+0000","last_fullsized":"2024-05-21T14:43:20.797832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:17:09.383291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797767+0000","last_change":"2024-05-21T14:43:19.617686+0000","last_active":"2024-05-21T14:43:20.797767+0000","last_peered":"2024-05-21T14:43:20.797767+0000","last_clean":"2024-05-21T14:43:20.797767+0000","last_became_active":"2024-05-21T14:43:19.617398+0000","last_became_peered":"2024-05-21T14:43:19.617398+0000","last_unstale":"2024-05-21T14:43:20.797767+0000","last_undegraded":"2024-05-21T14:43:20.797767+0000","last_fullsized":"2024-05-21T14:43:20.797767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:21:06.527871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798047+0000","last_change":"2024-05-21T14:43:19.601673+0000","last_active":"2024-05-21T14:43:20.798047+0000","last_peered":"2024-05-21T14:43:20.798047+0000","last_clean":"2024-05-21T14:43:20.798047+0000","last_became_active":"2024-05-21T14:43:19.601286+0000","last_became_peered":"2024-05-21T14:43:19.601286+0000","last_unstale":"2024-05-21T14:43:20.798047+0000","last_undegraded":"2024-05-21T14:43:20.798047+0000","last_fullsized":"2024-05-21T14:43:20.798047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:21:22.955055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.595034+0000","last_change":"2024-05-21T14:43:18.613555+0000","last_active":"2024-05-21T14:43:19.595034+0000","last_peered":"2024-05-21T14:43:19.595034+0000","last_clean":"2024-05-21T14:43:19.595034+0000","last_became_active":"2024-05-21T14:43:18.613117+0000","last_became_peered":"2024-05-21T14:43:18.613117+0000","last_unstale":"2024-05-21T14:43:19.595034+0000","last_undegraded":"2024-05-21T14:43:19.595034+0000","last_fullsized":"2024-05-21T14:43:19.595034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:38.151165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578450+0000","last_change":"2024-05-21T14:43:19.596736+0000","last_active":"2024-05-21T14:43:20.578450+0000","last_peered":"2024-05-21T14:43:20.578450+0000","last_clean":"2024-05-21T14:43:20.578450+0000","last_became_active":"2024-05-21T14:43:19.596157+0000","last_became_peered":"2024-05-21T14:43:19.596157+0000","last_unstale":"2024-05-21T14:43:20.578450+0000","last_undegraded":"2024-05-21T14:43:20.578450+0000","last_fullsized":"2024-05-21T14:43:20.578450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:22:14.002930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.597491+0000","last_change":"2024-05-21T14:43:18.614044+0000","last_active":"2024-05-21T14:43:19.597491+0000","last_peered":"2024-05-21T14:43:19.597491+0000","last_clean":"2024-05-21T14:43:19.597491+0000","last_became_active":"2024-05-21T14:43:18.613730+0000","last_became_peered":"2024-05-21T14:43:18.613730+0000","last_unstale":"2024-05-21T14:43:19.597491+0000","last_undegraded":"2024-05-21T14:43:19.597491+0000","last_fullsized":"2024-05-21T14:43:19.597491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:41:34.787779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.629965+0000","last_change":"2024-05-21T14:43:19.621999+0000","last_active":"2024-05-21T14:43:19.629965+0000","last_peered":"2024-05-21T14:43:19.629965+0000","last_clean":"2024-05-21T14:43:19.629965+0000","last_became_active":"2024-05-21T14:43:19.614744+0000","last_became_peered":"2024-05-21T14:43:19.614744+0000","last_unstale":"2024-05-21T14:43:19.629965+0000","last_undegraded":"2024-05-21T14:43:19.629965+0000","last_fullsized":"2024-05-21T14:43:19.629965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:30:33.727601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.601384+0000","last_change":"2024-05-21T14:43:18.614193+0000","last_active":"2024-05-21T14:43:19.601384+0000","last_peered":"2024-05-21T14:43:19.601384+0000","last_clean":"2024-05-21T14:43:19.601384+0000","last_became_active":"2024-05-21T14:43:18.609797+0000","last_became_peered":"2024-05-21T14:43:18.609797+0000","last_unstale":"2024-05-21T14:43:19.601384+0000","last_undegraded":"2024-05-21T14:43:19.601384+0000","last_fullsized":"2024-05-21T14:43:19.601384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:39:55.623816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.621805+0000","last_change":"2024-05-21T14:43:19.610578+0000","last_active":"2024-05-21T14:43:19.621805+0000","last_peered":"2024-05-21T14:43:19.621805+0000","last_clean":"2024-05-21T14:43:19.621805+0000","last_became_active":"2024-05-21T14:43:19.606575+0000","last_became_peered":"2024-05-21T14:43:19.606575+0000","last_unstale":"2024-05-21T14:43:19.621805+0000","last_undegraded":"2024-05-21T14:43:19.621805+0000","last_fullsized":"2024-05-21T14:43:19.621805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:06:01.278748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-21T14:43:19.587219+0000","last_change":"2024-05-21T14:43:18.601862+0000","last_active":"2024-05-21T14:43:19.587219+0000","last_peered":"2024-05-21T14:43:19.587219+0000","last_clean":"2024-05-21T14:43:19.587219+0000","last_became_active":"2024-05-21T14:43:18.601311+0000","last_became_peered":"2024-05-21T14:43:18.601311+0000","last_unstale":"2024-05-21T14:43:19.587219+0000","last_undegraded":"2024-05-21T14:43:19.587219+0000","last_fullsized":"2024-05-21T14:43:19.587219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:02.736061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":665303,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":665303,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T14:43:26.173 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-21T14:43:26.174 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-21T14:43:26.174 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-21T14:43:26.174 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-21T14:43:26.174 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-21T14:43:26.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.349+0000 7fa772000640 1 Processor -- start 2024-05-21T14:43:26.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.349+0000 7fa772000640 1 -- start start 2024-05-21T14:43:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.349+0000 7fa772000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa76c155cb0 0x7fa76c06e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.349+0000 7fa772000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa76c071180 0x7fa76c166340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.349+0000 7fa772000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa76c0c9550 con 0x7fa76c070d70 2024-05-21T14:43:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.349+0000 7fa772000640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fa76c15c440 con 0x7fa76c071180 2024-05-21T14:43:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.349+0000 7fa772000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa76c0c9810 con 0x7fa76c155cb0 2024-05-21T14:43:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.349+0000 7fa76be00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa76c071180 0x7fa76c166340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.349+0000 7fa76be00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa76c071180 0x7fa76c166340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38122/0 (socket says 172.21.15.78:38122) 2024-05-21T14:43:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.349+0000 7fa76be00640 1 -- 172.21.15.78:0/1707317696 learned_addr learned my addr 172.21.15.78:0/1707317696 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.349+0000 7fa76b400640 1 --2- 172.21.15.78:0/1707317696 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa76c155cb0 0x7fa76c06e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.349+0000 7fa76be00640 1 -- 172.21.15.78:0/1707317696 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa76c155cb0 msgr2=0x7fa76c06e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.349+0000 7fa76be00640 1 --2- 172.21.15.78:0/1707317696 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa76c155cb0 0x7fa76c06e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.349+0000 7fa76be00640 1 -- 172.21.15.78:0/1707317696 >> v1:172.21.15.84:6789/0 conn(0x7fa76c070d70 legacy=0x7fa76c06cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.349+0000 7fa76be00640 1 -- 172.21.15.78:0/1707317696 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76c0c9af0 con 0x7fa76c071180 2024-05-21T14:43:26.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.353+0000 7fa76be00640 1 --2- 172.21.15.78:0/1707317696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c071180 0x7fa76c166340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa764009870 tx=0x7fa76401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0187218a99905d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:26.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.353+0000 7fa76aa00640 1 -- 172.21.15.78:0/1707317696 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7640a95f0 con 0x7fa76c071180 2024-05-21T14:43:26.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.353+0000 7fa76aa00640 1 -- 172.21.15.78:0/1707317696 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7640a9790 con 0x7fa76c071180 2024-05-21T14:43:26.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.353+0000 7fa76aa00640 1 -- 172.21.15.78:0/1707317696 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7640a9b60 con 0x7fa76c071180 2024-05-21T14:43:26.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.353+0000 7fa772000640 1 -- 172.21.15.78:0/1707317696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c071180 msgr2=0x7fa76c166340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:26.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.353+0000 7fa772000640 1 --2- 172.21.15.78:0/1707317696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c071180 0x7fa76c166340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa764009870 tx=0x7fa76401c530 comp rx=0 tx=0).stop 2024-05-21T14:43:26.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.353+0000 7fa772000640 1 -- 172.21.15.78:0/1707317696 shutdown_connections 2024-05-21T14:43:26.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.353+0000 7fa772000640 1 --2- 172.21.15.78:0/1707317696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c071180 0x7fa76c166340 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.353+0000 7fa772000640 1 --2- 172.21.15.78:0/1707317696 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa76c155cb0 0x7fa76c06e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.353+0000 7fa772000640 1 -- 172.21.15.78:0/1707317696 >> 172.21.15.78:0/1707317696 conn(0x7fa76c0752c0 msgr2=0x7fa76c0ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:26.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.353+0000 7fa772000640 1 -- 172.21.15.78:0/1707317696 shutdown_connections 2024-05-21T14:43:26.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.353+0000 7fa772000640 1 -- 172.21.15.78:0/1707317696 wait complete. 2024-05-21T14:43:26.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.357+0000 7fa772000640 1 Processor -- start 2024-05-21T14:43:26.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.357+0000 7fa772000640 1 -- start start 2024-05-21T14:43:26.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.357+0000 7fa772000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c070d70 0x7fa76c14d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:26.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.357+0000 7fa772000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa76c071180 0x7fa76c146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:26.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.357+0000 7fa772000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa76c155cb0 0x7fa76c1468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:26.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.357+0000 7fa772000640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c06de70 con 0x7fa76c070d70 2024-05-21T14:43:26.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.357+0000 7fa772000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c15baa0 con 0x7fa76c071180 2024-05-21T14:43:26.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.357+0000 7fa772000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa76c15c8d0 con 0x7fa76c155cb0 2024-05-21T14:43:26.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.357+0000 7fa76b400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c070d70 0x7fa76c14d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:26.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.357+0000 7fa76b400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c070d70 0x7fa76c14d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38138/0 (socket says 172.21.15.78:38138) 2024-05-21T14:43:26.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.357+0000 7fa76b400640 1 -- 172.21.15.78:0/470961570 learned_addr learned my addr 172.21.15.78:0/470961570 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:26.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.357+0000 7fa762a00640 1 --2- 172.21.15.78:0/470961570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa76c071180 0x7fa76c146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:26.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.357+0000 7fa76be00640 1 --2- 172.21.15.78:0/470961570 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa76c155cb0 0x7fa76c1468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:26.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.361+0000 7fa76b400640 1 -- 172.21.15.78:0/470961570 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa76c155cb0 msgr2=0x7fa76c1468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:26.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.361+0000 7fa76b400640 1 --2- 172.21.15.78:0/470961570 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa76c155cb0 0x7fa76c1468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.361+0000 7fa76b400640 1 -- 172.21.15.78:0/470961570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa76c071180 msgr2=0x7fa76c146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:26.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.361+0000 7fa76b400640 1 --2- 172.21.15.78:0/470961570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa76c071180 0x7fa76c146390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.361+0000 7fa76b400640 1 -- 172.21.15.78:0/470961570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76c14cbf0 con 0x7fa76c070d70 2024-05-21T14:43:26.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.361+0000 7fa76be00640 1 --2- 172.21.15.78:0/470961570 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa76c155cb0 0x7fa76c1468d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:26.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.361+0000 7fa76b400640 1 --2- 172.21.15.78:0/470961570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c070d70 0x7fa76c14d4c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00d600 tx=0x7fa75c00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:26.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.361+0000 7fa763e00640 1 -- 172.21.15.78:0/470961570 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c004240 con 0x7fa76c070d70 2024-05-21T14:43:26.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.361+0000 7fa763e00640 1 -- 172.21.15.78:0/470961570 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75c0043e0 con 0x7fa76c070d70 2024-05-21T14:43:26.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.361+0000 7fa772000640 1 -- 172.21.15.78:0/470961570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa76c1517d0 con 0x7fa76c070d70 2024-05-21T14:43:26.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.361+0000 7fa763e00640 1 -- 172.21.15.78:0/470961570 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c003840 con 0x7fa76c070d70 2024-05-21T14:43:26.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.361+0000 7fa772000640 1 -- 172.21.15.78:0/470961570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa76c151a70 con 0x7fa76c070d70 2024-05-21T14:43:26.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.361+0000 7fa772000640 1 -- 172.21.15.78:0/470961570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa76c04f730 con 0x7fa76c070d70 2024-05-21T14:43:26.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.361+0000 7fa763e00640 1 -- 172.21.15.78:0/470961570 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa75c0039e0 con 0x7fa76c070d70 2024-05-21T14:43:26.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.361+0000 7fa763e00640 1 --2- 172.21.15.78:0/470961570 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa7480678c0 0x7fa748069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:26.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.361+0000 7fa763e00640 1 -- 172.21.15.78:0/470961570 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa75c085f60 con 0x7fa76c070d70 2024-05-21T14:43:26.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.365+0000 7fa762a00640 1 --2- 172.21.15.78:0/470961570 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa7480678c0 0x7fa748069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:26.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.365+0000 7fa762a00640 1 --2- 172.21.15.78:0/470961570 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa7480678c0 0x7fa748069dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa76c1596a0 tx=0x7fa754009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:26.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.369+0000 7fa763e00640 1 -- 172.21.15.78:0/470961570 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa75c01c360 con 0x7fa76c070d70 2024-05-21T14:43:26.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.561+0000 7fa772000640 1 -- 172.21.15.78:0/470961570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fa76c1537a0 con 0x7fa76c070d70 2024-05-21T14:43:26.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.565+0000 7fa763e00640 1 -- 172.21.15.78:0/470961570 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166887 (secure 0 0 0) 0x7fa75c056a90 con 0x7fa76c070d70 2024-05-21T14:43:26.573 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:26.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.565+0000 7fa772000640 1 -- 172.21.15.78:0/470961570 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa7480678c0 msgr2=0x7fa748069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:26.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.565+0000 7fa772000640 1 --2- 172.21.15.78:0/470961570 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa7480678c0 0x7fa748069dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa76c1596a0 tx=0x7fa754009040 comp rx=0 tx=0).stop 2024-05-21T14:43:26.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.565+0000 7fa772000640 1 -- 172.21.15.78:0/470961570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c070d70 msgr2=0x7fa76c14d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:26.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.565+0000 7fa772000640 1 --2- 172.21.15.78:0/470961570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c070d70 0x7fa76c14d4c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00d600 tx=0x7fa75c00dac0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.565+0000 7fa772000640 1 -- 172.21.15.78:0/470961570 shutdown_connections 2024-05-21T14:43:26.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.565+0000 7fa772000640 1 --2- 172.21.15.78:0/470961570 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa7480678c0 0x7fa748069dd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.565+0000 7fa772000640 1 --2- 172.21.15.78:0/470961570 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa76c155cb0 0x7fa76c1468d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.565+0000 7fa772000640 1 --2- 172.21.15.78:0/470961570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa76c071180 0x7fa76c146390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.565+0000 7fa772000640 1 --2- 172.21.15.78:0/470961570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa76c070d70 0x7fa76c14d4c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.565+0000 7fa772000640 1 -- 172.21.15.78:0/470961570 >> 172.21.15.78:0/470961570 conn(0x7fa76c0752c0 msgr2=0x7fa76c071740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:26.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.565+0000 7fa772000640 1 -- 172.21.15.78:0/470961570 shutdown_connections 2024-05-21T14:43:26.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.565+0000 7fa772000640 1 -- 172.21.15.78:0/470961570 wait complete. 2024-05-21T14:43:26.593 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3203955676},{"type":"v1","addr":"172.21.15.84:6833","nonce":3203955676}]},"active_addr":"172.21.15.84:6833/3203955676","active_change":"2024-05-21T14:42:58.472968+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4111,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":4193254823}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1210834773}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2295635489}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3409636974}]}]} 2024-05-21T14:43:26.597 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-21T14:43:26.597 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-21T14:43:26.597 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:43:26.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.741+0000 7f39aa600640 1 Processor -- start 2024-05-21T14:43:26.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.741+0000 7f39aa600640 1 -- start start 2024-05-21T14:43:26.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.741+0000 7f39aa600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f39a40c9550 0x7f39a415d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:26.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.741+0000 7f39aa600640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f39a40718b0 0x7f39a4164000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:26.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.741+0000 7f39aa600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39a40c3eb0 con 0x7f39a40714a0 2024-05-21T14:43:26.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.741+0000 7f39aa600640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f39a4071010 con 0x7f39a40718b0 2024-05-21T14:43:26.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.741+0000 7f39aa600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f39a4071cc0 con 0x7f39a40c9550 2024-05-21T14:43:26.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.741+0000 7f39a3e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f39a40718b0 0x7f39a4164000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:26.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.741+0000 7f39a3e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f39a40718b0 0x7f39a4164000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38146/0 (socket says 172.21.15.78:38146) 2024-05-21T14:43:26.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.741+0000 7f39a3e00640 1 -- 172.21.15.78:0/2424754780 learned_addr learned my addr 172.21.15.78:0/2424754780 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:26.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.741+0000 7f39a3400640 1 --2- 172.21.15.78:0/2424754780 >> v2:172.21.15.84:3300/0 conn(0x7f39a40c9550 0x7f39a415d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:26.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.741+0000 7f39a3e00640 1 -- 172.21.15.78:0/2424754780 >> v2:172.21.15.84:3300/0 conn(0x7f39a40c9550 msgr2=0x7f39a415d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:26.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.741+0000 7f39a3e00640 1 --2- 172.21.15.78:0/2424754780 >> v2:172.21.15.84:3300/0 conn(0x7f39a40c9550 0x7f39a415d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.741+0000 7f39a3e00640 1 -- 172.21.15.78:0/2424754780 >> v1:172.21.15.84:6789/0 conn(0x7f39a40714a0 legacy=0x7f39a40cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:26.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.741+0000 7f39a3e00640 1 -- 172.21.15.78:0/2424754780 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a415cc70 con 0x7f39a40718b0 2024-05-21T14:43:26.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.745+0000 7f39a3e00640 1 --2- 172.21.15.78:0/2424754780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39a40718b0 0x7f39a4164000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f39a40cfc10 tx=0x7f399c01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4662e4c473a7fd19 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:26.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.745+0000 7f39a2a00640 1 -- 172.21.15.78:0/2424754780 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c0b5070 con 0x7f39a40718b0 2024-05-21T14:43:26.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.745+0000 7f39a2a00640 1 -- 172.21.15.78:0/2424754780 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399c0a89d0 con 0x7f39a40718b0 2024-05-21T14:43:26.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.745+0000 7f39a2a00640 1 -- 172.21.15.78:0/2424754780 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c0a8da0 con 0x7f39a40718b0 2024-05-21T14:43:26.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.745+0000 7f39aa600640 1 -- 172.21.15.78:0/2424754780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39a40718b0 msgr2=0x7f39a4164000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:26.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.745+0000 7f39aa600640 1 --2- 172.21.15.78:0/2424754780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39a40718b0 0x7f39a4164000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f39a40cfc10 tx=0x7f399c01ecd0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.745+0000 7f39aa600640 1 -- 172.21.15.78:0/2424754780 shutdown_connections 2024-05-21T14:43:26.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.745+0000 7f39aa600640 1 --2- 172.21.15.78:0/2424754780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39a40718b0 0x7f39a4164000 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.745+0000 7f39aa600640 1 --2- 172.21.15.78:0/2424754780 >> v2:172.21.15.84:3300/0 conn(0x7f39a40c9550 0x7f39a415d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.745+0000 7f39aa600640 1 -- 172.21.15.78:0/2424754780 >> 172.21.15.78:0/2424754780 conn(0x7f39a40752c0 msgr2=0x7f39a40ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:26.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.745+0000 7f39aa600640 1 -- 172.21.15.78:0/2424754780 shutdown_connections 2024-05-21T14:43:26.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.745+0000 7f39aa600640 1 -- 172.21.15.78:0/2424754780 wait complete. 2024-05-21T14:43:26.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39aa600640 1 Processor -- start 2024-05-21T14:43:26.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39aa600640 1 -- start start 2024-05-21T14:43:26.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39aa600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39a40714a0 0x7f39a4147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:26.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39aa600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39a40718b0 0x7f39a41e67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:26.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39aa600640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f39a40c9550 0x7f39a41e6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:26.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39aa600640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f39a40c4430 con 0x7f39a40714a0 2024-05-21T14:43:26.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39aa600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f39a40c4150 con 0x7f39a40718b0 2024-05-21T14:43:26.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39aa600640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f39a40cf3b0 con 0x7f39a40c9550 2024-05-21T14:43:26.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39a3400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39a40714a0 0x7f39a4147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:26.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39a3400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39a40714a0 0x7f39a4147b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38162/0 (socket says 172.21.15.78:38162) 2024-05-21T14:43:26.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39a3400640 1 -- 172.21.15.78:0/2890402884 learned_addr learned my addr 172.21.15.78:0/2890402884 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:26.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39a3e00640 1 --2- 172.21.15.78:0/2890402884 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f39a40c9550 0x7f39a41e6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:26.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f399aa00640 1 --2- 172.21.15.78:0/2890402884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39a40718b0 0x7f39a41e67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:26.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39a3400640 1 -- 172.21.15.78:0/2890402884 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f39a40c9550 msgr2=0x7f39a41e6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:26.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39a3400640 1 --2- 172.21.15.78:0/2890402884 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f39a40c9550 0x7f39a41e6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39a3400640 1 -- 172.21.15.78:0/2890402884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39a40718b0 msgr2=0x7f39a41e67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:26.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39a3400640 1 --2- 172.21.15.78:0/2890402884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39a40718b0 0x7f39a41e67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39a3400640 1 -- 172.21.15.78:0/2890402884 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a4153a80 con 0x7f39a40714a0 2024-05-21T14:43:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.749+0000 7f39a3400640 1 --2- 172.21.15.78:0/2890402884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39a40714a0 0x7f39a4147b30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3994007e40 tx=0x7f399400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.753+0000 7f399be00640 1 -- 172.21.15.78:0/2890402884 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994014620 con 0x7f39a40714a0 2024-05-21T14:43:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.753+0000 7f399be00640 1 -- 172.21.15.78:0/2890402884 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3994019070 con 0x7f39a40714a0 2024-05-21T14:43:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.753+0000 7f399be00640 1 -- 172.21.15.78:0/2890402884 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994014a00 con 0x7f39a40714a0 2024-05-21T14:43:26.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.753+0000 7f39aa600640 1 -- 172.21.15.78:0/2890402884 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a41523c0 con 0x7f39a40714a0 2024-05-21T14:43:26.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.753+0000 7f39aa600640 1 -- 172.21.15.78:0/2890402884 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a40c7b90 con 0x7f39a40714a0 2024-05-21T14:43:26.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.753+0000 7f39aa600640 1 -- 172.21.15.78:0/2890402884 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a404f730 con 0x7f39a40714a0 2024-05-21T14:43:26.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.753+0000 7f399be00640 1 -- 172.21.15.78:0/2890402884 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3994014ba0 con 0x7f39a40714a0 2024-05-21T14:43:26.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.753+0000 7f399be00640 1 --2- 172.21.15.78:0/2890402884 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f39800678f0 0x7f3980069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:26.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.753+0000 7f399be00640 1 -- 172.21.15.78:0/2890402884 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f39940865b0 con 0x7f39a40714a0 2024-05-21T14:43:26.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.753+0000 7f399aa00640 1 --2- 172.21.15.78:0/2890402884 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f39800678f0 0x7f3980069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:26.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.757+0000 7f399aa00640 1 --2- 172.21.15.78:0/2890402884 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f39800678f0 0x7f3980069e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f39a40cbda0 tx=0x7f398c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:26.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.757+0000 7f399be00640 1 -- 172.21.15.78:0/2890402884 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f3994057050 con 0x7f39a40714a0 2024-05-21T14:43:26.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.917+0000 7f39aa600640 1 -- 172.21.15.78:0/2890402884 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39a40c9dc0 con 0x7f39a40714a0 2024-05-21T14:43:26.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.917+0000 7f399be00640 1 -- 172.21.15.78:0/2890402884 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16537 (secure 0 0 0) 0x7f3994056950 con 0x7f39a40714a0 2024-05-21T14:43:26.925 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:26.925 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:20.573644+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T14:43:17.088549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T14:43:18.012571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:43:26.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.921+0000 7f39aa600640 1 -- 172.21.15.78:0/2890402884 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f39800678f0 msgr2=0x7f3980069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:26.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.921+0000 7f39aa600640 1 --2- 172.21.15.78:0/2890402884 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f39800678f0 0x7f3980069e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f39a40cbda0 tx=0x7f398c008040 comp rx=0 tx=0).stop 2024-05-21T14:43:26.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.921+0000 7f39aa600640 1 -- 172.21.15.78:0/2890402884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39a40714a0 msgr2=0x7f39a4147b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:26.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.921+0000 7f39aa600640 1 --2- 172.21.15.78:0/2890402884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39a40714a0 0x7f39a4147b30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3994007e40 tx=0x7f399400e4b0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.921+0000 7f39aa600640 1 -- 172.21.15.78:0/2890402884 shutdown_connections 2024-05-21T14:43:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.921+0000 7f39aa600640 1 --2- 172.21.15.78:0/2890402884 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f39800678f0 0x7f3980069e00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.921+0000 7f39aa600640 1 --2- 172.21.15.78:0/2890402884 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f39a40c9550 0x7f39a41e6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.921+0000 7f39aa600640 1 --2- 172.21.15.78:0/2890402884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39a40718b0 0x7f39a41e67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.921+0000 7f39aa600640 1 --2- 172.21.15.78:0/2890402884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39a40714a0 0x7f39a4147b30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.921+0000 7f39aa600640 1 -- 172.21.15.78:0/2890402884 >> 172.21.15.78:0/2890402884 conn(0x7f39a40752c0 msgr2=0x7f39a415aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.921+0000 7f39aa600640 1 -- 172.21.15.78:0/2890402884 shutdown_connections 2024-05-21T14:43:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:26.921+0000 7f39aa600640 1 -- 172.21.15.78:0/2890402884 wait complete. 2024-05-21T14:43:26.948 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-21T14:43:26.948 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:43:27.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.085+0000 7f9a0c600640 1 Processor -- start 2024-05-21T14:43:27.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.085+0000 7f9a0c600640 1 -- start start 2024-05-21T14:43:27.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.085+0000 7f9a0c600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9a04071fe0 0x7f9a040723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.089+0000 7f9a0c600640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9a040c5640 0x7f9a040c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.089+0000 7f9a0c600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a040715f0 con 0x7f9a041529d0 2024-05-21T14:43:27.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.089+0000 7f9a0c600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f9a04072b80 con 0x7f9a04071fe0 2024-05-21T14:43:27.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.089+0000 7f9a0c600640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f9a040c8530 con 0x7f9a040c5640 2024-05-21T14:43:27.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.089+0000 7f9a0a600640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9a040c5640 0x7f9a040c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.089+0000 7f9a09200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9a04071fe0 0x7f9a040723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.089+0000 7f9a09c00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9a041529d0 0x7f9a04072e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.78:34638/0 (socket says 172.21.15.78:34638) 2024-05-21T14:43:27.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.089+0000 7f9a09c00640 1 -- 172.21.15.78:0/2292142812 learned_addr learned my addr 172.21.15.78:0/2292142812 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:27.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.089+0000 7f9a0a600640 1 -- 172.21.15.78:0/2292142812 >> v2:172.21.15.84:3300/0 conn(0x7f9a04071fe0 msgr2=0x7f9a040723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.089+0000 7f9a0a600640 1 --2- 172.21.15.78:0/2292142812 >> v2:172.21.15.84:3300/0 conn(0x7f9a04071fe0 0x7f9a040723f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.089+0000 7f9a0a600640 1 -- 172.21.15.78:0/2292142812 >> v1:172.21.15.84:6789/0 conn(0x7f9a041529d0 legacy=0x7f9a04072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.089+0000 7f9a0a600640 1 -- 172.21.15.78:0/2292142812 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a040c8810 con 0x7f9a040c5640 2024-05-21T14:43:27.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.093+0000 7f9a0a600640 1 --2- 172.21.15.78:0/2292142812 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9a040c5640 0x7f9a040c5a50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009d90 tx=0x7f99fc01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83897bed602a6bf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.093+0000 7f9a03e00640 1 -- 172.21.15.78:0/2292142812 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0b2070 con 0x7f9a040c5640 2024-05-21T14:43:27.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.093+0000 7f9a03e00640 1 -- 172.21.15.78:0/2292142812 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99fc0a5830 con 0x7f9a040c5640 2024-05-21T14:43:27.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.093+0000 7f9a03e00640 1 -- 172.21.15.78:0/2292142812 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0a5c00 con 0x7f9a040c5640 2024-05-21T14:43:27.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.093+0000 7f9a0c600640 1 -- 172.21.15.78:0/2292142812 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9a040c5640 msgr2=0x7f9a040c5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.093+0000 7f9a0c600640 1 --2- 172.21.15.78:0/2292142812 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9a040c5640 0x7f9a040c5a50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009d90 tx=0x7f99fc01c970 comp rx=0 tx=0).stop 2024-05-21T14:43:27.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.093+0000 7f9a0c600640 1 -- 172.21.15.78:0/2292142812 shutdown_connections 2024-05-21T14:43:27.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.093+0000 7f9a0c600640 1 --2- 172.21.15.78:0/2292142812 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9a040c5640 0x7f9a040c5a50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.093+0000 7f9a0c600640 1 --2- 172.21.15.78:0/2292142812 >> v2:172.21.15.84:3300/0 conn(0x7f9a04071fe0 0x7f9a040723f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.093+0000 7f9a0c600640 1 -- 172.21.15.78:0/2292142812 >> 172.21.15.78:0/2292142812 conn(0x7f9a040c9380 msgr2=0x7f9a040c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.093+0000 7f9a0c600640 1 -- 172.21.15.78:0/2292142812 shutdown_connections 2024-05-21T14:43:27.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.093+0000 7f9a0c600640 1 -- 172.21.15.78:0/2292142812 wait complete. 2024-05-21T14:43:27.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.093+0000 7f9a0c600640 1 Processor -- start 2024-05-21T14:43:27.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.093+0000 7f9a0c600640 1 -- start start 2024-05-21T14:43:27.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a0c600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a04071fe0 0x7f9a04149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a0c600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a040c5640 0x7f9a04140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a0c600640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9a041529d0 0x7f9a04161c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a0c600640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9a04163a20 con 0x7f9a040c5640 2024-05-21T14:43:27.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a0c600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9a041638a0 con 0x7f9a04071fe0 2024-05-21T14:43:27.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a0c600640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f9a04163ba0 con 0x7f9a041529d0 2024-05-21T14:43:27.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a09200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a040c5640 0x7f9a04140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a09200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a040c5640 0x7f9a04140af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38164/0 (socket says 172.21.15.78:38164) 2024-05-21T14:43:27.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a09200640 1 -- 172.21.15.78:0/3627212024 learned_addr learned my addr 172.21.15.78:0/3627212024 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:27.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a09c00640 1 --2- 172.21.15.78:0/3627212024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a04071fe0 0x7f9a04149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a0a600640 1 --2- 172.21.15.78:0/3627212024 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9a041529d0 0x7f9a04161c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a09200640 1 -- 172.21.15.78:0/3627212024 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9a041529d0 msgr2=0x7f9a04161c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a09200640 1 --2- 172.21.15.78:0/3627212024 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9a041529d0 0x7f9a04161c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a09200640 1 -- 172.21.15.78:0/3627212024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a04071fe0 msgr2=0x7f9a04149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a09200640 1 --2- 172.21.15.78:0/3627212024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a04071fe0 0x7f9a04149b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a09200640 1 -- 172.21.15.78:0/3627212024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a04140440 con 0x7f9a040c5640 2024-05-21T14:43:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a09c00640 1 --2- 172.21.15.78:0/3627212024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a04071fe0 0x7f9a04149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a09200640 1 --2- 172.21.15.78:0/3627212024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a040c5640 0x7f9a04140af0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f99f000e8a0 tx=0x7f99f000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a01600640 1 -- 172.21.15.78:0/3627212024 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f0017070 con 0x7f9a040c5640 2024-05-21T14:43:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a01600640 1 -- 172.21.15.78:0/3627212024 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99f000c940 con 0x7f9a040c5640 2024-05-21T14:43:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a0c600640 1 -- 172.21.15.78:0/3627212024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a04140720 con 0x7f9a040c5640 2024-05-21T14:43:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a01600640 1 -- 172.21.15.78:0/3627212024 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f000ccf0 con 0x7f9a040c5640 2024-05-21T14:43:27.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a0c600640 1 -- 172.21.15.78:0/3627212024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a0413f080 con 0x7f9a040c5640 2024-05-21T14:43:27.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.097+0000 7f9a0c600640 1 -- 172.21.15.78:0/3627212024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a0404f730 con 0x7f9a040c5640 2024-05-21T14:43:27.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.101+0000 7f9a01600640 1 -- 172.21.15.78:0/3627212024 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f99f001a070 con 0x7f9a040c5640 2024-05-21T14:43:27.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.101+0000 7f9a01600640 1 --2- 172.21.15.78:0/3627212024 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f99e40678c0 0x7f99e4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.101+0000 7f9a01600640 1 -- 172.21.15.78:0/3627212024 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f99f0085f00 con 0x7f9a040c5640 2024-05-21T14:43:27.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.101+0000 7f9a09c00640 1 --2- 172.21.15.78:0/3627212024 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f99e40678c0 0x7f99e4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.101+0000 7f9a09c00640 1 --2- 172.21.15.78:0/3627212024 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f99e40678c0 0x7f99e4069dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99f8000f70 tx=0x7f99f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.105+0000 7f9a01600640 1 -- 172.21.15.78:0/3627212024 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f99f0056350 con 0x7f9a040c5640 2024-05-21T14:43:27.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.261+0000 7f9a0c600640 1 -- 172.21.15.78:0/3627212024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a04152290 con 0x7f9a040c5640 2024-05-21T14:43:27.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.265+0000 7f9a01600640 1 -- 172.21.15.78:0/3627212024 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16537 (secure 0 0 0) 0x7f99f005a650 con 0x7f9a040c5640 2024-05-21T14:43:27.271 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:27.271 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:20.573644+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T14:43:17.088549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T14:43:18.012571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:43:27.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.265+0000 7f9a0c600640 1 -- 172.21.15.78:0/3627212024 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f99e40678c0 msgr2=0x7f99e4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.265+0000 7f9a0c600640 1 --2- 172.21.15.78:0/3627212024 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f99e40678c0 0x7f99e4069dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99f8000f70 tx=0x7f99f8009040 comp rx=0 tx=0).stop 2024-05-21T14:43:27.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.265+0000 7f9a0c600640 1 -- 172.21.15.78:0/3627212024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a040c5640 msgr2=0x7f9a04140af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.265+0000 7f9a0c600640 1 --2- 172.21.15.78:0/3627212024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a040c5640 0x7f9a04140af0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f99f000e8a0 tx=0x7f99f000eca0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.265+0000 7f9a0c600640 1 -- 172.21.15.78:0/3627212024 shutdown_connections 2024-05-21T14:43:27.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.265+0000 7f9a0c600640 1 --2- 172.21.15.78:0/3627212024 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f99e40678c0 0x7f99e4069dd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.265+0000 7f9a0c600640 1 --2- 172.21.15.78:0/3627212024 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9a041529d0 0x7f9a04161c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.265+0000 7f9a0c600640 1 --2- 172.21.15.78:0/3627212024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a040c5640 0x7f9a04140af0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.265+0000 7f9a0c600640 1 --2- 172.21.15.78:0/3627212024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a04071fe0 0x7f9a04149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.265+0000 7f9a0c600640 1 -- 172.21.15.78:0/3627212024 >> 172.21.15.78:0/3627212024 conn(0x7f9a040c9380 msgr2=0x7f9a040c6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.265+0000 7f9a0c600640 1 -- 172.21.15.78:0/3627212024 shutdown_connections 2024-05-21T14:43:27.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.265+0000 7f9a0c600640 1 -- 172.21.15.78:0/3627212024 wait complete. 2024-05-21T14:43:27.293 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-21T14:43:27.293 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-21T14:43:27.294 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-21T14:43:27.294 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-21T14:43:27.294 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-21T14:43:27.295 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-21T14:43:27.295 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-21T14:43:27.296 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-21T14:43:27.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.549+0000 7fa847000640 1 Processor -- start 2024-05-21T14:43:27.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.549+0000 7fa847000640 1 -- start start 2024-05-21T14:43:27.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.553+0000 7fa847000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa838006540 0x7fa8380468d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.553+0000 7fa847000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa8380e77a0 0x7fa8380dda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.553+0000 7fa847000640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8380e7bb0 con 0x7fa8380457b0 2024-05-21T14:43:27.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.553+0000 7fa847000640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fa8380e7310 con 0x7fa838006540 2024-05-21T14:43:27.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.553+0000 7fa847000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa838047970 con 0x7fa8380e77a0 2024-05-21T14:43:27.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.553+0000 7fa845c00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa838006540 0x7fa8380468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.553+0000 7fa846600640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa8380457b0 0x7fa8380e36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57394/0 (socket says 172.21.15.78:57394) 2024-05-21T14:43:27.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.553+0000 7fa846600640 1 -- 172.21.15.78:0/2138808010 learned_addr learned my addr 172.21.15.78:0/2138808010 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:27.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.553+0000 7fa845c00640 1 -- 172.21.15.78:0/2138808010 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa8380e77a0 msgr2=0x7fa8380dda40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-21T14:43:27.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.553+0000 7fa845c00640 1 --2- 172.21.15.78:0/2138808010 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa8380e77a0 0x7fa8380dda40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.553+0000 7fa845c00640 1 -- 172.21.15.78:0/2138808010 >> v1:172.21.15.78:6789/0 conn(0x7fa8380457b0 legacy=0x7fa8380e36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.553+0000 7fa845c00640 1 -- 172.21.15.78:0/2138808010 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa838046f60 con 0x7fa838006540 2024-05-21T14:43:27.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.557+0000 7fba83200640 1 Processor -- start 2024-05-21T14:43:27.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.557+0000 7fba83200640 1 -- start start 2024-05-21T14:43:27.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.557+0000 7fba83200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fba7c0e62b0 0x7fba7c0e66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.557+0000 7fba83200640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba7c0e5210 con 0x7fba7c0e7a10 2024-05-21T14:43:27.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.557+0000 7fba83200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba7c0e54f0 con 0x7fba7c0e4270 2024-05-21T14:43:27.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.557+0000 7fba83200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fba7c0e4fc0 con 0x7fba7c0e62b0 2024-05-21T14:43:27.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.557+0000 7fba82800640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fba7c0e4270 0x7fba7c0e4680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.78:34650/0 (socket says 172.21.15.78:34650) 2024-05-21T14:43:27.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.557+0000 7fba82800640 1 -- 172.21.15.78:0/1968031892 learned_addr learned my addr 172.21.15.78:0/1968031892 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:27.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.557+0000 7f3658800640 1 Processor -- start 2024-05-21T14:43:27.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba80a00640 1 -- 172.21.15.78:0/1968031892 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 598826000 0 0) 0x7fba7c0e54f0 con 0x7fba7c0e4270 2024-05-21T14:43:27.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba80a00640 1 -- 172.21.15.78:0/1968031892 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba68003530 con 0x7fba7c0e4270 2024-05-21T14:43:27.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba81400640 1 --2- 172.21.15.78:0/1968031892 >> v2:172.21.15.78:3300/0 conn(0x7fba7c0e62b0 0x7fba7c0e66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7f3658800640 1 -- start start 2024-05-21T14:43:27.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fa845c00640 1 --2- 172.21.15.78:0/2138808010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa838006540 0x7fa8380468d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa8340097a0 tx=0x7fa83401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a57b724601add7 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba80a00640 1 -- 172.21.15.78:0/1968031892 <== mon.1 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3720123956 0 0) 0x7fba68003530 con 0x7fba7c0e4270 2024-05-21T14:43:27.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba80a00640 1 -- 172.21.15.78:0/1968031892 >> v2:172.21.15.78:3300/0 conn(0x7fba7c0e62b0 msgr2=0x7fba7c0e66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba80a00640 1 --2- 172.21.15.78:0/1968031892 >> v2:172.21.15.78:3300/0 conn(0x7fba7c0e62b0 0x7fba7c0e66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba80a00640 1 -- 172.21.15.78:0/1968031892 >> v1:172.21.15.78:6789/0 conn(0x7fba7c0e7a10 legacy=0x7fba7c0075e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba80a00640 1 -- 172.21.15.78:0/1968031892 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba7c0e57d0 con 0x7fba7c0e4270 2024-05-21T14:43:27.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba80a00640 1 -- 172.21.15.78:0/1968031892 <== mon.1 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7fba84068700 con 0x7fba7c0e4270 2024-05-21T14:43:27.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba80a00640 1 -- 172.21.15.78:0/1968031892 >> v1:172.21.15.84:6789/0 conn(0x7fba7c0e4270 legacy=0x7fba7c0e4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba80a00640 1 --2- 172.21.15.78:0/1968031892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba680039e0 0x7fba68003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba80a00640 1 --2- 172.21.15.78:0/1968031892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba68004810 0x7fba68004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba80a00640 1 --2- 172.21.15.78:0/1968031892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fba68005240 0x7fba6800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba80a00640 1 -- 172.21.15.78:0/1968031892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c0e4fc0 con 0x7fba68004810 2024-05-21T14:43:27.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba80a00640 1 -- 172.21.15.78:0/1968031892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fba6800c1e0 con 0x7fba680039e0 2024-05-21T14:43:27.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba80a00640 1 -- 172.21.15.78:0/1968031892 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fba6800c3e0 con 0x7fba68005240 2024-05-21T14:43:27.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba81400640 1 --2- 172.21.15.78:0/1968031892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba68004810 0x7fba68004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba81e00640 1 --2- 172.21.15.78:0/1968031892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba680039e0 0x7fba68003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba82800640 1 --2- 172.21.15.78:0/1968031892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fba68005240 0x7fba6800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fa83fe00640 1 -- 172.21.15.78:0/2138808010 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8340b5070 con 0x7fa838006540 2024-05-21T14:43:27.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fa83fe00640 1 -- 172.21.15.78:0/2138808010 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8340a8990 con 0x7fa838006540 2024-05-21T14:43:27.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fa83fe00640 1 -- 172.21.15.78:0/2138808010 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8340a8d60 con 0x7fa838006540 2024-05-21T14:43:27.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba82800640 1 -- 172.21.15.78:0/1968031892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba680039e0 msgr2=0x7fba68003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba82800640 1 --2- 172.21.15.78:0/1968031892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba680039e0 0x7fba68003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba82800640 1 -- 172.21.15.78:0/1968031892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba68004810 msgr2=0x7fba68004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba82800640 1 --2- 172.21.15.78:0/1968031892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba68004810 0x7fba68004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7fba82800640 1 -- 172.21.15.78:0/1968031892 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba7c0e57d0 con 0x7fba68005240 2024-05-21T14:43:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7f3658800640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3650072d40 0x7f3650151e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7f3658800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f36500713d0 0x7f365006b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7f3658800640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36500c8a60 con 0x7f36500717e0 2024-05-21T14:43:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7f3658800640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f36500c8d40 con 0x7f3650072d40 2024-05-21T14:43:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.561+0000 7f3658800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f3650157e90 con 0x7f36500713d0 2024-05-21T14:43:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7ff014e00640 1 Processor -- start 2024-05-21T14:43:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7fa847000640 1 -- 172.21.15.78:0/2138808010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa838006540 msgr2=0x7fa8380468d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7fa847000640 1 --2- 172.21.15.78:0/2138808010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa838006540 0x7fa8380468d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa8340097a0 tx=0x7fa83401ec90 comp rx=0 tx=0).stop 2024-05-21T14:43:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7f016a400640 1 Processor -- start 2024-05-21T14:43:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7ff014e00640 1 -- start start 2024-05-21T14:43:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7f3655e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3650072d40 0x7f3650151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7f3655e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3650072d40 0x7f3650151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38208/0 (socket says 172.21.15.78:38208) 2024-05-21T14:43:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7f3655e00640 1 -- 172.21.15.78:0/248111344 learned_addr learned my addr 172.21.15.78:0/248111344 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7f3655400640 1 --2- 172.21.15.78:0/248111344 >> v2:172.21.15.84:3300/0 conn(0x7f36500713d0 0x7f365006b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7fa847000640 1 -- 172.21.15.78:0/2138808010 shutdown_connections 2024-05-21T14:43:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7fa847000640 1 --2- 172.21.15.78:0/2138808010 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa8380e77a0 0x7fa8380dda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7fa847000640 1 --2- 172.21.15.78:0/2138808010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa838006540 0x7fa8380468d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7fa847000640 1 -- 172.21.15.78:0/2138808010 >> 172.21.15.78:0/2138808010 conn(0x7fa838050810 msgr2=0x7fa838050c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7f016a400640 1 -- start start 2024-05-21T14:43:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7f016a400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f015c0457e0 0x7f015c04b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7ff014e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff010163030 0x7ff0100c3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7ff014e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff010159c70 0x7ff0100c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7ff014e00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff0100c90d0 0x7ff0100c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7ff014e00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7ff010163440 con 0x7ff010159c70 2024-05-21T14:43:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7ff014e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7ff0100c7f90 con 0x7ff010163030 2024-05-21T14:43:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7ff014e00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff0100c8270 con 0x7ff0100c90d0 2024-05-21T14:43:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7f3655e00640 1 -- 172.21.15.78:0/248111344 >> v2:172.21.15.84:3300/0 conn(0x7f36500713d0 msgr2=0x7f365006b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7f3655e00640 1 --2- 172.21.15.78:0/248111344 >> v2:172.21.15.84:3300/0 conn(0x7f36500713d0 0x7f365006b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7f3655e00640 1 -- 172.21.15.78:0/248111344 >> v1:172.21.15.78:6789/0 conn(0x7f36500717e0 legacy=0x7f365015b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7f3655e00640 1 -- 172.21.15.78:0/248111344 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3650158170 con 0x7f3650072d40 2024-05-21T14:43:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7ff00f400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff010163030 0x7ff0100c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7ff00fe00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff0100c90d0 0x7ff0100c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7ff00fe00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff0100c90d0 0x7ff0100c9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:54762/0 (socket says 172.21.15.78:54762) 2024-05-21T14:43:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7ff00fe00640 1 -- 172.21.15.78:0/2752442957 learned_addr learned my addr 172.21.15.78:0/2752442957 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7f0163e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f015c0457e0 0x7f015c04b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7f0163e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f015c0457e0 0x7f015c04b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:42622/0 (socket says 172.21.15.78:42622) 2024-05-21T14:43:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7f0163e00640 1 -- 172.21.15.78:0/4067229716 learned_addr learned my addr 172.21.15.78:0/4067229716 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7fa847000640 1 -- 172.21.15.78:0/2138808010 shutdown_connections 2024-05-21T14:43:27.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7fa847000640 1 -- 172.21.15.78:0/2138808010 wait complete. 2024-05-21T14:43:27.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7fba82800640 1 -- 172.21.15.78:0/1968031892 reap_dead start 2024-05-21T14:43:27.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.565+0000 7fba82800640 1 --2- 172.21.15.78:0/1968031892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fba68005240 0x7fba6800b9d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fba8402d840 tx=0x7fba840995a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=347c2192311064fc server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7f6452200640 1 Processor -- start 2024-05-21T14:43:27.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7ff00ea00640 1 --2- 172.21.15.78:0/2752442957 >> v2:172.21.15.78:3300/0 conn(0x7ff010159c70 0x7ff0100c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7f016a400640 1 -- 172.21.15.78:0/4067229716 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f015c0e7960 con 0x7f015c04bbd0 2024-05-21T14:43:27.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7f016a400640 1 -- 172.21.15.78:0/4067229716 --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f015c0e4620 con 0x7f015c0dda20 2024-05-21T14:43:27.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7ff00fe00640 1 -- 172.21.15.78:0/2752442957 >> v2:172.21.15.84:3300/0 conn(0x7ff010163030 msgr2=0x7ff0100c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7ff00fe00640 1 --2- 172.21.15.78:0/2752442957 >> v2:172.21.15.84:3300/0 conn(0x7ff010163030 0x7ff0100c3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7f016a400640 1 -- 172.21.15.78:0/4067229716 --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f015c0dde30 con 0x7f015c0457e0 2024-05-21T14:43:27.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7ff00fe00640 1 -- 172.21.15.78:0/2752442957 >> v2:172.21.15.78:3300/0 conn(0x7ff010159c70 msgr2=0x7ff0100c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7ff00fe00640 1 --2- 172.21.15.78:0/2752442957 >> v2:172.21.15.78:3300/0 conn(0x7ff010159c70 0x7ff0100c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7ff00fe00640 1 -- 172.21.15.78:0/2752442957 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0100c8550 con 0x7ff0100c90d0 2024-05-21T14:43:27.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7fe312600640 1 Processor -- start 2024-05-21T14:43:27.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7f6452200640 1 -- start start 2024-05-21T14:43:27.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7fba80a00640 1 -- 172.21.15.78:0/1968031892 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba840008e0 con 0x7fba68005240 2024-05-21T14:43:27.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7fba80a00640 1 -- 172.21.15.78:0/1968031892 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba84128610 con 0x7fba68005240 2024-05-21T14:43:27.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7fba80a00640 1 -- 172.21.15.78:0/1968031892 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84128a40 con 0x7fba68005240 2024-05-21T14:43:27.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7fe312600640 1 -- start start 2024-05-21T14:43:27.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7f0163400640 1 -- 172.21.15.78:0/4067229716 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1576102164 0 0) 0x7f015c0e7960 con 0x7f015c04bbd0 2024-05-21T14:43:27.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7f0163400640 1 -- 172.21.15.78:0/4067229716 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f014c003530 con 0x7f015c04bbd0 2024-05-21T14:43:27.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7f0163400640 1 -- 172.21.15.78:0/4067229716 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 930976720 0 0) 0x7f015c0e4620 con 0x7f015c0dda20 2024-05-21T14:43:27.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7f0163400640 1 -- 172.21.15.78:0/4067229716 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f014c003890 con 0x7f015c0dda20 2024-05-21T14:43:27.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7fba83200640 1 -- 172.21.15.78:0/1968031892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fba68005240 msgr2=0x7fba6800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7fba83200640 1 --2- 172.21.15.78:0/1968031892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fba68005240 0x7fba6800b9d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fba8402d840 tx=0x7fba840995a0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7fba83200640 1 -- 172.21.15.78:0/1968031892 shutdown_connections 2024-05-21T14:43:27.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7fba83200640 1 --2- 172.21.15.78:0/1968031892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fba68005240 0x7fba6800b9d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7fba83200640 1 -- 172.21.15.78:0/1968031892 >> 172.21.15.78:0/1968031892 conn(0x7fba7c0512d0 msgr2=0x7fba7c0516e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7f0163e00640 1 -- 172.21.15.78:0/4067229716 >> v1:172.21.15.84:6789/0 conn(0x7f015c0dda20 legacy=0x7f015c0060f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7f0163400640 1 -- 172.21.15.78:0/4067229716 <== mon.1 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3656188607 0 0) 0x7f014c003890 con 0x7f015c0dda20 2024-05-21T14:43:27.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7f0163e00640 1 -- 172.21.15.78:0/4067229716 >> v1:172.21.15.78:6789/0 conn(0x7f015c04bbd0 legacy=0x7f015c0ee040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7f0163e00640 1 -- 172.21.15.78:0/4067229716 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015c0e3860 con 0x7f015c0457e0 2024-05-21T14:43:27.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7fa847000640 1 Processor -- start 2024-05-21T14:43:27.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7fa847000640 1 -- start start 2024-05-21T14:43:27.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f3655e00640 1 --2- 172.21.15.78:0/248111344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3650072d40 0x7f3650151e00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f365006e010 tx=0x7f364401e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cc0f40accbba63 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f6452200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f644c0c82d0 0x7f644c0c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f6452200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f644c072e50 0x7f644c073260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f6452200640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f644c071ae0 con 0x7f644c151ce0 2024-05-21T14:43:27.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f6452200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f644c072830 con 0x7f644c0c82d0 2024-05-21T14:43:27.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f6452200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f644c0c3750 con 0x7f644c072e50 2024-05-21T14:43:27.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f644b400640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f644c151ce0 0x7f644c0713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57432/0 (socket says 172.21.15.78:57432) 2024-05-21T14:43:27.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f644b400640 1 -- 172.21.15.78:0/497699974 learned_addr learned my addr 172.21.15.78:0/497699974 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:27.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7fba83200640 1 -- 172.21.15.78:0/1968031892 shutdown_connections 2024-05-21T14:43:27.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.569+0000 7fba83200640 1 -- 172.21.15.78:0/1968031892 wait complete. 2024-05-21T14:43:27.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f644aa00640 1 --2- 172.21.15.78:0/497699974 >> v2:172.21.15.78:3300/0 conn(0x7f644c0c82d0 0x7f644c0c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f644be00640 1 --2- 172.21.15.78:0/497699974 >> v2:172.21.15.84:3300/0 conn(0x7f644c072e50 0x7f644c073260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f644a000640 1 -- 172.21.15.78:0/497699974 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 308026766 0 0) 0x7f644c071ae0 con 0x7f644c151ce0 2024-05-21T14:43:27.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f3654a00640 1 -- 172.21.15.78:0/248111344 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36440ac5f0 con 0x7f3650072d40 2024-05-21T14:43:27.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7fe312600640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe30c1587a0 0x7fe30c158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f3654a00640 1 -- 172.21.15.78:0/248111344 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36440b1070 con 0x7f3650072d40 2024-05-21T14:43:27.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f3654a00640 1 -- 172.21.15.78:0/248111344 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36440ac5f0 con 0x7f3650072d40 2024-05-21T14:43:27.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7fe312600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe30c0c7110 0x7fe30c0c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7fe312600640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe30c15ba10 con 0x7fe30c152650 2024-05-21T14:43:27.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7fe312600640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fe30c15c870 con 0x7fe30c1587a0 2024-05-21T14:43:27.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7fe312600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fe30c15bcf0 con 0x7fe30c0c7110 2024-05-21T14:43:27.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7fe311c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe30c0c7110 0x7fe30c0c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7fe311c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe30c0c7110 0x7fe30c0c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:42644/0 (socket says 172.21.15.78:42644) 2024-05-21T14:43:27.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7fe311c00640 1 -- 172.21.15.78:0/3426703681 learned_addr learned my addr 172.21.15.78:0/3426703681 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:27.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7fba83200640 1 Processor -- start 2024-05-21T14:43:27.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7fba83200640 1 -- start start 2024-05-21T14:43:27.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7ff00fe00640 1 --2- 172.21.15.78:0/2752442957 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff0100c90d0 0x7ff0100c9aa0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff010070370 tx=0x7ff00801ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f94d565c23901e19 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7ff00e000640 1 -- 172.21.15.78:0/2752442957 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0080a5670 con 0x7ff0100c90d0 2024-05-21T14:43:27.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7ff00e000640 1 -- 172.21.15.78:0/2752442957 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0080a5810 con 0x7ff0100c90d0 2024-05-21T14:43:27.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7ff00e000640 1 -- 172.21.15.78:0/2752442957 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0080a5be0 con 0x7ff0100c90d0 2024-05-21T14:43:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f644a000640 1 -- 172.21.15.78:0/497699974 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6430003530 con 0x7f644c151ce0 2024-05-21T14:43:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f644aa00640 1 -- 172.21.15.78:0/497699974 >> v2:172.21.15.84:3300/0 conn(0x7f644c072e50 msgr2=0x7f644c073260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f644aa00640 1 --2- 172.21.15.78:0/497699974 >> v2:172.21.15.84:3300/0 conn(0x7f644c072e50 0x7f644c073260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f644aa00640 1 -- 172.21.15.78:0/497699974 >> v1:172.21.15.78:6789/0 conn(0x7f644c151ce0 legacy=0x7f644c0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f644aa00640 1 -- 172.21.15.78:0/497699974 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c071f00 con 0x7f644c0c82d0 2024-05-21T14:43:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7f644be00640 1 --2- 172.21.15.78:0/497699974 >> v2:172.21.15.84:3300/0 conn(0x7f644c072e50 0x7f644c073260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:27.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7fe311c00640 1 -- 172.21.15.78:0/3426703681 >> v2:172.21.15.78:3300/0 conn(0x7fe30c1587a0 msgr2=0x7fe30c158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7fe311c00640 1 --2- 172.21.15.78:0/3426703681 >> v2:172.21.15.78:3300/0 conn(0x7fe30c1587a0 0x7fe30c158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7fe311c00640 1 -- 172.21.15.78:0/3426703681 >> v1:172.21.15.78:6789/0 conn(0x7fe30c152650 legacy=0x7fe30c0c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7fe311c00640 1 -- 172.21.15.78:0/3426703681 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c15bfd0 con 0x7fe30c0c7110 2024-05-21T14:43:27.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7fa847000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa838006540 0x7fa83817a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.573+0000 7fb13b200640 1 Processor -- start 2024-05-21T14:43:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f0163e00640 1 --2- 172.21.15.78:0/4067229716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f015c0457e0 0x7f015c04b690 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f01500097f0 tx=0x7f015001c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ea66ae304cd6fb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fb13b200640 1 -- start start 2024-05-21T14:43:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7ff014e00640 1 -- 172.21.15.78:0/2752442957 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff0100c90d0 msgr2=0x7ff0100c9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7ff014e00640 1 --2- 172.21.15.78:0/2752442957 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff0100c90d0 0x7ff0100c9aa0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff010070370 tx=0x7ff00801ca10 comp rx=0 tx=0).stop 2024-05-21T14:43:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fa847000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8380457b0 0x7fa83816f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fa845c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa838006540 0x7fa83817a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fa845c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa838006540 0x7fa83817a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:54772/0 (socket says 172.21.15.78:54772) 2024-05-21T14:43:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fa845200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8380457b0 0x7fa83816f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fa845200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8380457b0 0x7fa83816f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38262/0 (socket says 172.21.15.78:38262) 2024-05-21T14:43:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7ff014e00640 1 -- 172.21.15.78:0/2752442957 shutdown_connections 2024-05-21T14:43:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7ff014e00640 1 --2- 172.21.15.78:0/2752442957 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff0100c90d0 0x7ff0100c9aa0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7ff014e00640 1 --2- 172.21.15.78:0/2752442957 >> v2:172.21.15.78:3300/0 conn(0x7ff010159c70 0x7ff0100c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7ff014e00640 1 --2- 172.21.15.78:0/2752442957 >> v2:172.21.15.84:3300/0 conn(0x7ff010163030 0x7ff0100c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7ff014e00640 1 -- 172.21.15.78:0/2752442957 >> 172.21.15.78:0/2752442957 conn(0x7ff01006ba20 msgr2=0x7ff01006be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f0163400640 1 -- 172.21.15.78:0/4067229716 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01500b0070 con 0x7f015c0457e0 2024-05-21T14:43:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f0163400640 1 -- 172.21.15.78:0/4067229716 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01500ab400 con 0x7f015c0457e0 2024-05-21T14:43:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f0163400640 1 -- 172.21.15.78:0/4067229716 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01500b0070 con 0x7f015c0457e0 2024-05-21T14:43:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fa845c00640 1 -- 172.21.15.78:0/376428153 learned_addr learned my addr 172.21.15.78:0/376428153 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:27.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fa847000640 1 --2- 172.21.15.78:0/376428153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8380e77a0 0x7fa8380e4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fa847000640 1 -- 172.21.15.78:0/376428153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa8380e6cc0 con 0x7fa8380457b0 2024-05-21T14:43:27.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fa847000640 1 -- 172.21.15.78:0/376428153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa838047500 con 0x7fa8380e77a0 2024-05-21T14:43:27.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fa847000640 1 -- 172.21.15.78:0/376428153 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa8380e6fa0 con 0x7fa838006540 2024-05-21T14:43:27.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fa845200640 1 -- 172.21.15.78:0/376428153 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa838006540 msgr2=0x7fa83817a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fa845200640 1 --2- 172.21.15.78:0/376428153 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa838006540 0x7fa83817a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fa845200640 1 -- 172.21.15.78:0/376428153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8380e77a0 msgr2=0x7fa8380e4890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-21T14:43:27.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fa845200640 1 --2- 172.21.15.78:0/376428153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8380e77a0 0x7fa8380e4890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fa845200640 1 -- 172.21.15.78:0/376428153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa838035c30 con 0x7fa8380457b0 2024-05-21T14:43:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fba83200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba68005240 0x7fba7c0372c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fba83200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba7c0de170 0x7fba7c17da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fba83200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fba7c04c670 0x7fba7c0e2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fba83200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c03a440 con 0x7fba7c0de170 2024-05-21T14:43:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fba83200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c0e5d90 con 0x7fba68005240 2024-05-21T14:43:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fba83200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fba7c051df0 con 0x7fba7c04c670 2024-05-21T14:43:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7ff014e00640 1 -- 172.21.15.78:0/2752442957 shutdown_connections 2024-05-21T14:43:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7ff014e00640 1 -- 172.21.15.78:0/2752442957 wait complete. 2024-05-21T14:43:27.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f016a400640 1 -- 172.21.15.78:0/4067229716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f015c0457e0 msgr2=0x7f015c04b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f016a400640 1 --2- 172.21.15.78:0/4067229716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f015c0457e0 0x7f015c04b690 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f01500097f0 tx=0x7f015001c420 comp rx=0 tx=0).stop 2024-05-21T14:43:27.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fb13b200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb13c0c8160 0x7fb13c158280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fa845200640 1 --2- 172.21.15.78:0/376428153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8380457b0 0x7fa83816f2e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa83800e120 tx=0x7fa82c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fba81e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba68005240 0x7fba7c0372c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f3658800640 1 -- 172.21.15.78:0/248111344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3650072d40 msgr2=0x7f3650151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f3658800640 1 --2- 172.21.15.78:0/248111344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3650072d40 0x7f3650151e00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f365006e010 tx=0x7f364401e720 comp rx=0 tx=0).stop 2024-05-21T14:43:27.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f016a400640 1 -- 172.21.15.78:0/4067229716 shutdown_connections 2024-05-21T14:43:27.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f016a400640 1 --2- 172.21.15.78:0/4067229716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f015c0457e0 0x7f015c04b690 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f016a400640 1 -- 172.21.15.78:0/4067229716 >> 172.21.15.78:0/4067229716 conn(0x7f015c0503c0 msgr2=0x7f015c0507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fb13b200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb13c0c6390 0x7fb13c0c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fb13b200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb13c06b620 0x7fb13c06ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fb13b200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fb13c151f10 con 0x7fb13c0c8160 2024-05-21T14:43:27.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fb13b200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fb13c15ad60 con 0x7fb13c06b620 2024-05-21T14:43:27.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fb13b200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb13c0c86f0 con 0x7fb13c0c6390 2024-05-21T14:43:27.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fba82800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fba7c04c670 0x7fba7c0e2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fba82800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fba7c04c670 0x7fba7c0e2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:54788/0 (socket says 172.21.15.78:54788) 2024-05-21T14:43:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fba82800640 1 -- 172.21.15.78:0/2719329189 learned_addr learned my addr 172.21.15.78:0/2719329189 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f3658800640 1 -- 172.21.15.78:0/248111344 shutdown_connections 2024-05-21T14:43:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f3658800640 1 --2- 172.21.15.78:0/248111344 >> v2:172.21.15.84:3300/0 conn(0x7f36500713d0 0x7f365006b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f3658800640 1 --2- 172.21.15.78:0/248111344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3650072d40 0x7f3650151e00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f3658800640 1 -- 172.21.15.78:0/248111344 >> 172.21.15.78:0/248111344 conn(0x7f36500cd1e0 msgr2=0x7f36500c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f016a400640 1 -- 172.21.15.78:0/4067229716 shutdown_connections 2024-05-21T14:43:27.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fb13a800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb13c06b620 0x7fb13c06ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fb139400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb13c0c6390 0x7fb13c0c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fb13a800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb13c06b620 0x7fb13c06ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:42678/0 (socket says 172.21.15.78:42678) 2024-05-21T14:43:27.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fb13a800640 1 -- 172.21.15.78:0/1893868534 learned_addr learned my addr 172.21.15.78:0/1893868534 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f3658800640 1 -- 172.21.15.78:0/248111344 shutdown_connections 2024-05-21T14:43:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f3658800640 1 -- 172.21.15.78:0/248111344 wait complete. 2024-05-21T14:43:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7f016a400640 1 -- 172.21.15.78:0/4067229716 wait complete. 2024-05-21T14:43:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fb139400640 1 -- 172.21.15.78:0/1893868534 >> v2:172.21.15.84:3300/0 conn(0x7fb13c06b620 msgr2=0x7fb13c06ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fb139400640 1 --2- 172.21.15.78:0/1893868534 >> v2:172.21.15.84:3300/0 conn(0x7fb13c06b620 0x7fb13c06ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fba82800640 1 -- 172.21.15.78:0/2719329189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba68005240 msgr2=0x7fba7c0372c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fa83d600640 1 -- 172.21.15.78:0/376428153 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c015020 con 0x7fa8380457b0 2024-05-21T14:43:27.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fa83d600640 1 -- 172.21.15.78:0/376428153 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa82c011830 con 0x7fa8380457b0 2024-05-21T14:43:27.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fa83d600640 1 -- 172.21.15.78:0/376428153 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c011c00 con 0x7fa8380457b0 2024-05-21T14:43:27.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fba82800640 1 --2- 172.21.15.78:0/2719329189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba68005240 0x7fba7c0372c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fba82800640 1 -- 172.21.15.78:0/2719329189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba7c0de170 msgr2=0x7fba7c17da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fba82800640 1 --2- 172.21.15.78:0/2719329189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba7c0de170 0x7fba7c17da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fba82800640 1 -- 172.21.15.78:0/2719329189 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba7c179ac0 con 0x7fba7c04c670 2024-05-21T14:43:27.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fba81e00640 1 --2- 172.21.15.78:0/2719329189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba68005240 0x7fba7c0372c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:43:27.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fb139400640 1 -- 172.21.15.78:0/1893868534 >> v2:172.21.15.78:3300/0 conn(0x7fb13c0c8160 msgr2=0x7fb13c158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fb139400640 1 --2- 172.21.15.78:0/1893868534 >> v2:172.21.15.78:3300/0 conn(0x7fb13c0c8160 0x7fb13c158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.577+0000 7fb139400640 1 -- 172.21.15.78:0/1893868534 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb13c0c89d0 con 0x7fb13c0c6390 2024-05-21T14:43:27.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fa847000640 1 -- 172.21.15.78:0/376428153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa838035f10 con 0x7fa8380457b0 2024-05-21T14:43:27.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fa847000640 1 -- 172.21.15.78:0/376428153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8380364d0 con 0x7fa8380457b0 2024-05-21T14:43:27.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fba82800640 1 --2- 172.21.15.78:0/2719329189 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fba7c04c670 0x7fba7c0e2c70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fba84050a40 tx=0x7fba68005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7ff014e00640 1 Processor -- start 2024-05-21T14:43:27.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7f644aa00640 1 --2- 172.21.15.78:0/497699974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644c0c82d0 0x7f644c0c86e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f644c0729b0 tx=0x7f643801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a755006a5dcb1578 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fe311c00640 1 --2- 172.21.15.78:0/3426703681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c0c7110 0x7fe30c0c7520 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe30c06e6a0 tx=0x7fe2fc01c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82ad7f258e3942ed server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7f644a000640 1 -- 172.21.15.78:0/497699974 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64380b0070 con 0x7f644c0c82d0 2024-05-21T14:43:27.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fba7a000640 1 -- 172.21.15.78:0/2719329189 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8413a070 con 0x7fba7c04c670 2024-05-21T14:43:27.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fba83200640 1 -- 172.21.15.78:0/2719329189 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba7c179d80 con 0x7fba7c04c670 2024-05-21T14:43:27.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7f644a000640 1 -- 172.21.15.78:0/497699974 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64380ab600 con 0x7f644c0c82d0 2024-05-21T14:43:27.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fba83200640 1 -- 172.21.15.78:0/2719329189 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fba7c17a340 con 0x7fba7c04c670 2024-05-21T14:43:27.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fba7a000640 1 -- 172.21.15.78:0/2719329189 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba84128d60 con 0x7fba7c04c670 2024-05-21T14:43:27.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fba7a000640 1 -- 172.21.15.78:0/2719329189 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba840008e0 con 0x7fba7c04c670 2024-05-21T14:43:27.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fba83200640 1 -- 172.21.15.78:0/2719329189 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fba5c001040 con 0x7fba7c04c670 2024-05-21T14:43:27.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f3658800640 1 Processor -- start 2024-05-21T14:43:27.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f3658800640 1 -- start start 2024-05-21T14:43:27.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7ff014e00640 1 -- start start 2024-05-21T14:43:27.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7f016a400640 1 Processor -- start 2024-05-21T14:43:27.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7f644a000640 1 -- 172.21.15.78:0/497699974 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64380ab9d0 con 0x7f644c0c82d0 2024-05-21T14:43:27.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7f6452200640 1 -- 172.21.15.78:0/497699974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644c0c82d0 msgr2=0x7f644c0c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7f6452200640 1 --2- 172.21.15.78:0/497699974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644c0c82d0 0x7f644c0c86e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f644c0729b0 tx=0x7f643801c460 comp rx=0 tx=0).stop 2024-05-21T14:43:27.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7f6452200640 1 -- 172.21.15.78:0/497699974 shutdown_connections 2024-05-21T14:43:27.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7f6452200640 1 --2- 172.21.15.78:0/497699974 >> v2:172.21.15.84:3300/0 conn(0x7f644c072e50 0x7f644c073260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7f6452200640 1 --2- 172.21.15.78:0/497699974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644c0c82d0 0x7f644c0c86e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7f6452200640 1 -- 172.21.15.78:0/497699974 >> 172.21.15.78:0/497699974 conn(0x7f644c0cd1e0 msgr2=0x7f644c0c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f6452200640 1 -- 172.21.15.78:0/497699974 shutdown_connections 2024-05-21T14:43:27.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f6452200640 1 -- 172.21.15.78:0/497699974 wait complete. 2024-05-21T14:43:27.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fe30b400640 1 -- 172.21.15.78:0/3426703681 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0a5670 con 0x7fe30c0c7110 2024-05-21T14:43:27.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fe30b400640 1 -- 172.21.15.78:0/3426703681 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc0a5810 con 0x7fe30c0c7110 2024-05-21T14:43:27.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7fe30b400640 1 -- 172.21.15.78:0/3426703681 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0a5be0 con 0x7fe30c0c7110 2024-05-21T14:43:27.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fe312600640 1 -- 172.21.15.78:0/3426703681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c0c7110 msgr2=0x7fe30c0c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fe312600640 1 --2- 172.21.15.78:0/3426703681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c0c7110 0x7fe30c0c7520 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe30c06e6a0 tx=0x7fe2fc01c9b0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.581+0000 7f016a400640 1 -- start start 2024-05-21T14:43:27.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f016a400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f015c0457e0 0x7f015c180af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f016a400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f015c04bbd0 0x7f015c0e19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f016a400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f015c0dda20 0x7f015c0c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f016a400640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f015c0e7c20 con 0x7f015c0dda20 2024-05-21T14:43:27.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f016a400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f015c0e7670 con 0x7f015c04bbd0 2024-05-21T14:43:27.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f016a400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f015c006800 con 0x7f015c0457e0 2024-05-21T14:43:27.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7ff014e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0100c90d0 0x7ff010164920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7ff014e00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff010159c70 0x7ff01015c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7ff014e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff010163030 0x7ff010156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fe312600640 1 -- 172.21.15.78:0/3426703681 shutdown_connections 2024-05-21T14:43:27.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fe312600640 1 --2- 172.21.15.78:0/3426703681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c0c7110 0x7fe30c0c7520 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fe312600640 1 --2- 172.21.15.78:0/3426703681 >> v2:172.21.15.78:3300/0 conn(0x7fe30c1587a0 0x7fe30c158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fe312600640 1 -- 172.21.15.78:0/3426703681 >> 172.21.15.78:0/3426703681 conn(0x7fe30c06f520 msgr2=0x7fe30c0cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7ff014e00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff01006f8c0 con 0x7ff0100c90d0 2024-05-21T14:43:27.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7ff014e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff01006f740 con 0x7ff010163030 2024-05-21T14:43:27.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fb139400640 1 --2- 172.21.15.78:0/1893868534 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb13c0c6390 0x7fb13c0c67a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb13c070580 tx=0x7fb12c01ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c23bc10f3913d30f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f0169000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f015c0457e0 0x7f015c180af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fa847000640 1 -- 172.21.15.78:0/376428153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa83816d8d0 con 0x7fa8380457b0 2024-05-21T14:43:27.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fa83d600640 1 -- 172.21.15.78:0/376428153 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa82c018020 con 0x7fa8380457b0 2024-05-21T14:43:27.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7ff014e00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff01006fa40 con 0x7ff010159c70 2024-05-21T14:43:27.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7ff00fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff010163030 0x7ff010156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7ff00fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff010163030 0x7ff010156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:42692/0 (socket says 172.21.15.78:42692) 2024-05-21T14:43:27.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7ff00fe00640 1 -- 172.21.15.78:0/3846963053 learned_addr learned my addr 172.21.15.78:0/3846963053 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:27.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7ff00ea00640 1 --2- 172.21.15.78:0/3846963053 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff010159c70 0x7ff01015c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f0169000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f015c0457e0 0x7f015c180af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:54800/0 (socket says 172.21.15.78:54800) 2024-05-21T14:43:27.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f0169000640 1 -- 172.21.15.78:0/1476899550 learned_addr learned my addr 172.21.15.78:0/1476899550 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:27.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f0163e00640 1 --2- 172.21.15.78:0/1476899550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f015c04bbd0 0x7f015c0e19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fb138a00640 1 -- 172.21.15.78:0/1893868534 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0b5070 con 0x7fb13c0c6390 2024-05-21T14:43:27.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fb138a00640 1 -- 172.21.15.78:0/1893868534 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12c0a8930 con 0x7fb13c0c6390 2024-05-21T14:43:27.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fe312600640 1 -- 172.21.15.78:0/3426703681 shutdown_connections 2024-05-21T14:43:27.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fe312600640 1 -- 172.21.15.78:0/3426703681 wait complete. 2024-05-21T14:43:27.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fba7a000640 1 -- 172.21.15.78:0/2719329189 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fba8413d070 con 0x7fba7c04c670 2024-05-21T14:43:27.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7ff00f400640 1 --2- 172.21.15.78:0/3846963053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0100c90d0 0x7ff010164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7ff00fe00640 1 -- 172.21.15.78:0/3846963053 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff010159c70 msgr2=0x7ff01015c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7ff00fe00640 1 --2- 172.21.15.78:0/3846963053 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff010159c70 0x7ff01015c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7ff00fe00640 1 -- 172.21.15.78:0/3846963053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0100c90d0 msgr2=0x7ff010164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f0169a00640 1 --2- 172.21.15.78:0/1476899550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f015c0dda20 0x7f015c0c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fa83d600640 1 --2- 172.21.15.78:0/376428153 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa8200678f0 0x7fa820069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f3658800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36500713d0 0x7f365015aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f3658800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36500717e0 0x7f36500c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f3658800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3650072d40 0x7f36500cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f3658800640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f36500c8810 con 0x7f36500713d0 2024-05-21T14:43:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f3658800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f36500c8690 con 0x7f3650072d40 2024-05-21T14:43:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f3658800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f36500c3660 con 0x7f36500717e0 2024-05-21T14:43:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f3655400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36500717e0 0x7f36500c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7ff00fe00640 1 --2- 172.21.15.78:0/3846963053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0100c90d0 0x7ff010164920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fa83d600640 1 -- 172.21.15.78:0/376428153 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa82c085560 con 0x7fa8380457b0 2024-05-21T14:43:27.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fa83d600640 1 --2- 172.21.15.78:0/376428153 >> [v2:172.21.15.78:6800/2618175314,v1:172.21.15.78:6801/2618175314] conn(0x7fa82006fbc0 0x7fa820072010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fa83d600640 1 -- 172.21.15.78:0/376428153 --> [v2:172.21.15.78:6800/2618175314,v1:172.21.15.78:6801/2618175314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa8200726e0 con 0x7fa82006fbc0 2024-05-21T14:43:27.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fa83d600640 1 -- 172.21.15.78:0/376428153 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa82c08c050 con 0x7fa8380457b0 2024-05-21T14:43:27.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fa845c00640 1 --2- 172.21.15.78:0/376428153 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa8200678f0 0x7fa820069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7fba7a000640 1 --2- 172.21.15.78:0/2719329189 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fba640678f0 0x7fba64069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fba7a000640 1 -- 172.21.15.78:0/2719329189 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fba8419c330 con 0x7fba7c04c670 2024-05-21T14:43:27.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fba7a000640 1 --2- 172.21.15.78:0/2719329189 >> [v2:172.21.15.78:6824/840893414,v1:172.21.15.78:6825/840893414] conn(0x7fba6406fb40 0x7fba64071f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fba7a000640 1 -- 172.21.15.78:0/2719329189 --> [v2:172.21.15.78:6824/840893414,v1:172.21.15.78:6825/840893414] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba84127ec0 con 0x7fba6406fb40 2024-05-21T14:43:27.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fba7a000640 1 -- 172.21.15.78:0/2719329189 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fba8419c7c0 con 0x7fba7c04c670 2024-05-21T14:43:27.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f3655400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36500717e0 0x7f36500c5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:54812/0 (socket says 172.21.15.78:54812) 2024-05-21T14:43:27.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f3655400640 1 -- 172.21.15.78:0/575004651 learned_addr learned my addr 172.21.15.78:0/575004651 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:27.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f3655e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36500713d0 0x7f365015aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f3656800640 1 --2- 172.21.15.78:0/575004651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3650072d40 0x7f36500cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f3655400640 1 -- 172.21.15.78:0/575004651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3650072d40 msgr2=0x7f36500cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f3655400640 1 --2- 172.21.15.78:0/575004651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3650072d40 0x7f36500cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f3655400640 1 -- 172.21.15.78:0/575004651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36500713d0 msgr2=0x7f365015aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7ff00fe00640 1 -- 172.21.15.78:0/3846963053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0101571f0 con 0x7ff010163030 2024-05-21T14:43:27.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7ff00f400640 1 --2- 172.21.15.78:0/3846963053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0100c90d0 0x7ff010164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:43:27.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f0169a00640 1 -- 172.21.15.78:0/1476899550 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f015c0457e0 msgr2=0x7f015c180af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.585+0000 7f0169a00640 1 --2- 172.21.15.78:0/1476899550 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f015c0457e0 0x7f015c180af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f0169a00640 1 -- 172.21.15.78:0/1476899550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f015c04bbd0 msgr2=0x7f015c0e19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f0169a00640 1 --2- 172.21.15.78:0/1476899550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f015c04bbd0 0x7f015c0e19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f0169a00640 1 -- 172.21.15.78:0/1476899550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015c04ee90 con 0x7f015c0dda20 2024-05-21T14:43:27.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f0169a00640 1 --2- 172.21.15.78:0/1476899550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f015c0dda20 0x7f015c0c87c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0164069180 tx=0x7f0164068ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fb138a00640 1 -- 172.21.15.78:0/1893868534 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0a8d00 con 0x7fb13c0c6390 2024-05-21T14:43:27.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fa846600640 1 --2- 172.21.15.78:0/376428153 >> [v2:172.21.15.78:6800/2618175314,v1:172.21.15.78:6801/2618175314] conn(0x7fa82006fbc0 0x7fa820072010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7ff00fe00640 1 --2- 172.21.15.78:0/3846963053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff010163030 0x7ff010156620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff0080af040 tx=0x7ff0080197b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fba81e00640 1 --2- 172.21.15.78:0/2719329189 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fba640678f0 0x7fba64069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fba81400640 1 --2- 172.21.15.78:0/2719329189 >> [v2:172.21.15.78:6824/840893414,v1:172.21.15.78:6825/840893414] conn(0x7fba6406fb40 0x7fba64071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f3655400640 1 --2- 172.21.15.78:0/575004651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36500713d0 0x7f365015aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f0160c00640 1 -- 172.21.15.78:0/1476899550 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0164092070 con 0x7f015c0dda20 2024-05-21T14:43:27.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f0160c00640 1 -- 172.21.15.78:0/1476899550 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f016406b620 con 0x7f015c0dda20 2024-05-21T14:43:27.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f0160c00640 1 -- 172.21.15.78:0/1476899550 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0164092070 con 0x7f015c0dda20 2024-05-21T14:43:27.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fb13b200640 1 -- 172.21.15.78:0/1893868534 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb13c0c6390 msgr2=0x7fb13c0c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fb13b200640 1 --2- 172.21.15.78:0/1893868534 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb13c0c6390 0x7fb13c0c67a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb13c070580 tx=0x7fb12c01ec70 comp rx=0 tx=0).stop 2024-05-21T14:43:27.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f6452200640 1 Processor -- start 2024-05-21T14:43:27.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7ff007400640 1 -- 172.21.15.78:0/3846963053 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0080bc020 con 0x7ff010163030 2024-05-21T14:43:27.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7ff007400640 1 -- 172.21.15.78:0/3846963053 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0080b8670 con 0x7ff010163030 2024-05-21T14:43:27.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7ff007400640 1 -- 172.21.15.78:0/3846963053 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0080a5670 con 0x7ff010163030 2024-05-21T14:43:27.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f3655400640 1 -- 172.21.15.78:0/575004651 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36500c3450 con 0x7f36500717e0 2024-05-21T14:43:27.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fa846600640 1 --2- 172.21.15.78:0/376428153 >> [v2:172.21.15.78:6800/2618175314,v1:172.21.15.78:6801/2618175314] conn(0x7fa82006fbc0 0x7fa820072010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f3655e00640 1 --2- 172.21.15.78:0/575004651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36500713d0 0x7f365015aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:43:27.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f3655400640 1 --2- 172.21.15.78:0/575004651 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36500717e0 0x7f36500c5680 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f364000d5d0 tx=0x7f364000da90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f6452200640 1 -- start start 2024-05-21T14:43:27.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fa845c00640 1 --2- 172.21.15.78:0/376428153 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa8200678f0 0x7fa820069e00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa83401ecd0 tx=0x7fa8340aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f364a000640 1 -- 172.21.15.78:0/575004651 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640004240 con 0x7f36500717e0 2024-05-21T14:43:27.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7ff014e00640 1 -- 172.21.15.78:0/3846963053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff01015c9a0 con 0x7ff010163030 2024-05-21T14:43:27.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fb13b200640 1 -- 172.21.15.78:0/1893868534 shutdown_connections 2024-05-21T14:43:27.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fb13b200640 1 --2- 172.21.15.78:0/1893868534 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb13c0c6390 0x7fb13c0c67a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fb13b200640 1 --2- 172.21.15.78:0/1893868534 >> v2:172.21.15.84:3300/0 conn(0x7fb13c06b620 0x7fb13c06ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fb13b200640 1 --2- 172.21.15.78:0/1893868534 >> v2:172.21.15.78:3300/0 conn(0x7fb13c0c8160 0x7fb13c158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fb13b200640 1 -- 172.21.15.78:0/1893868534 >> 172.21.15.78:0/1893868534 conn(0x7fb13c06f520 msgr2=0x7fb13c0cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f016a400640 1 -- 172.21.15.78:0/1476899550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f015c1802f0 con 0x7f015c0dda20 2024-05-21T14:43:27.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f016a400640 1 -- 172.21.15.78:0/1476899550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f015c0e3490 con 0x7f015c0dda20 2024-05-21T14:43:27.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7ff014e00640 1 -- 172.21.15.78:0/3846963053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0101fd680 con 0x7ff010163030 2024-05-21T14:43:27.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fba81400640 1 --2- 172.21.15.78:0/2719329189 >> [v2:172.21.15.78:6824/840893414,v1:172.21.15.78:6825/840893414] conn(0x7fba6406fb40 0x7fba64071f90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fa83d600640 1 -- 172.21.15.78:0/376428153 <== osd.0 v2:172.21.15.78:6800/2618175314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa8200726e0 con 0x7fa82006fbc0 2024-05-21T14:43:27.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fba81e00640 1 --2- 172.21.15.78:0/2719329189 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fba640678f0 0x7fba64069e00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba74001a30 tx=0x7fba74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7fe312600640 1 Processor -- start 2024-05-21T14:43:27.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f016a400640 1 -- 172.21.15.78:0/1476899550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f015c04f0d0 con 0x7f015c0dda20 2024-05-21T14:43:27.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f6452200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644c072e50 0x7f644c14ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f6452200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f644c0c82d0 0x7f644c1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7fb13b200640 1 -- 172.21.15.78:0/1893868534 shutdown_connections 2024-05-21T14:43:27.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f6452200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f644c151ce0 0x7f644c0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f6452200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f644c164980 con 0x7f644c072e50 2024-05-21T14:43:27.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f6452200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f644c0c43e0 con 0x7f644c151ce0 2024-05-21T14:43:27.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f6452200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f644c164b00 con 0x7f644c0c82d0 2024-05-21T14:43:27.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7fb13b200640 1 -- 172.21.15.78:0/1893868534 wait complete. 2024-05-21T14:43:27.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f364a000640 1 -- 172.21.15.78:0/575004651 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36400043e0 con 0x7f36500717e0 2024-05-21T14:43:27.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.589+0000 7f364a000640 1 -- 172.21.15.78:0/575004651 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640003840 con 0x7f36500717e0 2024-05-21T14:43:27.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7fe312600640 1 -- start start 2024-05-21T14:43:27.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f3658800640 1 -- 172.21.15.78:0/575004651 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36500c4bc0 con 0x7f36500717e0 2024-05-21T14:43:27.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f3658800640 1 -- 172.21.15.78:0/575004651 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f365015b6b0 con 0x7f36500717e0 2024-05-21T14:43:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f644be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f644c151ce0 0x7f644c0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f644be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f644c151ce0 0x7f644c0cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:42700/0 (socket says 172.21.15.78:42700) 2024-05-21T14:43:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f644be00640 1 -- 172.21.15.78:0/3649689310 learned_addr learned my addr 172.21.15.78:0/3649689310 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f644be00640 1 -- 172.21.15.78:0/3649689310 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f644c0c82d0 msgr2=0x7f644c1509b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-21T14:43:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f644be00640 1 --2- 172.21.15.78:0/3649689310 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f644c0c82d0 0x7f644c1509b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f644be00640 1 -- 172.21.15.78:0/3649689310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644c072e50 msgr2=0x7f644c14ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f644be00640 1 --2- 172.21.15.78:0/3649689310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644c072e50 0x7f644c14ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f644be00640 1 -- 172.21.15.78:0/3649689310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c14cf50 con 0x7f644c151ce0 2024-05-21T14:43:27.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f3658800640 1 -- 172.21.15.78:0/575004651 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f365004f730 con 0x7f36500717e0 2024-05-21T14:43:27.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7fba7a000640 1 -- 172.21.15.78:0/2719329189 <== osd.1 v2:172.21.15.78:6824/840893414 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fba84127ec0 con 0x7fba6406fb40 2024-05-21T14:43:27.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7ff014e00640 1 -- 172.21.15.78:0/3846963053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff01004f730 con 0x7ff010163030 2024-05-21T14:43:27.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f644be00640 1 --2- 172.21.15.78:0/3649689310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f644c151ce0 0x7f644c0cb650 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6444007df0 tx=0x7f644400d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7fe312600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe30c0c7110 0x7fe30c146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7fe312600640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe30c152650 0x7fe30c14eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7fe312600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c1587a0 0x7fe30c14f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7fe312600640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c152a60 con 0x7fe30c0c7110 2024-05-21T14:43:27.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7fe312600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c0c4320 con 0x7fe30c1587a0 2024-05-21T14:43:27.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7fe312600640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c14ba00 con 0x7fe30c152650 2024-05-21T14:43:27.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f364a000640 1 -- 172.21.15.78:0/575004651 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f36400039e0 con 0x7f36500717e0 2024-05-21T14:43:27.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7f0160c00640 1 -- 172.21.15.78:0/1476899550 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f016406b7d0 con 0x7f015c0dda20 2024-05-21T14:43:27.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f0160c00640 1 --2- 172.21.15.78:0/1476899550 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0144067ac0 0x7f0144069fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f0160c00640 1 -- 172.21.15.78:0/1476899550 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0164100c70 con 0x7f015c0dda20 2024-05-21T14:43:27.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f0160c00640 1 --2- 172.21.15.78:0/1476899550 >> [v2:172.21.15.84:6802/1494211791,v1:172.21.15.84:6804/1494211791] conn(0x7f014406fd90 0x7f01440721e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f0160c00640 1 -- 172.21.15.78:0/1476899550 --> [v2:172.21.15.84:6802/1494211791,v1:172.21.15.84:6804/1494211791] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0164068fd0 con 0x7f014406fd90 2024-05-21T14:43:27.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f0169000640 1 --2- 172.21.15.78:0/1476899550 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0144067ac0 0x7f0144069fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f0160c00640 1 -- 172.21.15.78:0/1476899550 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0164101060 con 0x7f015c0dda20 2024-05-21T14:43:27.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f0163e00640 1 --2- 172.21.15.78:0/1476899550 >> [v2:172.21.15.84:6802/1494211791,v1:172.21.15.84:6804/1494211791] conn(0x7f014406fd90 0x7f01440721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f6443400640 1 -- 172.21.15.78:0/3649689310 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644401a070 con 0x7f644c151ce0 2024-05-21T14:43:27.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f6443400640 1 -- 172.21.15.78:0/3649689310 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64440039a0 con 0x7f644c151ce0 2024-05-21T14:43:27.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f6443400640 1 -- 172.21.15.78:0/3649689310 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444003d90 con 0x7f644c151ce0 2024-05-21T14:43:27.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.593+0000 7fe311200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe30c0c7110 0x7fe30c146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7fe30be00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe30c152650 0x7fe30c14eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7fe311200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe30c0c7110 0x7fe30c146aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38308/0 (socket says 172.21.15.78:38308) 2024-05-21T14:43:27.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7fe311200640 1 -- 172.21.15.78:0/4040807232 learned_addr learned my addr 172.21.15.78:0/4040807232 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:27.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7fe311c00640 1 --2- 172.21.15.78:0/4040807232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c1587a0 0x7fe30c14f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7fe311200640 1 -- 172.21.15.78:0/4040807232 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe30c152650 msgr2=0x7fe30c14eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7fe311200640 1 --2- 172.21.15.78:0/4040807232 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe30c152650 0x7fe30c14eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7fe311200640 1 -- 172.21.15.78:0/4040807232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c1587a0 msgr2=0x7fe30c14f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7fe311200640 1 --2- 172.21.15.78:0/4040807232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c1587a0 0x7fe30c14f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7fe311200640 1 -- 172.21.15.78:0/4040807232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c14cf90 con 0x7fe30c0c7110 2024-05-21T14:43:27.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7ff007400640 1 -- 172.21.15.78:0/3846963053 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff0080bf020 con 0x7ff010163030 2024-05-21T14:43:27.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f364a000640 1 --2- 172.21.15.78:0/575004651 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f36340678f0 0x7f3634069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7fb13b200640 1 Processor -- start 2024-05-21T14:43:27.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f364a000640 1 -- 172.21.15.78:0/575004651 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3640086820 con 0x7f36500717e0 2024-05-21T14:43:27.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f364a000640 1 --2- 172.21.15.78:0/575004651 >> [v2:172.21.15.78:6808/68473545,v1:172.21.15.78:6810/68473545] conn(0x7f363406fb40 0x7f3634071f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f0169000640 1 --2- 172.21.15.78:0/1476899550 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0144067ac0 0x7f0144069fd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f01580016a0 tx=0x7f0158009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f364a000640 1 -- 172.21.15.78:0/575004651 --> [v2:172.21.15.78:6808/68473545,v1:172.21.15.78:6810/68473545] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f364000fe50 con 0x7f363406fb40 2024-05-21T14:43:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f364a000640 1 -- 172.21.15.78:0/575004651 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f3640086cb0 con 0x7f36500717e0 2024-05-21T14:43:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f0163e00640 1 --2- 172.21.15.78:0/1476899550 >> [v2:172.21.15.84:6802/1494211791,v1:172.21.15.84:6804/1494211791] conn(0x7f014406fd90 0x7f01440721e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f6452200640 1 -- 172.21.15.78:0/3649689310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644c13d420 con 0x7f644c151ce0 2024-05-21T14:43:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f6452200640 1 -- 172.21.15.78:0/3649689310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644c06f420 con 0x7f644c151ce0 2024-05-21T14:43:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7f6452200640 1 -- 172.21.15.78:0/3649689310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f644c13d6e0 con 0x7f644c151ce0 2024-05-21T14:43:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7fb13b200640 1 -- start start 2024-05-21T14:43:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7f3656800640 1 --2- 172.21.15.78:0/575004651 >> [v2:172.21.15.78:6808/68473545,v1:172.21.15.78:6810/68473545] conn(0x7f363406fb40 0x7f3634071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7ff007400640 1 --2- 172.21.15.78:0/3846963053 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7feff00678c0 0x7feff0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7ff007400640 1 -- 172.21.15.78:0/3846963053 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff008120b90 con 0x7ff010163030 2024-05-21T14:43:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7ff007400640 1 --2- 172.21.15.78:0/3846963053 >> [v2:172.21.15.78:6809/3531240521,v1:172.21.15.78:6811/3531240521] conn(0x7feff006fb90 0x7feff0071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7ff007400640 1 -- 172.21.15.78:0/3846963053 --> [v2:172.21.15.78:6809/3531240521,v1:172.21.15.78:6811/3531240521] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feff00726b0 con 0x7feff006fb90 2024-05-21T14:43:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.597+0000 7ff007400640 1 -- 172.21.15.78:0/3846963053 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ff0081252a0 con 0x7ff010163030 2024-05-21T14:43:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7fe311200640 1 --2- 172.21.15.78:0/4040807232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe30c0c7110 0x7fe30c146aa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe30400b3e0 tx=0x7fe30400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7f3655e00640 1 --2- 172.21.15.78:0/575004651 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f36340678f0 0x7f3634069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7f0160c00640 1 -- 172.21.15.78:0/1476899550 <== osd.4 v2:172.21.15.84:6802/1494211791 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0164068fd0 con 0x7f014406fd90 2024-05-21T14:43:27.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7fe308c00640 1 -- 172.21.15.78:0/4040807232 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304015020 con 0x7fe30c0c7110 2024-05-21T14:43:27.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7fe312600640 1 -- 172.21.15.78:0/4040807232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30c14fc70 con 0x7fe30c0c7110 2024-05-21T14:43:27.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7fe312600640 1 -- 172.21.15.78:0/4040807232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30c1f4f40 con 0x7fe30c0c7110 2024-05-21T14:43:27.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7fe308c00640 1 -- 172.21.15.78:0/4040807232 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe304011850 con 0x7fe30c0c7110 2024-05-21T14:43:27.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7fe308c00640 1 -- 172.21.15.78:0/4040807232 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304011c40 con 0x7fe30c0c7110 2024-05-21T14:43:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7ff00f400640 1 --2- 172.21.15.78:0/3846963053 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7feff00678c0 0x7feff0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7ff00ea00640 1 --2- 172.21.15.78:0/3846963053 >> [v2:172.21.15.78:6809/3531240521,v1:172.21.15.78:6811/3531240521] conn(0x7feff006fb90 0x7feff0071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7fb13b200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb13c06b620 0x7fb13c156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7fb13b200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb13c0c6390 0x7fb13c1f96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7fb13b200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb13c0c8160 0x7fb13c1f9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7ff00f400640 1 --2- 172.21.15.78:0/3846963053 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7feff00678c0 0x7feff0069dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feffc006fd0 tx=0x7feffc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7fb13b200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c0c8f90 con 0x7fb13c0c8160 2024-05-21T14:43:27.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7fb13b200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c15b000 con 0x7fb13c0c6390 2024-05-21T14:43:27.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.601+0000 7fb13b200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb13c157750 con 0x7fb13c06b620 2024-05-21T14:43:27.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb139e00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb13c06b620 0x7fb13c156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7f3655e00640 1 --2- 172.21.15.78:0/575004651 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f36340678f0 0x7f3634069e00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f36440b0000 tx=0x7f3644009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb139400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb13c0c6390 0x7fb13c1f96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7ff00ea00640 1 --2- 172.21.15.78:0/3846963053 >> [v2:172.21.15.78:6809/3531240521,v1:172.21.15.78:6811/3531240521] conn(0x7feff006fb90 0x7feff0071fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb13a800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb13c0c8160 0x7fb13c1f9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb13a800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb13c0c8160 0x7fb13c1f9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38316/0 (socket says 172.21.15.78:38316) 2024-05-21T14:43:27.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb13a800640 1 -- 172.21.15.78:0/1109060844 learned_addr learned my addr 172.21.15.78:0/1109060844 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:27.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb13a800640 1 -- 172.21.15.78:0/1109060844 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb13c06b620 msgr2=0x7fb13c156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fe308c00640 1 -- 172.21.15.78:0/4040807232 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe304018020 con 0x7fe30c0c7110 2024-05-21T14:43:27.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7f6443400640 1 -- 172.21.15.78:0/3649689310 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f644401d070 con 0x7f644c151ce0 2024-05-21T14:43:27.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb13a800640 1 --2- 172.21.15.78:0/1109060844 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb13c06b620 0x7fb13c156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb13a800640 1 -- 172.21.15.78:0/1109060844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb13c0c6390 msgr2=0x7fb13c1f96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb13a800640 1 --2- 172.21.15.78:0/1109060844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb13c0c6390 0x7fb13c1f96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb13a800640 1 -- 172.21.15.78:0/1109060844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb13c06e500 con 0x7fb13c0c8160 2024-05-21T14:43:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb139400640 1 --2- 172.21.15.78:0/1109060844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb13c0c6390 0x7fb13c1f96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb139e00640 1 --2- 172.21.15.78:0/1109060844 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb13c06b620 0x7fb13c156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:43:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb13a800640 1 --2- 172.21.15.78:0/1109060844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb13c0c8160 0x7fb13c1f9c00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb134009cf0 tx=0x7fb13400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb132000640 1 -- 172.21.15.78:0/1109060844 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13400cd20 con 0x7fb13c0c8160 2024-05-21T14:43:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb132000640 1 -- 172.21.15.78:0/1109060844 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1340039a0 con 0x7fb13c0c8160 2024-05-21T14:43:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb13b200640 1 -- 172.21.15.78:0/1109060844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb13c154c20 con 0x7fb13c0c8160 2024-05-21T14:43:27.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb132000640 1 -- 172.21.15.78:0/1109060844 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134003d90 con 0x7fb13c0c8160 2024-05-21T14:43:27.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fe308c00640 1 --2- 172.21.15.78:0/4040807232 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe2ec067910 0x7fe2ec069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7fe308c00640 1 -- 172.21.15.78:0/4040807232 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe304085c50 con 0x7fe30c0c7110 2024-05-21T14:43:27.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7fe302000640 1 -- 172.21.15.78:0/4040807232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe2e4001040 con 0x7fe30c0c7110 2024-05-21T14:43:27.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7fe30be00640 1 --2- 172.21.15.78:0/4040807232 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe2ec067910 0x7fe2ec069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7fe308c00640 1 --2- 172.21.15.78:0/4040807232 >> [v2:172.21.15.84:6800/2776653794,v1:172.21.15.84:6801/2776653794] conn(0x7fe2ec06fb60 0x7fe2ec071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.605+0000 7fb13b200640 1 -- 172.21.15.78:0/1109060844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb13c152160 con 0x7fb13c0c8160 2024-05-21T14:43:27.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7fb13b200640 1 -- 172.21.15.78:0/1109060844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb13c04f730 con 0x7fb13c0c8160 2024-05-21T14:43:27.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7fe308c00640 1 -- 172.21.15.78:0/4040807232 --> [v2:172.21.15.84:6800/2776653794,v1:172.21.15.84:6801/2776653794] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe304004460 con 0x7fe2ec06fb60 2024-05-21T14:43:27.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7f3656800640 1 --2- 172.21.15.78:0/575004651 >> [v2:172.21.15.78:6808/68473545,v1:172.21.15.78:6810/68473545] conn(0x7f363406fb40 0x7f3634071f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7ff007400640 1 -- 172.21.15.78:0/3846963053 <== osd.3 v2:172.21.15.78:6809/3531240521 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feff00726b0 con 0x7feff006fb90 2024-05-21T14:43:27.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7fe308c00640 1 -- 172.21.15.78:0/4040807232 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fe3040522c0 con 0x7fe30c0c7110 2024-05-21T14:43:27.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7f6443400640 1 --2- 172.21.15.78:0/3649689310 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f642c067990 0x7f642c069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7f6443400640 1 -- 172.21.15.78:0/3649689310 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f64440865d0 con 0x7f644c151ce0 2024-05-21T14:43:27.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7f6443400640 1 --2- 172.21.15.78:0/3649689310 >> [v2:172.21.15.84:6803/4084754024,v1:172.21.15.84:6805/4084754024] conn(0x7f642c06fc00 0x7f642c072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7f6443400640 1 -- 172.21.15.78:0/3649689310 --> [v2:172.21.15.84:6803/4084754024,v1:172.21.15.84:6805/4084754024] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f642c072720 con 0x7f642c06fc00 2024-05-21T14:43:27.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7f6443400640 1 -- 172.21.15.78:0/3649689310 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f64440869c0 con 0x7f644c151ce0 2024-05-21T14:43:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7fe311c00640 1 --2- 172.21.15.78:0/4040807232 >> [v2:172.21.15.84:6800/2776653794,v1:172.21.15.84:6801/2776653794] conn(0x7fe2ec06fb60 0x7fe2ec071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7fe30be00640 1 --2- 172.21.15.78:0/4040807232 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe2ec067910 0x7fe2ec069e20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8006fd0 tx=0x7fe2f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7f644b400640 1 --2- 172.21.15.78:0/3649689310 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f642c067990 0x7f642c069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7f644aa00640 1 --2- 172.21.15.78:0/3649689310 >> [v2:172.21.15.84:6803/4084754024,v1:172.21.15.84:6805/4084754024] conn(0x7f642c06fc00 0x7f642c072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.609+0000 7f364a000640 1 -- 172.21.15.78:0/575004651 <== osd.2 v2:172.21.15.78:6808/68473545 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f364000fe50 con 0x7f363406fb40 2024-05-21T14:43:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.613+0000 7fe311c00640 1 --2- 172.21.15.78:0/4040807232 >> [v2:172.21.15.84:6800/2776653794,v1:172.21.15.84:6801/2776653794] conn(0x7fe2ec06fb60 0x7fe2ec071fb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.613+0000 7fb132000640 1 -- 172.21.15.78:0/1109060844 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb134012050 con 0x7fb13c0c8160 2024-05-21T14:43:27.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.613+0000 7fb132000640 1 --2- 172.21.15.78:0/1109060844 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb11c0678c0 0x7fb11c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.613+0000 7fb132000640 1 -- 172.21.15.78:0/1109060844 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb134086e90 con 0x7fb13c0c8160 2024-05-21T14:43:27.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.613+0000 7f644b400640 1 --2- 172.21.15.78:0/3649689310 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f642c067990 0x7f642c069ea0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f643c007fd0 tx=0x7f643c007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.613+0000 7fb132000640 1 --2- 172.21.15.78:0/1109060844 >> [v2:172.21.15.84:6824/3186857851,v1:172.21.15.84:6825/3186857851] conn(0x7fb11c06fb10 0x7fb11c071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.613+0000 7fb139e00640 1 --2- 172.21.15.78:0/1109060844 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb11c0678c0 0x7fb11c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.613+0000 7fb132000640 1 -- 172.21.15.78:0/1109060844 --> [v2:172.21.15.84:6824/3186857851,v1:172.21.15.84:6825/3186857851] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb1340020c0 con 0x7fb11c06fb10 2024-05-21T14:43:27.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.613+0000 7fb132000640 1 -- 172.21.15.78:0/1109060844 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fb134087320 con 0x7fb13c0c8160 2024-05-21T14:43:27.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.613+0000 7fb139400640 1 --2- 172.21.15.78:0/1109060844 >> [v2:172.21.15.84:6824/3186857851,v1:172.21.15.84:6825/3186857851] conn(0x7fb11c06fb10 0x7fb11c071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.613+0000 7fe308c00640 1 -- 172.21.15.78:0/4040807232 <== osd.7 v2:172.21.15.84:6800/2776653794 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe304004460 con 0x7fe2ec06fb60 2024-05-21T14:43:27.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.613+0000 7fb139e00640 1 --2- 172.21.15.78:0/1109060844 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb11c0678c0 0x7fb11c069dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb128009cc0 tx=0x7fb128006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.613+0000 7fb139400640 1 --2- 172.21.15.78:0/1109060844 >> [v2:172.21.15.84:6824/3186857851,v1:172.21.15.84:6825/3186857851] conn(0x7fb11c06fb10 0x7fb11c071f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.617+0000 7f644aa00640 1 --2- 172.21.15.78:0/3649689310 >> [v2:172.21.15.84:6803/4084754024,v1:172.21.15.84:6805/4084754024] conn(0x7f642c06fc00 0x7f642c072050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.617+0000 7fb132000640 1 -- 172.21.15.78:0/1109060844 <== osd.5 v2:172.21.15.84:6824/3186857851 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb1340020c0 con 0x7fb11c06fb10 2024-05-21T14:43:27.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.617+0000 7f6443400640 1 -- 172.21.15.78:0/3649689310 <== osd.6 v2:172.21.15.84:6803/4084754024 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f642c072720 con 0x7f642c06fc00 2024-05-21T14:43:27.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.617+0000 7fa847000640 1 -- 172.21.15.78:0/376428153 --> [v2:172.21.15.78:6800/2618175314,v1:172.21.15.78:6801/2618175314] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa8380e64f0 con 0x7fa82006fbc0 2024-05-21T14:43:27.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.621+0000 7fa83d600640 1 -- 172.21.15.78:0/376428153 <== osd.0 v2:172.21.15.78:6800/2618175314 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa8380e64f0 con 0x7fa82006fbc0 2024-05-21T14:43:27.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.625+0000 7fa847000640 1 -- 172.21.15.78:0/376428153 >> [v2:172.21.15.78:6800/2618175314,v1:172.21.15.78:6801/2618175314] conn(0x7fa82006fbc0 msgr2=0x7fa820072010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.625+0000 7fa847000640 1 --2- 172.21.15.78:0/376428153 >> [v2:172.21.15.78:6800/2618175314,v1:172.21.15.78:6801/2618175314] conn(0x7fa82006fbc0 0x7fa820072010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.625+0000 7fa847000640 1 -- 172.21.15.78:0/376428153 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa8200678f0 msgr2=0x7fa820069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.625+0000 7fa847000640 1 --2- 172.21.15.78:0/376428153 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa8200678f0 0x7fa820069e00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa83401ecd0 tx=0x7fa8340aa070 comp rx=0 tx=0).stop 2024-05-21T14:43:27.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.625+0000 7fa847000640 1 -- 172.21.15.78:0/376428153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8380457b0 msgr2=0x7fa83816f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.625+0000 7fa847000640 1 --2- 172.21.15.78:0/376428153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8380457b0 0x7fa83816f2e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa83800e120 tx=0x7fa82c009f90 comp rx=0 tx=0).stop 2024-05-21T14:43:27.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.625+0000 7fa846600640 1 -- 172.21.15.78:0/376428153 reap_dead start 2024-05-21T14:43:27.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.625+0000 7fa847000640 1 -- 172.21.15.78:0/376428153 shutdown_connections 2024-05-21T14:43:27.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.625+0000 7fa847000640 1 -- 172.21.15.78:0/376428153 >> 172.21.15.78:0/376428153 conn(0x7fa838050810 msgr2=0x7fa838004c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.625+0000 7fa847000640 1 -- 172.21.15.78:0/376428153 shutdown_connections 2024-05-21T14:43:27.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.625+0000 7fa847000640 1 -- 172.21.15.78:0/376428153 wait complete. 2024-05-21T14:43:27.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.629+0000 7f016a400640 1 -- 172.21.15.78:0/1476899550 --> [v2:172.21.15.84:6802/1494211791,v1:172.21.15.84:6804/1494211791] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f015c0054b0 con 0x7f014406fd90 2024-05-21T14:43:27.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.633+0000 7f0160c00640 1 -- 172.21.15.78:0/1476899550 <== osd.4 v2:172.21.15.84:6802/1494211791 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f015c0054b0 con 0x7f014406fd90 2024-05-21T14:43:27.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.633+0000 7f016a400640 1 -- 172.21.15.78:0/1476899550 >> [v2:172.21.15.84:6802/1494211791,v1:172.21.15.84:6804/1494211791] conn(0x7f014406fd90 msgr2=0x7f01440721e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.633+0000 7f016a400640 1 --2- 172.21.15.78:0/1476899550 >> [v2:172.21.15.84:6802/1494211791,v1:172.21.15.84:6804/1494211791] conn(0x7f014406fd90 0x7f01440721e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.633+0000 7f016a400640 1 -- 172.21.15.78:0/1476899550 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0144067ac0 msgr2=0x7f0144069fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.633+0000 7f016a400640 1 --2- 172.21.15.78:0/1476899550 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0144067ac0 0x7f0144069fd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f01580016a0 tx=0x7f0158009040 comp rx=0 tx=0).stop 2024-05-21T14:43:27.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.633+0000 7f016a400640 1 -- 172.21.15.78:0/1476899550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f015c0dda20 msgr2=0x7f015c0c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.633+0000 7f016a400640 1 --2- 172.21.15.78:0/1476899550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f015c0dda20 0x7f015c0c87c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0164069180 tx=0x7f0164068ea0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.633+0000 7f0169a00640 1 -- 172.21.15.78:0/1476899550 reap_dead start 2024-05-21T14:43:27.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.633+0000 7f016a400640 1 -- 172.21.15.78:0/1476899550 shutdown_connections 2024-05-21T14:43:27.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.633+0000 7f016a400640 1 -- 172.21.15.78:0/1476899550 >> 172.21.15.78:0/1476899550 conn(0x7f015c0503c0 msgr2=0x7f015c04c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.633+0000 7fba83200640 1 -- 172.21.15.78:0/2719329189 --> [v2:172.21.15.78:6824/840893414,v1:172.21.15.78:6825/840893414] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fba5c002de0 con 0x7fba6406fb40 2024-05-21T14:43:27.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.633+0000 7fba7a000640 1 -- 172.21.15.78:0/2719329189 <== osd.1 v2:172.21.15.78:6824/840893414 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fba5c002de0 con 0x7fba6406fb40 2024-05-21T14:43:27.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.637+0000 7fba6f400640 1 -- 172.21.15.78:0/2719329189 >> [v2:172.21.15.78:6824/840893414,v1:172.21.15.78:6825/840893414] conn(0x7fba6406fb40 msgr2=0x7fba64071f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.637+0000 7fba6f400640 1 --2- 172.21.15.78:0/2719329189 >> [v2:172.21.15.78:6824/840893414,v1:172.21.15.78:6825/840893414] conn(0x7fba6406fb40 0x7fba64071f90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.637+0000 7f016a400640 1 -- 172.21.15.78:0/1476899550 shutdown_connections 2024-05-21T14:43:27.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.637+0000 7fba6f400640 1 -- 172.21.15.78:0/2719329189 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fba640678f0 msgr2=0x7fba64069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.637+0000 7fba6f400640 1 --2- 172.21.15.78:0/2719329189 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fba640678f0 0x7fba64069e00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba74001a30 tx=0x7fba74009040 comp rx=0 tx=0).stop 2024-05-21T14:43:27.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.637+0000 7fba6f400640 1 -- 172.21.15.78:0/2719329189 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fba7c04c670 msgr2=0x7fba7c0e2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.637+0000 7fba6f400640 1 --2- 172.21.15.78:0/2719329189 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fba7c04c670 0x7fba7c0e2c70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fba84050a40 tx=0x7fba68005840 comp rx=0 tx=0).stop 2024-05-21T14:43:27.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.637+0000 7fba82800640 1 -- 172.21.15.78:0/2719329189 reap_dead start 2024-05-21T14:43:27.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.637+0000 7fba6f400640 1 -- 172.21.15.78:0/2719329189 shutdown_connections 2024-05-21T14:43:27.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.637+0000 7fba6f400640 1 -- 172.21.15.78:0/2719329189 >> 172.21.15.78:0/2719329189 conn(0x7fba7c0512d0 msgr2=0x7fba7c04fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.637+0000 7fba6f400640 1 -- 172.21.15.78:0/2719329189 shutdown_connections 2024-05-21T14:43:27.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.637+0000 7fba6f400640 1 -- 172.21.15.78:0/2719329189 wait complete. 2024-05-21T14:43:27.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.637+0000 7f016a400640 1 -- 172.21.15.78:0/1476899550 wait complete. 2024-05-21T14:43:27.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.641+0000 7ff014e00640 1 -- 172.21.15.78:0/3846963053 --> [v2:172.21.15.78:6809/3531240521,v1:172.21.15.78:6811/3531240521] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff0100b2ac0 con 0x7feff006fb90 2024-05-21T14:43:27.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.641+0000 7ff007400640 1 -- 172.21.15.78:0/3846963053 <== osd.3 v2:172.21.15.78:6809/3531240521 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff0100b2ac0 con 0x7feff006fb90 2024-05-21T14:43:27.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7f6452200640 1 -- 172.21.15.78:0/3649689310 --> [v2:172.21.15.84:6803/4084754024,v1:172.21.15.84:6805/4084754024] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f644c04f730 con 0x7f642c06fc00 2024-05-21T14:43:27.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7fe302000640 1 -- 172.21.15.78:0/4040807232 --> [v2:172.21.15.84:6800/2776653794,v1:172.21.15.84:6801/2776653794] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe2e4002de0 con 0x7fe2ec06fb60 2024-05-21T14:43:27.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7ff014e00640 1 -- 172.21.15.78:0/3846963053 >> [v2:172.21.15.78:6809/3531240521,v1:172.21.15.78:6811/3531240521] conn(0x7feff006fb90 msgr2=0x7feff0071fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7ff014e00640 1 --2- 172.21.15.78:0/3846963053 >> [v2:172.21.15.78:6809/3531240521,v1:172.21.15.78:6811/3531240521] conn(0x7feff006fb90 0x7feff0071fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7ff014e00640 1 -- 172.21.15.78:0/3846963053 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7feff00678c0 msgr2=0x7feff0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7ff014e00640 1 --2- 172.21.15.78:0/3846963053 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7feff00678c0 0x7feff0069dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feffc006fd0 tx=0x7feffc008040 comp rx=0 tx=0).stop 2024-05-21T14:43:27.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7ff014e00640 1 -- 172.21.15.78:0/3846963053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff010163030 msgr2=0x7ff010156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7ff014e00640 1 --2- 172.21.15.78:0/3846963053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff010163030 0x7ff010156620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff0080af040 tx=0x7ff0080197b0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7ff00fe00640 1 -- 172.21.15.78:0/3846963053 reap_dead start 2024-05-21T14:43:27.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7f6443400640 1 -- 172.21.15.78:0/3649689310 <== osd.6 v2:172.21.15.84:6803/4084754024 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f644c04f730 con 0x7f642c06fc00 2024-05-21T14:43:27.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7fe308c00640 1 -- 172.21.15.78:0/4040807232 <== osd.7 v2:172.21.15.84:6800/2776653794 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe2e4002de0 con 0x7fe2ec06fb60 2024-05-21T14:43:27.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7f3658800640 1 -- 172.21.15.78:0/575004651 --> [v2:172.21.15.78:6808/68473545,v1:172.21.15.78:6810/68473545] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f365015b180 con 0x7f363406fb40 2024-05-21T14:43:27.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7ff014e00640 1 -- 172.21.15.78:0/3846963053 shutdown_connections 2024-05-21T14:43:27.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7ff014e00640 1 -- 172.21.15.78:0/3846963053 >> 172.21.15.78:0/3846963053 conn(0x7ff01006ba20 msgr2=0x7ff010160e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7f6452200640 1 -- 172.21.15.78:0/3649689310 >> [v2:172.21.15.84:6803/4084754024,v1:172.21.15.84:6805/4084754024] conn(0x7f642c06fc00 msgr2=0x7f642c072050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7fe302000640 1 -- 172.21.15.78:0/4040807232 >> [v2:172.21.15.84:6800/2776653794,v1:172.21.15.84:6801/2776653794] conn(0x7fe2ec06fb60 msgr2=0x7fe2ec071fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7f6452200640 1 --2- 172.21.15.78:0/3649689310 >> [v2:172.21.15.84:6803/4084754024,v1:172.21.15.84:6805/4084754024] conn(0x7f642c06fc00 0x7f642c072050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7fe302000640 1 --2- 172.21.15.78:0/4040807232 >> [v2:172.21.15.84:6800/2776653794,v1:172.21.15.84:6801/2776653794] conn(0x7fe2ec06fb60 0x7fe2ec071fb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7fe302000640 1 -- 172.21.15.78:0/4040807232 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe2ec067910 msgr2=0x7fe2ec069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7fe302000640 1 --2- 172.21.15.78:0/4040807232 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe2ec067910 0x7fe2ec069e20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8006fd0 tx=0x7fe2f8008040 comp rx=0 tx=0).stop 2024-05-21T14:43:27.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7fe302000640 1 -- 172.21.15.78:0/4040807232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe30c0c7110 msgr2=0x7fe30c146aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7fe302000640 1 --2- 172.21.15.78:0/4040807232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe30c0c7110 0x7fe30c146aa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe30400b3e0 tx=0x7fe30400b8a0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7fe311c00640 1 -- 172.21.15.78:0/4040807232 reap_dead start 2024-05-21T14:43:27.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7f6452200640 1 -- 172.21.15.78:0/3649689310 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f642c067990 msgr2=0x7f642c069ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7f6452200640 1 --2- 172.21.15.78:0/3649689310 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f642c067990 0x7f642c069ea0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f643c007fd0 tx=0x7f643c007900 comp rx=0 tx=0).stop 2024-05-21T14:43:27.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7f6452200640 1 -- 172.21.15.78:0/3649689310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f644c151ce0 msgr2=0x7f644c0cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7f6452200640 1 --2- 172.21.15.78:0/3649689310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f644c151ce0 0x7f644c0cb650 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6444007df0 tx=0x7f644400d4a0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7f364a000640 1 -- 172.21.15.78:0/575004651 <== osd.2 v2:172.21.15.78:6808/68473545 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f365015b180 con 0x7f363406fb40 2024-05-21T14:43:27.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7fe302000640 1 -- 172.21.15.78:0/4040807232 shutdown_connections 2024-05-21T14:43:27.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7fe302000640 1 -- 172.21.15.78:0/4040807232 >> 172.21.15.78:0/4040807232 conn(0x7fe30c06f520 msgr2=0x7fe30c0cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7fe302000640 1 -- 172.21.15.78:0/4040807232 shutdown_connections 2024-05-21T14:43:27.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7fe302000640 1 -- 172.21.15.78:0/4040807232 wait complete. 2024-05-21T14:43:27.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.645+0000 7f644be00640 1 -- 172.21.15.78:0/3649689310 reap_dead start 2024-05-21T14:43:27.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7f6452200640 1 -- 172.21.15.78:0/3649689310 shutdown_connections 2024-05-21T14:43:27.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7f6452200640 1 -- 172.21.15.78:0/3649689310 >> 172.21.15.78:0/3649689310 conn(0x7f644c0cd1e0 msgr2=0x7f644c0c4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7f3658800640 1 -- 172.21.15.78:0/575004651 >> [v2:172.21.15.78:6808/68473545,v1:172.21.15.78:6810/68473545] conn(0x7f363406fb40 msgr2=0x7f3634071f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7f3658800640 1 --2- 172.21.15.78:0/575004651 >> [v2:172.21.15.78:6808/68473545,v1:172.21.15.78:6810/68473545] conn(0x7f363406fb40 0x7f3634071f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7fb13b200640 1 -- 172.21.15.78:0/1109060844 --> [v2:172.21.15.84:6824/3186857851,v1:172.21.15.84:6825/3186857851] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb13c075710 con 0x7fb11c06fb10 2024-05-21T14:43:27.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7f3658800640 1 -- 172.21.15.78:0/575004651 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f36340678f0 msgr2=0x7f3634069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7f3658800640 1 --2- 172.21.15.78:0/575004651 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f36340678f0 0x7f3634069e00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f36440b0000 tx=0x7f3644009040 comp rx=0 tx=0).stop 2024-05-21T14:43:27.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7f6452200640 1 -- 172.21.15.78:0/3649689310 shutdown_connections 2024-05-21T14:43:27.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7f3658800640 1 -- 172.21.15.78:0/575004651 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36500717e0 msgr2=0x7f36500c5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7f3658800640 1 --2- 172.21.15.78:0/575004651 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36500717e0 0x7f36500c5680 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f364000d5d0 tx=0x7f364000da90 comp rx=0 tx=0).stop 2024-05-21T14:43:27.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7ff014e00640 1 -- 172.21.15.78:0/3846963053 shutdown_connections 2024-05-21T14:43:27.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7ff014e00640 1 -- 172.21.15.78:0/3846963053 wait complete. 2024-05-21T14:43:27.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7f6452200640 1 -- 172.21.15.78:0/3649689310 wait complete. 2024-05-21T14:43:27.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7f3656800640 1 -- 172.21.15.78:0/575004651 reap_dead start 2024-05-21T14:43:27.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7f3658800640 1 -- 172.21.15.78:0/575004651 shutdown_connections 2024-05-21T14:43:27.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7f3658800640 1 -- 172.21.15.78:0/575004651 >> 172.21.15.78:0/575004651 conn(0x7f36500cd1e0 msgr2=0x7f365006ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7f3658800640 1 -- 172.21.15.78:0/575004651 shutdown_connections 2024-05-21T14:43:27.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7fb132000640 1 -- 172.21.15.78:0/1109060844 <== osd.5 v2:172.21.15.84:6824/3186857851 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb13c075710 con 0x7fb11c06fb10 2024-05-21T14:43:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7fb13b200640 1 -- 172.21.15.78:0/1109060844 >> [v2:172.21.15.84:6824/3186857851,v1:172.21.15.84:6825/3186857851] conn(0x7fb11c06fb10 msgr2=0x7fb11c071f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7fb13b200640 1 --2- 172.21.15.78:0/1109060844 >> [v2:172.21.15.84:6824/3186857851,v1:172.21.15.84:6825/3186857851] conn(0x7fb11c06fb10 0x7fb11c071f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7fb13b200640 1 -- 172.21.15.78:0/1109060844 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb11c0678c0 msgr2=0x7fb11c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7fb13b200640 1 --2- 172.21.15.78:0/1109060844 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb11c0678c0 0x7fb11c069dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb128009cc0 tx=0x7fb128006f90 comp rx=0 tx=0).stop 2024-05-21T14:43:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7fb13b200640 1 -- 172.21.15.78:0/1109060844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb13c0c8160 msgr2=0x7fb13c1f9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7fb13b200640 1 --2- 172.21.15.78:0/1109060844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb13c0c8160 0x7fb13c1f9c00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb134009cf0 tx=0x7fb13400c490 comp rx=0 tx=0).stop 2024-05-21T14:43:27.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.649+0000 7fb13a800640 1 -- 172.21.15.78:0/1109060844 reap_dead start 2024-05-21T14:43:27.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.653+0000 7fb13b200640 1 -- 172.21.15.78:0/1109060844 shutdown_connections 2024-05-21T14:43:27.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.653+0000 7fb13b200640 1 -- 172.21.15.78:0/1109060844 >> 172.21.15.78:0/1109060844 conn(0x7fb13c06f520 msgr2=0x7fb13c071790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.653+0000 7fb13b200640 1 -- 172.21.15.78:0/1109060844 shutdown_connections 2024-05-21T14:43:27.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.653+0000 7fb13b200640 1 -- 172.21.15.78:0/1109060844 wait complete. 2024-05-21T14:43:27.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.653+0000 7f3658800640 1 -- 172.21.15.78:0/575004651 wait complete. 2024-05-21T14:43:27.684 INFO:teuthology.orchestra.run.smithi078.stdout:64424509447 2024-05-21T14:43:27.684 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-21T14:43:27.689 INFO:teuthology.orchestra.run.smithi078.stdout:64424509446 2024-05-21T14:43:27.689 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-21T14:43:27.693 INFO:teuthology.orchestra.run.smithi078.stdout:64424509446 2024-05-21T14:43:27.694 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-21T14:43:27.697 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2024-05-21T14:43:27.697 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-21T14:43:27.701 INFO:teuthology.orchestra.run.smithi078.stdout:64424509446 2024-05-21T14:43:27.701 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-21T14:43:27.702 INFO:teuthology.orchestra.run.smithi078.stdout:64424509447 2024-05-21T14:43:27.702 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-21T14:43:27.703 INFO:teuthology.orchestra.run.smithi078.stdout:64424509447 2024-05-21T14:43:27.704 INFO:teuthology.orchestra.run.smithi078.stdout:64424509447 2024-05-21T14:43:27.704 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-21T14:43:27.704 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-21T14:43:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.937+0000 7f3d4da00640 1 Processor -- start 2024-05-21T14:43:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.941+0000 7f3d4da00640 1 -- start start 2024-05-21T14:43:27.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.941+0000 7f3d4da00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3d4004c000 0x7f3d400df110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.941+0000 7f3d4da00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d4004ba50 0x7f3d40006450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.941+0000 7f3d47e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3d4004c000 0x7f3d400df110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.941+0000 7f3d47400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d4004ba50 0x7f3d40006450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.945+0000 7f3d47400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d4004ba50 0x7f3d40006450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:54858/0 (socket says 172.21.15.78:54858) 2024-05-21T14:43:27.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.945+0000 7f3d47e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3d4004c000 0x7f3d400df110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:42722/0 (socket says 172.21.15.78:42722) 2024-05-21T14:43:27.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.945+0000 7f3d4d000640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3d400334f0 0x7f3d400db3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57454/0 (socket says 172.21.15.78:57454) 2024-05-21T14:43:27.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.945+0000 7f3d47400640 1 -- 172.21.15.78:0/1295871791 learned_addr learned my addr 172.21.15.78:0/1295871791 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:27.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.945+0000 7f3d4da00640 1 -- 172.21.15.78:0/1295871791 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d4004c510 con 0x7f3d400334f0 2024-05-21T14:43:27.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.945+0000 7f3d46a00640 1 -- 172.21.15.78:0/1295871791 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3538983937 0 0) 0x7f3d4004c510 con 0x7f3d400334f0 2024-05-21T14:43:27.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.945+0000 7f3d4da00640 1 -- 172.21.15.78:0/1295871791 --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f3d400de930 con 0x7f3d4004c000 2024-05-21T14:43:27.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.945+0000 7f3d4da00640 1 -- 172.21.15.78:0/1295871791 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f3d400351a0 con 0x7f3d4004ba50 2024-05-21T14:43:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.945+0000 7f3d46a00640 1 -- 172.21.15.78:0/1295871791 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d30003530 con 0x7f3d400334f0 2024-05-21T14:43:27.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.949+0000 7f3d47e00640 1 -- 172.21.15.78:0/1295871791 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d4004ba50 msgr2=0x7f3d40006450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.949+0000 7f3d47e00640 1 --2- 172.21.15.78:0/1295871791 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d4004ba50 0x7f3d40006450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.949+0000 7f3d47e00640 1 -- 172.21.15.78:0/1295871791 >> v1:172.21.15.78:6789/0 conn(0x7f3d400334f0 legacy=0x7f3d400db3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.949+0000 7f3d47e00640 1 -- 172.21.15.78:0/1295871791 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d40035480 con 0x7f3d4004c000 2024-05-21T14:43:27.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.949+0000 7f3d47400640 1 --2- 172.21.15.78:0/1295871791 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d4004ba50 0x7f3d40006450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:43:27.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.953+0000 7f3d47e00640 1 --2- 172.21.15.78:0/1295871791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4004c000 0x7f3d400df110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3d4806b040 tx=0x7f3d48098eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c442ba5ae0aff0b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.953+0000 7f3d46a00640 1 -- 172.21.15.78:0/1295871791 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4812e070 con 0x7f3d4004c000 2024-05-21T14:43:27.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.953+0000 7f3d46a00640 1 -- 172.21.15.78:0/1295871791 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d48121a40 con 0x7f3d4004c000 2024-05-21T14:43:27.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.953+0000 7f3d46a00640 1 -- 172.21.15.78:0/1295871791 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4812e070 con 0x7f3d4004c000 2024-05-21T14:43:27.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.953+0000 7f3d4da00640 1 -- 172.21.15.78:0/1295871791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4004c000 msgr2=0x7f3d400df110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.953+0000 7f3d4da00640 1 --2- 172.21.15.78:0/1295871791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4004c000 0x7f3d400df110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3d4806b040 tx=0x7f3d48098eb0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.953+0000 7f3d4da00640 1 -- 172.21.15.78:0/1295871791 shutdown_connections 2024-05-21T14:43:27.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.953+0000 7f3d4da00640 1 --2- 172.21.15.78:0/1295871791 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d4004ba50 0x7f3d40006450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.953+0000 7f3d4da00640 1 --2- 172.21.15.78:0/1295871791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4004c000 0x7f3d400df110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.953+0000 7f3d4da00640 1 -- 172.21.15.78:0/1295871791 >> 172.21.15.78:0/1295871791 conn(0x7f3d400503c0 msgr2=0x7f3d400507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.953+0000 7fe3f9c00640 1 Processor -- start 2024-05-21T14:43:27.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.957+0000 7f3d4da00640 1 -- 172.21.15.78:0/1295871791 shutdown_connections 2024-05-21T14:43:27.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.957+0000 7f3d4da00640 1 -- 172.21.15.78:0/1295871791 wait complete. 2024-05-21T14:43:27.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.957+0000 7fe3f9c00640 1 -- start start 2024-05-21T14:43:27.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.957+0000 7fe3f9c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe3f415d3b0 0x7fe3f40c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.957+0000 7fe3f9c00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3f40ca4a0 0x7fe3f40ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.957+0000 7fe3f9c00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3f40c9380 con 0x7fe3f415fe20 2024-05-21T14:43:27.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.957+0000 7fe3f9c00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fe3f40c9c70 con 0x7fe3f40ca4a0 2024-05-21T14:43:27.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.957+0000 7fe3f9c00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe3f4160a20 con 0x7fe3f415d3b0 2024-05-21T14:43:27.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.957+0000 7fe3f2000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3f40ca4a0 0x7fe3f40ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.957+0000 7fe3f2000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3f40ca4a0 0x7fe3f40ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38320/0 (socket says 172.21.15.78:38320) 2024-05-21T14:43:27.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.957+0000 7fe3f2000640 1 -- 172.21.15.78:0/1161647388 learned_addr learned my addr 172.21.15.78:0/1161647388 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:27.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.961+0000 7fe3f2000640 1 -- 172.21.15.78:0/1161647388 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe3f415d3b0 msgr2=0x7fe3f40c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.961+0000 7fe3f2000640 1 --2- 172.21.15.78:0/1161647388 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe3f415d3b0 0x7fe3f40c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.961+0000 7fe3f2000640 1 -- 172.21.15.78:0/1161647388 >> v1:172.21.15.84:6789/0 conn(0x7fe3f415fe20 legacy=0x7fe3f4160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.961+0000 7f3d4da00640 1 Processor -- start 2024-05-21T14:43:27.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.961+0000 7fe3f2000640 1 -- 172.21.15.78:0/1161647388 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f40c9620 con 0x7fe3f40ca4a0 2024-05-21T14:43:27.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.961+0000 7f3d4da00640 1 -- start start 2024-05-21T14:43:27.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.961+0000 7f3d4da00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d400334f0 0x7f3d4017f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.961+0000 7f3d4da00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d4004ba50 0x7f3d400d7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.961+0000 7f3d4da00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4004c000 0x7f3d400d67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.961+0000 7f3d4da00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4004c800 con 0x7f3d400334f0 2024-05-21T14:43:27.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.961+0000 7efe65000640 1 Processor -- start 2024-05-21T14:43:27.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d4da00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4004ad40 con 0x7f3d4004c000 2024-05-21T14:43:27.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d4da00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4004c980 con 0x7f3d4004ba50 2024-05-21T14:43:27.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7efe65000640 1 -- start start 2024-05-21T14:43:27.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7faa36200640 1 Processor -- start 2024-05-21T14:43:27.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7fad10000640 1 Processor -- start 2024-05-21T14:43:27.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d47400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d4004ba50 0x7f3d400d7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d47400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d4004ba50 0x7f3d400d7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:54888/0 (socket says 172.21.15.78:54888) 2024-05-21T14:43:27.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d47400640 1 -- 172.21.15.78:0/2972081187 learned_addr learned my addr 172.21.15.78:0/2972081187 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:27.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d47e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d400334f0 0x7f3d4017f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7fad10000640 1 -- start start 2024-05-21T14:43:27.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d4d000640 1 --2- 172.21.15.78:0/2972081187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4004c000 0x7f3d400d67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d47e00640 1 -- 172.21.15.78:0/2972081187 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d4004ba50 msgr2=0x7f3d400d7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d47e00640 1 --2- 172.21.15.78:0/2972081187 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d4004ba50 0x7f3d400d7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d47e00640 1 -- 172.21.15.78:0/2972081187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4004c000 msgr2=0x7f3d400d67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d47e00640 1 --2- 172.21.15.78:0/2972081187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4004c000 0x7f3d400d67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d47e00640 1 -- 172.21.15.78:0/2972081187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4017fb80 con 0x7f3d400334f0 2024-05-21T14:43:27.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d4d000640 1 --2- 172.21.15.78:0/2972081187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4004c000 0x7f3d400d67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:43:27.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d47e00640 1 --2- 172.21.15.78:0/2972081187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d400334f0 0x7f3d4017f640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3d48076e80 tx=0x7f3d48095cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d3be00640 1 -- 172.21.15.78:0/2972081187 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4812e050 con 0x7f3d400334f0 2024-05-21T14:43:27.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d4da00640 1 -- 172.21.15.78:0/2972081187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d400d2b90 con 0x7f3d400334f0 2024-05-21T14:43:27.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d4da00640 1 -- 172.21.15.78:0/2972081187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d400d28b0 con 0x7f3d400334f0 2024-05-21T14:43:27.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d3be00640 1 -- 172.21.15.78:0/2972081187 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4813a070 con 0x7f3d400334f0 2024-05-21T14:43:27.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7efe65000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe600c82d0 0x7efe600c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7efe65000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efe60072e50 0x7efe60073260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7f3d3be00640 1 -- 172.21.15.78:0/2972081187 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4812e050 con 0x7f3d400334f0 2024-05-21T14:43:27.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7faa36200640 1 -- start start 2024-05-21T14:43:27.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7efe5de00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efe60151ce0 0x7efe600713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57466/0 (socket says 172.21.15.78:57466) 2024-05-21T14:43:27.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7efe5de00640 1 -- 172.21.15.78:0/2855011882 learned_addr learned my addr 172.21.15.78:0/2855011882 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:27.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7efe5d400640 1 --2- 172.21.15.78:0/2855011882 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe600c82d0 0x7efe600c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.965+0000 7faa36200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faa30151ce0 0x7faa300713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7f5f3c400640 1 Processor -- start 2024-05-21T14:43:27.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7f3d4da00640 1 -- 172.21.15.78:0/2972081187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d240052a0 con 0x7f3d400334f0 2024-05-21T14:43:27.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7f5f3c400640 1 -- start start 2024-05-21T14:43:27.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7faa36200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa30073560 0x7faa300c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7faa36200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa300c3750 con 0x7faa300c82d0 2024-05-21T14:43:27.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7faa36200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7faa30072830 con 0x7faa30151ce0 2024-05-21T14:43:27.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7faa36200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7faa30071f00 con 0x7faa30073560 2024-05-21T14:43:27.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7fad10000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad08073560 0x7fad080c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7fad10000640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad08071ae0 con 0x7fad080c82d0 2024-05-21T14:43:27.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7fad10000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad080c3750 con 0x7fad08151ce0 2024-05-21T14:43:27.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7fad10000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fad08072830 con 0x7fad08073560 2024-05-21T14:43:27.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7faa2ea00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faa300c82d0 0x7faa30072e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.78:34686/0 (socket says 172.21.15.78:34686) 2024-05-21T14:43:27.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7faa2ea00640 1 -- 172.21.15.78:0/4271599796 learned_addr learned my addr 172.21.15.78:0/4271599796 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:27.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7faa2fe00640 1 --2- 172.21.15.78:0/4271599796 >> v2:172.21.15.84:3300/0 conn(0x7faa30073560 0x7faa300c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7fad0d600640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fad08151ce0 0x7fad080713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.78:34700/0 (socket says 172.21.15.78:34700) 2024-05-21T14:43:27.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7fad0d600640 1 -- 172.21.15.78:0/3062791771 learned_addr learned my addr 172.21.15.78:0/3062791771 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:27.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7fad0e000640 1 --2- 172.21.15.78:0/3062791771 >> v2:172.21.15.84:3300/0 conn(0x7fad08073560 0x7fad080c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7fe3f2000640 1 --2- 172.21.15.78:0/1161647388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f40ca4a0 0x7fe3f40ca8b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009870 tx=0x7fe3e001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9216d87feb667665 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7efe5e800640 1 --2- 172.21.15.78:0/2855011882 >> v2:172.21.15.78:3300/0 conn(0x7efe60072e50 0x7efe60073260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7efe65000640 1 -- 172.21.15.78:0/2855011882 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe60071ae0 con 0x7efe60151ce0 2024-05-21T14:43:27.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7efe65000640 1 -- 172.21.15.78:0/2855011882 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7efe60072830 con 0x7efe60072e50 2024-05-21T14:43:27.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7efe65000640 1 -- 172.21.15.78:0/2855011882 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7efe600c3750 con 0x7efe600c82d0 2024-05-21T14:43:27.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7efe5e800640 1 -- 172.21.15.78:0/2855011882 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe600c82d0 msgr2=0x7efe600c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7efe5e800640 1 --2- 172.21.15.78:0/2855011882 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe600c82d0 0x7efe600c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7efe5e800640 1 -- 172.21.15.78:0/2855011882 >> v1:172.21.15.78:6789/0 conn(0x7efe60151ce0 legacy=0x7efe600713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7efe5e800640 1 -- 172.21.15.78:0/2855011882 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe60071f00 con 0x7efe60072e50 2024-05-21T14:43:27.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7faa2fe00640 1 -- 172.21.15.78:0/4271599796 >> v2:172.21.15.78:3300/0 conn(0x7faa30151ce0 msgr2=0x7faa300713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7faa2fe00640 1 --2- 172.21.15.78:0/4271599796 >> v2:172.21.15.78:3300/0 conn(0x7faa30151ce0 0x7faa300713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7faa2fe00640 1 -- 172.21.15.78:0/4271599796 >> v1:172.21.15.84:6789/0 conn(0x7faa300c82d0 legacy=0x7faa30072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7faa2fe00640 1 -- 172.21.15.78:0/4271599796 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa300721e0 con 0x7faa30073560 2024-05-21T14:43:27.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7fad07e00640 1 -- 172.21.15.78:0/3062791771 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1714028791 0 0) 0x7fad080c3750 con 0x7fad08151ce0 2024-05-21T14:43:27.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7f70b2200640 1 Processor -- start 2024-05-21T14:43:27.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7fad07e00640 1 -- 172.21.15.78:0/3062791771 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facf0003530 con 0x7fad08151ce0 2024-05-21T14:43:27.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7fad0e000640 1 -- 172.21.15.78:0/3062791771 >> v1:172.21.15.84:6789/0 conn(0x7fad08151ce0 legacy=0x7fad080713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7f8506000640 1 Processor -- start 2024-05-21T14:43:27.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7fad0e000640 1 -- 172.21.15.78:0/3062791771 >> v1:172.21.15.78:6789/0 conn(0x7fad080c82d0 legacy=0x7fad08072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7fad0e000640 1 -- 172.21.15.78:0/3062791771 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad08071f00 con 0x7fad08073560 2024-05-21T14:43:27.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7f8506000640 1 -- start start 2024-05-21T14:43:27.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7f70b2200640 1 -- start start 2024-05-21T14:43:27.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7f3d3be00640 1 -- 172.21.15.78:0/2972081187 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3d481218c0 con 0x7f3d400334f0 2024-05-21T14:43:27.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.969+0000 7fe3f1600640 1 -- 172.21.15.78:0/1161647388 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00b5070 con 0x7fe3f40ca4a0 2024-05-21T14:43:27.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f3d3be00640 1 --2- 172.21.15.78:0/2972081187 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f3d28067cf0 0x7f3d2806a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f3d3be00640 1 -- 172.21.15.78:0/2972081187 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3d48129a70 con 0x7f3d400334f0 2024-05-21T14:43:27.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7fe3f1600640 1 -- 172.21.15.78:0/1161647388 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e00a89d0 con 0x7fe3f40ca4a0 2024-05-21T14:43:27.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7fe3f1600640 1 -- 172.21.15.78:0/1161647388 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00b5070 con 0x7fe3f40ca4a0 2024-05-21T14:43:27.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f8506000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8500153960 0x7f850006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f70b2200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f70ac06b8b0 0x7f70ac0c5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f84fea00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8500153960 0x7f850006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f84ffe00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f850006e010 0x7f85000c8150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57478/0 (socket says 172.21.15.78:57478) 2024-05-21T14:43:27.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f84ffe00640 1 -- 172.21.15.78:0/252291224 learned_addr learned my addr 172.21.15.78:0/252291224 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:27.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f8506000640 1 -- 172.21.15.78:0/252291224 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8500159d60 con 0x7f850006e010 2024-05-21T14:43:27.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f8506000640 1 -- 172.21.15.78:0/252291224 --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f850015a040 con 0x7f8500159740 2024-05-21T14:43:27.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f8506000640 1 -- 172.21.15.78:0/252291224 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f85000c7cc0 con 0x7f8500153960 2024-05-21T14:43:27.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f3d47400640 1 --2- 172.21.15.78:0/2972081187 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f3d28067cf0 0x7f3d2806a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7faa2fe00640 1 --2- 172.21.15.78:0/4271599796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa30073560 0x7faa300c86e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faa300729b0 tx=0x7faa2801ea30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6cf742f606e5ae1 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7fe3f9c00640 1 -- 172.21.15.78:0/1161647388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f40ca4a0 msgr2=0x7fe3f40ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7fe3f9c00640 1 --2- 172.21.15.78:0/1161647388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f40ca4a0 0x7fe3f40ca8b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009870 tx=0x7fe3e001ed10 comp rx=0 tx=0).stop 2024-05-21T14:43:27.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7efe5e800640 1 --2- 172.21.15.78:0/2855011882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe60072e50 0x7efe60073260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efe58009d90 tx=0x7efe5801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463a8ba44262980a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f84fea00640 1 -- 172.21.15.78:0/252291224 >> v1:172.21.15.84:6789/0 conn(0x7f8500159740 legacy=0x7f85000ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f84fea00640 1 -- 172.21.15.78:0/252291224 >> v1:172.21.15.78:6789/0 conn(0x7f850006e010 legacy=0x7f85000c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f84fea00640 1 -- 172.21.15.78:0/252291224 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850015a320 con 0x7f8500153960 2024-05-21T14:43:27.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7fe3f9c00640 1 -- 172.21.15.78:0/1161647388 shutdown_connections 2024-05-21T14:43:27.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7fe3f9c00640 1 --2- 172.21.15.78:0/1161647388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f40ca4a0 0x7fe3f40ca8b0 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009870 tx=0x7fe3e001ed10 comp rx=0 tx=0).stop 2024-05-21T14:43:27.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7fe3f9c00640 1 --2- 172.21.15.78:0/1161647388 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe3f415d3b0 0x7fe3f40c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7fe3f9c00640 1 -- 172.21.15.78:0/1161647388 >> 172.21.15.78:0/1161647388 conn(0x7fe3f40cb4e0 msgr2=0x7fe3f40cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f70b2200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f70ac0c7a60 0x7f70ac16a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f70b2200640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70ac15fc70 con 0x7f70ac0c5ca0 2024-05-21T14:43:27.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f70b2200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f70ac0c60b0 con 0x7f70ac06b8b0 2024-05-21T14:43:27.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f70b2200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f70ac15fef0 con 0x7f70ac0c7a60 2024-05-21T14:43:27.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7fad0e000640 1 --2- 172.21.15.78:0/3062791771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad08073560 0x7fad080c86e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad080729b0 tx=0x7fad0001c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d04288983f37a41 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7fe3f9c00640 1 -- 172.21.15.78:0/1161647388 shutdown_connections 2024-05-21T14:43:27.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f70aaa00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f70ac0c5ca0 0x7f70ac0c7350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57480/0 (socket says 172.21.15.78:57480) 2024-05-21T14:43:27.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7f70aaa00640 1 -- 172.21.15.78:0/3786891579 learned_addr learned my addr 172.21.15.78:0/3786891579 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:27.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f3d47400640 1 --2- 172.21.15.78:0/2972081187 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f3d28067cf0 0x7f3d2806a200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3d40050880 tx=0x7f3d3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:27.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7fad07e00640 1 -- 172.21.15.78:0/3062791771 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad000b2070 con 0x7fad08073560 2024-05-21T14:43:27.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7fad07e00640 1 -- 172.21.15.78:0/3062791771 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad000a5710 con 0x7fad08073560 2024-05-21T14:43:27.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7fad07e00640 1 -- 172.21.15.78:0/3062791771 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad000a5ae0 con 0x7fad08073560 2024-05-21T14:43:27.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f3c400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5f340c5c30 0x7f5f341538d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f3c400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5f340c6540 0x7f5f340735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:27.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.973+0000 7fe3f9c00640 1 -- 172.21.15.78:0/1161647388 wait complete. 2024-05-21T14:43:27.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7faa2e000640 1 -- 172.21.15.78:0/4271599796 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa280ad070 con 0x7faa30073560 2024-05-21T14:43:27.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7faa2e000640 1 -- 172.21.15.78:0/4271599796 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa280a7900 con 0x7faa30073560 2024-05-21T14:43:27.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f70ab400640 1 --2- 172.21.15.78:0/3786891579 >> v2:172.21.15.78:3300/0 conn(0x7f70ac06b8b0 0x7f70ac0c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f3c400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f340c7240 con 0x7f5f340c7f90 2024-05-21T14:43:27.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f70ab400640 1 -- 172.21.15.78:0/3786891579 >> v2:172.21.15.84:3300/0 conn(0x7f70ac0c7a60 msgr2=0x7f70ac16a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f70ab400640 1 --2- 172.21.15.78:0/3786891579 >> v2:172.21.15.84:3300/0 conn(0x7f70ac0c7a60 0x7f70ac16a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f70ab400640 1 -- 172.21.15.78:0/3786891579 >> v1:172.21.15.78:6789/0 conn(0x7f70ac0c5ca0 legacy=0x7f70ac0c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f70ab400640 1 -- 172.21.15.78:0/3786891579 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ac1601d0 con 0x7f70ac06b8b0 2024-05-21T14:43:27.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f3c400640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f5f34153e10 con 0x7f5f340c6540 2024-05-21T14:43:27.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f39000640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5f340c7f90 0x7f5f3415cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.78:34720/0 (socket says 172.21.15.78:34720) 2024-05-21T14:43:27.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f39000640 1 -- 172.21.15.78:0/4197173345 learned_addr learned my addr 172.21.15.78:0/4197173345 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:27.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f3c400640 1 -- 172.21.15.78:0/4197173345 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f5f340c4370 con 0x7f5f340c5c30 2024-05-21T14:43:27.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7faa2e000640 1 -- 172.21.15.78:0/4271599796 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa280a7cd0 con 0x7faa30073560 2024-05-21T14:43:27.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7fad10000640 1 -- 172.21.15.78:0/3062791771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad08073560 msgr2=0x7fad080c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7fad10000640 1 --2- 172.21.15.78:0/3062791771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad08073560 0x7fad080c86e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad080729b0 tx=0x7fad0001c850 comp rx=0 tx=0).stop 2024-05-21T14:43:27.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7faa36200640 1 -- 172.21.15.78:0/4271599796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa30073560 msgr2=0x7faa300c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:27.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7faa36200640 1 --2- 172.21.15.78:0/4271599796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa30073560 0x7faa300c86e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faa300729b0 tx=0x7faa2801ea30 comp rx=0 tx=0).stop 2024-05-21T14:43:27.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7faa36200640 1 -- 172.21.15.78:0/4271599796 shutdown_connections 2024-05-21T14:43:27.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7faa36200640 1 --2- 172.21.15.78:0/4271599796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa30073560 0x7faa300c86e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7faa36200640 1 --2- 172.21.15.78:0/4271599796 >> v2:172.21.15.78:3300/0 conn(0x7faa30151ce0 0x7faa300713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7faa36200640 1 -- 172.21.15.78:0/4271599796 >> 172.21.15.78:0/4271599796 conn(0x7faa300cd1e0 msgr2=0x7faa300c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7fad10000640 1 -- 172.21.15.78:0/3062791771 shutdown_connections 2024-05-21T14:43:27.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7fad10000640 1 --2- 172.21.15.78:0/3062791771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad08073560 0x7fad080c86e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7fad10000640 1 -- 172.21.15.78:0/3062791771 >> 172.21.15.78:0/3062791771 conn(0x7fad080cd1e0 msgr2=0x7fad080c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:27.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7fad10000640 1 -- 172.21.15.78:0/3062791771 shutdown_connections 2024-05-21T14:43:27.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f33e00640 1 -- 172.21.15.78:0/4197173345 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2805857021 0 0) 0x7f5f340c7240 con 0x7f5f340c7f90 2024-05-21T14:43:27.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f39a00640 1 --2- 172.21.15.78:0/4197173345 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5f340c5c30 0x7f5f341538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f33e00640 1 -- 172.21.15.78:0/4197173345 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f1c003530 con 0x7f5f340c7f90 2024-05-21T14:43:27.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f3a400640 1 --2- 172.21.15.78:0/4197173345 >> v2:172.21.15.78:3300/0 conn(0x7f5f340c6540 0x7f5f340735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:27.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7fad10000640 1 -- 172.21.15.78:0/3062791771 wait complete. 2024-05-21T14:43:27.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7faa36200640 1 -- 172.21.15.78:0/4271599796 shutdown_connections 2024-05-21T14:43:27.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f33e00640 1 -- 172.21.15.78:0/4197173345 <== mon.1 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3695474926 0 0) 0x7f5f1c003530 con 0x7f5f340c7f90 2024-05-21T14:43:27.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f33e00640 1 -- 172.21.15.78:0/4197173345 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5f340c5c30 msgr2=0x7f5f341538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f33e00640 1 --2- 172.21.15.78:0/4197173345 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5f340c5c30 0x7f5f341538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f33e00640 1 -- 172.21.15.78:0/4197173345 >> v2:172.21.15.78:3300/0 conn(0x7f5f340c6540 msgr2=0x7f5f340735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:27.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f33e00640 1 --2- 172.21.15.78:0/4197173345 >> v2:172.21.15.78:3300/0 conn(0x7f5f340c6540 0x7f5f340735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:27.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f33e00640 1 -- 172.21.15.78:0/4197173345 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f340c74e0 con 0x7f5f340c7f90 2024-05-21T14:43:27.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f3a400640 1 --2- 172.21.15.78:0/4197173345 >> v2:172.21.15.78:3300/0 conn(0x7f5f340c6540 0x7f5f340735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:43:27.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f33e00640 1 -- 172.21.15.78:0/4197173345 <== mon.1 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7f5f200016a0 con 0x7f5f340c7f90 2024-05-21T14:43:27.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f33e00640 1 -- 172.21.15.78:0/4197173345 >> v1:172.21.15.84:6789/0 conn(0x7f5f340c7f90 legacy=0x7f5f3415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f33e00640 1 --2- 172.21.15.78:0/4197173345 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5f340c5c30 0x7f5f1c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f33e00640 1 --2- 172.21.15.78:0/4197173345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f1c004000 0x7f5f1c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f33e00640 1 --2- 172.21.15.78:0/4197173345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1c004d50 0x7f5f1c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f33e00640 1 -- 172.21.15.78:0/4197173345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5f34153e10 con 0x7f5f1c004d50 2024-05-21T14:43:28.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f33e00640 1 -- 172.21.15.78:0/4197173345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5f340c4370 con 0x7f5f1c004000 2024-05-21T14:43:28.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7f5f33e00640 1 -- 172.21.15.78:0/4197173345 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f5f1c00ff10 con 0x7f5f340c5c30 2024-05-21T14:43:28.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7faa36200640 1 -- 172.21.15.78:0/4271599796 wait complete. 2024-05-21T14:43:28.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.977+0000 7fe3f9c00640 1 Processor -- start 2024-05-21T14:43:28.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f5f39a00640 1 --2- 172.21.15.78:0/4197173345 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5f340c5c30 0x7f5f1c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f5f39000640 1 --2- 172.21.15.78:0/4197173345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f1c004000 0x7f5f1c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f5f3a400640 1 --2- 172.21.15.78:0/4197173345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1c004d50 0x7f5f1c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fe3f9c00640 1 -- start start 2024-05-21T14:43:28.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fad10000640 1 Processor -- start 2024-05-21T14:43:28.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f84fea00640 1 --2- 172.21.15.78:0/252291224 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8500153960 0x7f850006dad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f84ec0097f0 tx=0x7f84ec01ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bc9a5c97820c95f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:28.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f5f3a400640 1 -- 172.21.15.78:0/4197173345 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5f340c5c30 msgr2=0x7f5f1c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:28.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f5f3a400640 1 --2- 172.21.15.78:0/4197173345 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5f340c5c30 0x7f5f1c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f5f3a400640 1 -- 172.21.15.78:0/4197173345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f1c004000 msgr2=0x7f5f1c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:28.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f5f3a400640 1 --2- 172.21.15.78:0/4197173345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f1c004000 0x7f5f1c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f5f3a400640 1 -- 172.21.15.78:0/4197173345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1c003530 con 0x7f5f1c004d50 2024-05-21T14:43:28.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fad10000640 1 -- start start 2024-05-21T14:43:28.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7efe5ca00640 1 -- 172.21.15.78:0/2855011882 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe580b2070 con 0x7efe60072e50 2024-05-21T14:43:28.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f84fe000640 1 -- 172.21.15.78:0/252291224 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ec0b5070 con 0x7f8500153960 2024-05-21T14:43:28.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f84fe000640 1 -- 172.21.15.78:0/252291224 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84ec0a89d0 con 0x7f8500153960 2024-05-21T14:43:28.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f84fe000640 1 -- 172.21.15.78:0/252291224 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ec0a8da0 con 0x7f8500153960 2024-05-21T14:43:28.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7efe5ca00640 1 -- 172.21.15.78:0/2855011882 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe580a5830 con 0x7efe60072e50 2024-05-21T14:43:28.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f70ab400640 1 --2- 172.21.15.78:0/3786891579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70ac06b8b0 0x7f70ac0c5760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0c3350 tx=0x7f709801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac1e78375869a34 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:28.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f8506000640 1 -- 172.21.15.78:0/252291224 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8500153960 msgr2=0x7f850006dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f8506000640 1 --2- 172.21.15.78:0/252291224 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8500153960 0x7f850006dad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f84ec0097f0 tx=0x7f84ec01ecd0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fe3f9c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3f415d3b0 0x7fe3f414ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fe3f9c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe3f415fe20 0x7fe3f4145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fe3f9c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f413f920 0x7fe3f415dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fe3f9c00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f415d7c0 con 0x7fe3f413f920 2024-05-21T14:43:28.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fe3f9c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f4160d00 con 0x7fe3f415d3b0 2024-05-21T14:43:28.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fe3f9c00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe3f40ca100 con 0x7fe3f415fe20 2024-05-21T14:43:28.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fe3f2000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe3f415fe20 0x7fe3f4145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fe3f2000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe3f415fe20 0x7fe3f4145350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:54942/0 (socket says 172.21.15.78:54942) 2024-05-21T14:43:28.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fe3f2000640 1 -- 172.21.15.78:0/233500550 learned_addr learned my addr 172.21.15.78:0/233500550 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:28.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f3d3be00640 1 -- 172.21.15.78:0/2972081187 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f3d48092c60 con 0x7f3d400334f0 2024-05-21T14:43:28.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7efe5ca00640 1 -- 172.21.15.78:0/2855011882 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe580a5c00 con 0x7efe60072e50 2024-05-21T14:43:28.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7efe65000640 1 -- 172.21.15.78:0/2855011882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe60072e50 msgr2=0x7efe60073260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7efe65000640 1 --2- 172.21.15.78:0/2855011882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe60072e50 0x7efe60073260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efe58009d90 tx=0x7efe5801c970 comp rx=0 tx=0).stop 2024-05-21T14:43:28.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f8506000640 1 -- 172.21.15.78:0/252291224 shutdown_connections 2024-05-21T14:43:28.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f8506000640 1 --2- 172.21.15.78:0/252291224 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8500153960 0x7f850006dad0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7f8506000640 1 -- 172.21.15.78:0/252291224 >> 172.21.15.78:0/252291224 conn(0x7f85000cd550 msgr2=0x7f85000c9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:28.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fad10000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad08073560 0x7fad081434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fe3f2a00640 1 --2- 172.21.15.78:0/233500550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3f415d3b0 0x7fe3f414ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fad10000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fad080c82d0 0x7fad081f1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fad10000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad08151ce0 0x7fad081440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fad10000640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fad08165b10 con 0x7fad08073560 2024-05-21T14:43:28.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fad10000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fad08165990 con 0x7fad08151ce0 2024-05-21T14:43:28.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fad10000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fad08165c90 con 0x7fad080c82d0 2024-05-21T14:43:28.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7efe65000640 1 -- 172.21.15.78:0/2855011882 shutdown_connections 2024-05-21T14:43:28.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7efe65000640 1 --2- 172.21.15.78:0/2855011882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe60072e50 0x7efe60073260 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7efe65000640 1 --2- 172.21.15.78:0/2855011882 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe600c82d0 0x7efe600c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7efe65000640 1 -- 172.21.15.78:0/2855011882 >> 172.21.15.78:0/2855011882 conn(0x7efe600cd1e0 msgr2=0x7efe600c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:28.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7efe65000640 1 -- 172.21.15.78:0/2855011882 shutdown_connections 2024-05-21T14:43:28.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fad0d600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad08073560 0x7fad081434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fad0d600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad08073560 0x7fad081434c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38402/0 (socket says 172.21.15.78:38402) 2024-05-21T14:43:28.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fad0d600640 1 -- 172.21.15.78:0/1451560345 learned_addr learned my addr 172.21.15.78:0/1451560345 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:28.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7fad0cc00640 1 --2- 172.21.15.78:0/1451560345 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fad080c82d0 0x7fad081f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fe3f2000640 1 -- 172.21.15.78:0/233500550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3f415d3b0 msgr2=0x7fe3f414ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fe3f2000640 1 --2- 172.21.15.78:0/233500550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3f415d3b0 0x7fe3f414ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fe3f2000640 1 -- 172.21.15.78:0/233500550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f413f920 msgr2=0x7fe3f415dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fe3f2000640 1 --2- 172.21.15.78:0/233500550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f413f920 0x7fe3f415dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.981+0000 7fe3f2000640 1 -- 172.21.15.78:0/233500550 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f414c230 con 0x7fe3f415fe20 2024-05-21T14:43:28.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7fad0e000640 1 --2- 172.21.15.78:0/1451560345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad08151ce0 0x7fad081440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7f8506000640 1 -- 172.21.15.78:0/252291224 shutdown_connections 2024-05-21T14:43:28.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7f8506000640 1 -- 172.21.15.78:0/252291224 wait complete. 2024-05-21T14:43:28.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7fe3f2000640 1 --2- 172.21.15.78:0/233500550 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe3f415fe20 0x7fe3f4145350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00b3040 tx=0x7fe3e001bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:28.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7f70aa000640 1 -- 172.21.15.78:0/3786891579 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70980b0070 con 0x7f70ac06b8b0 2024-05-21T14:43:28.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7f70aa000640 1 -- 172.21.15.78:0/3786891579 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70980ab600 con 0x7f70ac06b8b0 2024-05-21T14:43:28.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7f70aa000640 1 -- 172.21.15.78:0/3786891579 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70980ab9d0 con 0x7f70ac06b8b0 2024-05-21T14:43:28.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7fe3eaa00640 1 -- 172.21.15.78:0/233500550 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00b5040 con 0x7fe3f415fe20 2024-05-21T14:43:28.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7fe3eaa00640 1 -- 172.21.15.78:0/233500550 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e0004330 con 0x7fe3f415fe20 2024-05-21T14:43:28.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7fe3eaa00640 1 -- 172.21.15.78:0/233500550 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0003820 con 0x7fe3f415fe20 2024-05-21T14:43:28.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7fad0d600640 1 -- 172.21.15.78:0/1451560345 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fad080c82d0 msgr2=0x7fad081f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7fad0d600640 1 --2- 172.21.15.78:0/1451560345 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fad080c82d0 0x7fad081f1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7fad0d600640 1 -- 172.21.15.78:0/1451560345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad08151ce0 msgr2=0x7fad081440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7fad0d600640 1 --2- 172.21.15.78:0/1451560345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad08151ce0 0x7fad081440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7fad0d600640 1 -- 172.21.15.78:0/1451560345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad081f1dc0 con 0x7fad08073560 2024-05-21T14:43:28.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7faa36200640 1 Processor -- start 2024-05-21T14:43:28.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7fad0d600640 1 --2- 172.21.15.78:0/1451560345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad08073560 0x7fad081434c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7facfc00c690 tx=0x7facfc00cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:28.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7f70b2200640 1 -- 172.21.15.78:0/3786891579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70ac06b8b0 msgr2=0x7f70ac0c5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7f70b2200640 1 --2- 172.21.15.78:0/3786891579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70ac06b8b0 0x7f70ac0c5760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0c3350 tx=0x7f709801c4a0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7efe65000640 1 -- 172.21.15.78:0/2855011882 wait complete. 2024-05-21T14:43:28.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7f70b2200640 1 -- 172.21.15.78:0/3786891579 shutdown_connections 2024-05-21T14:43:28.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7f70b2200640 1 --2- 172.21.15.78:0/3786891579 >> v2:172.21.15.84:3300/0 conn(0x7f70ac0c7a60 0x7f70ac16a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7f70b2200640 1 --2- 172.21.15.78:0/3786891579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70ac06b8b0 0x7f70ac0c5760 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7f70b2200640 1 -- 172.21.15.78:0/3786891579 >> 172.21.15.78:0/3786891579 conn(0x7f70ac0cd1e0 msgr2=0x7f70ac0c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:28.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7f5f3a400640 1 --2- 172.21.15.78:0/4197173345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1c004d50 0x7f5f1c005160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00e320 tx=0x7f5f2c01ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c3d8f190a3b0f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:28.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7fe3f9c00640 1 -- 172.21.15.78:0/233500550 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f414c780 con 0x7fe3f415fe20 2024-05-21T14:43:28.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7fe3f9c00640 1 -- 172.21.15.78:0/233500550 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f414c4a0 con 0x7fe3f415fe20 2024-05-21T14:43:28.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7faa36200640 1 -- start start 2024-05-21T14:43:28.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7f70b2200640 1 -- 172.21.15.78:0/3786891579 shutdown_connections 2024-05-21T14:43:28.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7f5f33e00640 1 -- 172.21.15.78:0/4197173345 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c0b2070 con 0x7f5f1c004d50 2024-05-21T14:43:28.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7fe3dfe00640 1 -- 172.21.15.78:0/233500550 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3c80052a0 con 0x7fe3f415fe20 2024-05-21T14:43:28.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7f70b2200640 1 -- 172.21.15.78:0/3786891579 wait complete. 2024-05-21T14:43:28.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7f5f33e00640 1 -- 172.21.15.78:0/4197173345 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f2c0a5e50 con 0x7f5f1c004d50 2024-05-21T14:43:28.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7f5f33e00640 1 -- 172.21.15.78:0/4197173345 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c009de0 con 0x7f5f1c004d50 2024-05-21T14:43:28.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7efe65000640 1 Processor -- start 2024-05-21T14:43:28.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7fad05600640 1 -- 172.21.15.78:0/1451560345 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc007960 con 0x7fad08073560 2024-05-21T14:43:28.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7fad05600640 1 -- 172.21.15.78:0/1451560345 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facfc008040 con 0x7fad08073560 2024-05-21T14:43:28.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7fad05600640 1 -- 172.21.15.78:0/1451560345 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc007d40 con 0x7fad08073560 2024-05-21T14:43:28.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7f5f3c400640 1 -- 172.21.15.78:0/4197173345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1c004d50 msgr2=0x7f5f1c005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7f5f3c400640 1 --2- 172.21.15.78:0/4197173345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1c004d50 0x7f5f1c005160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00e320 tx=0x7f5f2c01ce40 comp rx=0 tx=0).stop 2024-05-21T14:43:28.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7fe3eaa00640 1 -- 172.21.15.78:0/233500550 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe3e00c2030 con 0x7fe3f415fe20 2024-05-21T14:43:28.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7fad10000640 1 -- 172.21.15.78:0/1451560345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0814c270 con 0x7fad08073560 2024-05-21T14:43:28.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7fad10000640 1 -- 172.21.15.78:0/1451560345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad081f50d0 con 0x7fad08073560 2024-05-21T14:43:28.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7faa36200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa30073560 0x7faa30161230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7faa36200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa300c82d0 0x7faa30161770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7faa36200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa30151ce0 0x7faa301f9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7faa36200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7faa30164980 con 0x7faa300c82d0 2024-05-21T14:43:28.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7faa36200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faa30071b60 con 0x7faa30073560 2024-05-21T14:43:28.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7faa36200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7faa30164b00 con 0x7faa30151ce0 2024-05-21T14:43:28.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7f5f3a400640 1 -- 172.21.15.78:0/4197173345 reap_dead start 2024-05-21T14:43:28.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7faa2ea00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa300c82d0 0x7faa30161770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7fe3eaa00640 1 --2- 172.21.15.78:0/233500550 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe3d40678f0 0x7fe3d4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7faa2ea00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa300c82d0 0x7faa30161770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38414/0 (socket says 172.21.15.78:38414) 2024-05-21T14:43:28.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7faa2ea00640 1 -- 172.21.15.78:0/2248423765 learned_addr learned my addr 172.21.15.78:0/2248423765 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:28.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.985+0000 7efe65000640 1 -- start start 2024-05-21T14:43:28.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7efe65000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe60072e50 0x7efe601511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7fe3eaa00640 1 -- 172.21.15.78:0/233500550 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe3e0122900 con 0x7fe3f415fe20 2024-05-21T14:43:28.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7faa2fe00640 1 --2- 172.21.15.78:0/2248423765 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa30151ce0 0x7faa301f9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7f5f3c400640 1 -- 172.21.15.78:0/4197173345 shutdown_connections 2024-05-21T14:43:28.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7f5f3c400640 1 -- 172.21.15.78:0/4197173345 >> 172.21.15.78:0/4197173345 conn(0x7f5f340cd1e0 msgr2=0x7f5f340c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:28.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7f5f3c400640 1 -- 172.21.15.78:0/4197173345 shutdown_connections 2024-05-21T14:43:28.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7faa2f400640 1 --2- 172.21.15.78:0/2248423765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa30073560 0x7faa30161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7fad10000640 1 -- 172.21.15.78:0/1451560345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad080c6c50 con 0x7fad08073560 2024-05-21T14:43:28.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7fe3f2a00640 1 --2- 172.21.15.78:0/233500550 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe3d40678f0 0x7fe3d4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7efe65000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe600c82d0 0x7efe6014d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7f70b2200640 1 Processor -- start 2024-05-21T14:43:28.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7f8506000640 1 Processor -- start 2024-05-21T14:43:28.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7f8506000640 1 -- start start 2024-05-21T14:43:28.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7efe5de00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe60072e50 0x7efe601511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7efe5de00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe60072e50 0x7efe601511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:54970/0 (socket says 172.21.15.78:54970) 2024-05-21T14:43:28.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7efe5de00640 1 -- 172.21.15.78:0/3511518778 learned_addr learned my addr 172.21.15.78:0/3511518778 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:28.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7efe65000640 1 --2- 172.21.15.78:0/3511518778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe60151ce0 0x7efe60201f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7f70b2200640 1 -- start start 2024-05-21T14:43:28.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7efe5d400640 1 --2- 172.21.15.78:0/3511518778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe600c82d0 0x7efe6014d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7faa2fe00640 1 -- 172.21.15.78:0/2248423765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa30073560 msgr2=0x7faa30161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7faa2fe00640 1 --2- 172.21.15.78:0/2248423765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa30073560 0x7faa30161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7faa2fe00640 1 -- 172.21.15.78:0/2248423765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa300c82d0 msgr2=0x7faa30161770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7faa2fe00640 1 --2- 172.21.15.78:0/2248423765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa300c82d0 0x7faa30161770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7faa2fe00640 1 -- 172.21.15.78:0/2248423765 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa301fce90 con 0x7faa30151ce0 2024-05-21T14:43:28.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7faa2f400640 1 --2- 172.21.15.78:0/2248423765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa30073560 0x7faa30161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:43:28.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7faa2fe00640 1 --2- 172.21.15.78:0/2248423765 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa30151ce0 0x7faa301f9880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faa300ca0d0 tx=0x7faa2801b7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:28.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7efe65000640 1 -- 172.21.15.78:0/3511518778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efe600c99b0 con 0x7efe60151ce0 2024-05-21T14:43:28.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7efe65000640 1 -- 172.21.15.78:0/3511518778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efe600c43e0 con 0x7efe600c82d0 2024-05-21T14:43:28.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7efe65000640 1 -- 172.21.15.78:0/3511518778 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7efe600c9b30 con 0x7efe60072e50 2024-05-21T14:43:28.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7fad05600640 1 -- 172.21.15.78:0/1451560345 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7facfc00f410 con 0x7fad08073560 2024-05-21T14:43:28.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7efe5e800640 1 --2- 172.21.15.78:0/3511518778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe60151ce0 0x7efe60201f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.989+0000 7f5f3c400640 1 -- 172.21.15.78:0/4197173345 wait complete. 2024-05-21T14:43:28.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f5f3c400640 1 Processor -- start 2024-05-21T14:43:28.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7efe5de00640 1 -- 172.21.15.78:0/3511518778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe600c82d0 msgr2=0x7efe6014d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7efe5de00640 1 --2- 172.21.15.78:0/3511518778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe600c82d0 0x7efe6014d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7efe5de00640 1 -- 172.21.15.78:0/3511518778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe60151ce0 msgr2=0x7efe60201f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7efe5de00640 1 --2- 172.21.15.78:0/3511518778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe60151ce0 0x7efe60201f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7efe5de00640 1 -- 172.21.15.78:0/3511518778 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe60202480 con 0x7efe60072e50 2024-05-21T14:43:28.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7efe5e800640 1 --2- 172.21.15.78:0/3511518778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe60151ce0 0x7efe60201f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:28.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f8506000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f850006e010 0x7f8500158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f8506000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8500153960 0x7f85001f64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f8506000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8500159740 0x7f8500152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f84ff400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f850006e010 0x7f8500158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f8506000640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8500153d70 con 0x7f850006e010 2024-05-21T14:43:28.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f8506000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f85000c7950 con 0x7f8500159740 2024-05-21T14:43:28.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f8506000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f85000c8860 con 0x7f8500153960 2024-05-21T14:43:28.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f84ff400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f850006e010 0x7f8500158290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38434/0 (socket says 172.21.15.78:38434) 2024-05-21T14:43:28.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f84ff400640 1 -- 172.21.15.78:0/1127633484 learned_addr learned my addr 172.21.15.78:0/1127633484 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:28.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7fad05600640 1 --2- 172.21.15.78:0/1451560345 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7face80678f0 0x7face8069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f84fea00640 1 --2- 172.21.15.78:0/1127633484 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8500153960 0x7f85001f64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f84ffe00640 1 --2- 172.21.15.78:0/1127633484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8500159740 0x7f8500152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7fad05600640 1 -- 172.21.15.78:0/1451560345 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7facfc085d30 con 0x7fad08073560 2024-05-21T14:43:28.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f70b2200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f70ac06b8b0 0x7f70ac155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f70b2200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70ac0c5ca0 0x7f70ac0c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f70b2200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70ac0c7a60 0x7f70ac1592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f5f3c400640 1 -- start start 2024-05-21T14:43:28.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f84ff400640 1 -- 172.21.15.78:0/1127633484 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8500153960 msgr2=0x7f85001f64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f84ff400640 1 --2- 172.21.15.78:0/1127633484 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8500153960 0x7f85001f64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f84ff400640 1 -- 172.21.15.78:0/1127633484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8500159740 msgr2=0x7f8500152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f84ff400640 1 --2- 172.21.15.78:0/1127633484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8500159740 0x7f8500152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f84ff400640 1 -- 172.21.15.78:0/1127633484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85001e5960 con 0x7f850006e010 2024-05-21T14:43:28.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7fad0cc00640 1 --2- 172.21.15.78:0/1451560345 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7face80678f0 0x7face8069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f70b2200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac0c8cc0 con 0x7f70ac0c5ca0 2024-05-21T14:43:28.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f70b2200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac0c8b40 con 0x7f70ac0c7a60 2024-05-21T14:43:28.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f70b2200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f70ac0ca020 con 0x7f70ac06b8b0 2024-05-21T14:43:28.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7fe3f2a00640 1 --2- 172.21.15.78:0/233500550 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe3d40678f0 0x7fe3d4069e00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4006fd0 tx=0x7fe3e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:28.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7efe5de00640 1 --2- 172.21.15.78:0/3511518778 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe60072e50 0x7efe601511c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efe4800c430 tx=0x7efe4800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:28.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f84ff400640 1 --2- 172.21.15.78:0/1127633484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f850006e010 0x7f8500158290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f84f800c7d0 tx=0x7f84f800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:28.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f70ab400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f70ac06b8b0 0x7f70ac155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f70ab400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f70ac06b8b0 0x7f70ac155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:54982/0 (socket says 172.21.15.78:54982) 2024-05-21T14:43:28.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f70abe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70ac0c7a60 0x7f70ac1592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f70aaa00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70ac0c5ca0 0x7f70ac0c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f70abe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70ac0c7a60 0x7f70ac1592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:42818/0 (socket says 172.21.15.78:42818) 2024-05-21T14:43:28.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7f70abe00640 1 -- 172.21.15.78:0/2484085568 learned_addr learned my addr 172.21.15.78:0/2484085568 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:28.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.993+0000 7fad0cc00640 1 --2- 172.21.15.78:0/1451560345 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7face80678f0 0x7face8069e00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad08144aa0 tx=0x7facf4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:28.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f70abe00640 1 -- 172.21.15.78:0/2484085568 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f70ac06b8b0 msgr2=0x7f70ac155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f70abe00640 1 --2- 172.21.15.78:0/2484085568 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f70ac06b8b0 0x7f70ac155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f70abe00640 1 -- 172.21.15.78:0/2484085568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70ac0c5ca0 msgr2=0x7f70ac0c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f70abe00640 1 --2- 172.21.15.78:0/2484085568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70ac0c5ca0 0x7f70ac0c25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f70abe00640 1 -- 172.21.15.78:0/2484085568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ac155fb0 con 0x7f70ac0c7a60 2024-05-21T14:43:28.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f70abe00640 1 --2- 172.21.15.78:0/2484085568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70ac0c7a60 0x7f70ac1592d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70a400b9e0 tx=0x7f70a400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:28.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f5f3c400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1c004d50 0x7f5f34158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f5f3c400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5f34159060 0x7f5f341f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f5f3c400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f340ca600 0x7f5f341f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f5f3c400640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5f340c48a0 con 0x7f5f1c004d50 2024-05-21T14:43:28.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f5f3c400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5f340c45c0 con 0x7f5f340ca600 2024-05-21T14:43:28.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f5f3c400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f5f340c6950 con 0x7f5f34159060 2024-05-21T14:43:28.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f5f39a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1c004d50 0x7f5f34158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f70a3400640 1 -- 172.21.15.78:0/2484085568 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4019070 con 0x7f70ac0c7a60 2024-05-21T14:43:28.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f70a3400640 1 -- 172.21.15.78:0/2484085568 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a400cb40 con 0x7f70ac0c7a60 2024-05-21T14:43:28.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f70a3400640 1 -- 172.21.15.78:0/2484085568 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4014440 con 0x7f70ac0c7a60 2024-05-21T14:43:28.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f5f39a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1c004d50 0x7f5f34158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38460/0 (socket says 172.21.15.78:38460) 2024-05-21T14:43:28.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f5f39a00640 1 -- 172.21.15.78:0/2889378710 learned_addr learned my addr 172.21.15.78:0/2889378710 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:28.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f70b2200640 1 -- 172.21.15.78:0/2484085568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ac1f9890 con 0x7f70ac0c7a60 2024-05-21T14:43:28.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f5f39000640 1 --2- 172.21.15.78:0/2889378710 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5f34159060 0x7f5f341f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f5f3a400640 1 --2- 172.21.15.78:0/2889378710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f340ca600 0x7f5f341f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f70b2200640 1 -- 172.21.15.78:0/2484085568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ac1f9e50 con 0x7f70ac0c7a60 2024-05-21T14:43:28.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f5f39a00640 1 -- 172.21.15.78:0/2889378710 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5f34159060 msgr2=0x7f5f341f18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f5f39a00640 1 --2- 172.21.15.78:0/2889378710 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5f34159060 0x7f5f341f18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f5f39a00640 1 -- 172.21.15.78:0/2889378710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f340ca600 msgr2=0x7f5f341f1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f5f39a00640 1 --2- 172.21.15.78:0/2889378710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f340ca600 0x7f5f341f1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f5f39a00640 1 -- 172.21.15.78:0/2889378710 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f34200d00 con 0x7f5f1c004d50 2024-05-21T14:43:28.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f5f39a00640 1 --2- 172.21.15.78:0/2889378710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1c004d50 0x7f5f34158b20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f280119d0 tx=0x7f5f28011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:28.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:27.997+0000 7f70b2200640 1 -- 172.21.15.78:0/2484085568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70ac1f95f0 con 0x7f70ac0c7a60 2024-05-21T14:43:28.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.001+0000 7f70a3400640 1 -- 172.21.15.78:0/2484085568 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f70a401c070 con 0x7f70ac0c7a60 2024-05-21T14:43:28.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.001+0000 7f70a3400640 1 --2- 172.21.15.78:0/2484085568 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f708c0678c0 0x7f708c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.001+0000 7f70a3400640 1 -- 172.21.15.78:0/2484085568 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f70a4086030 con 0x7f70ac0c7a60 2024-05-21T14:43:28.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.001+0000 7f70ab400640 1 --2- 172.21.15.78:0/2484085568 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f708c0678c0 0x7f708c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.001+0000 7f70ab400640 1 --2- 172.21.15.78:0/2484085568 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f708c0678c0 0x7f708c069dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f70980ad000 tx=0x7f70980a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:28.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.001+0000 7f84f7400640 1 -- 172.21.15.78:0/1127633484 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f8003b80 con 0x7f850006e010 2024-05-21T14:43:28.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.001+0000 7f5f31600640 1 -- 172.21.15.78:0/2889378710 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2800fb50 con 0x7f5f1c004d50 2024-05-21T14:43:28.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.001+0000 7f5f31600640 1 -- 172.21.15.78:0/2889378710 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f2800fcf0 con 0x7f5f1c004d50 2024-05-21T14:43:28.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.001+0000 7f5f31600640 1 -- 172.21.15.78:0/2889378710 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2800fea0 con 0x7f5f1c004d50 2024-05-21T14:43:28.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.001+0000 7f5f3c400640 1 -- 172.21.15.78:0/2889378710 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f34200fe0 con 0x7f5f1c004d50 2024-05-21T14:43:28.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.001+0000 7f84f7400640 1 -- 172.21.15.78:0/1127633484 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f8003d20 con 0x7f850006e010 2024-05-21T14:43:28.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.001+0000 7f8506000640 1 -- 172.21.15.78:0/1127633484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85001e4150 con 0x7f850006e010 2024-05-21T14:43:28.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.001+0000 7f5f3c400640 1 -- 172.21.15.78:0/2889378710 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f342015a0 con 0x7f5f1c004d50 2024-05-21T14:43:28.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.001+0000 7f84f7400640 1 -- 172.21.15.78:0/1127633484 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f800aa90 con 0x7f850006e010 2024-05-21T14:43:28.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.001+0000 7f8506000640 1 -- 172.21.15.78:0/1127633484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85001e4710 con 0x7f850006e010 2024-05-21T14:43:28.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.005+0000 7fad05600640 1 -- 172.21.15.78:0/1451560345 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7facfc014030 con 0x7fad08073560 2024-05-21T14:43:28.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.005+0000 7f5f3c400640 1 -- 172.21.15.78:0/2889378710 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f340c7b40 con 0x7f5f1c004d50 2024-05-21T14:43:28.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.005+0000 7f8506000640 1 -- 172.21.15.78:0/1127633484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f850004f730 con 0x7f850006e010 2024-05-21T14:43:28.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.005+0000 7fe3eaa00640 1 -- 172.21.15.78:0/233500550 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fe3e00c9060 con 0x7fe3f415fe20 2024-05-21T14:43:28.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.005+0000 7faa27400640 1 -- 172.21.15.78:0/2248423765 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa280ad040 con 0x7faa30151ce0 2024-05-21T14:43:28.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.005+0000 7faa27400640 1 -- 172.21.15.78:0/2248423765 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa280b1690 con 0x7faa30151ce0 2024-05-21T14:43:28.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.005+0000 7faa27400640 1 -- 172.21.15.78:0/2248423765 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa280b1a60 con 0x7faa30151ce0 2024-05-21T14:43:28.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.005+0000 7faa36200640 1 -- 172.21.15.78:0/2248423765 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa301fd170 con 0x7faa30151ce0 2024-05-21T14:43:28.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.005+0000 7faa36200640 1 -- 172.21.15.78:0/2248423765 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3014b490 con 0x7faa30151ce0 2024-05-21T14:43:28.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.005+0000 7efe56000640 1 -- 172.21.15.78:0/3511518778 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe48017070 con 0x7efe60072e50 2024-05-21T14:43:28.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.005+0000 7efe65000640 1 -- 172.21.15.78:0/3511518778 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe60154130 con 0x7efe60072e50 2024-05-21T14:43:28.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.005+0000 7efe56000640 1 -- 172.21.15.78:0/3511518778 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe48005cf0 con 0x7efe60072e50 2024-05-21T14:43:28.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.005+0000 7efe56000640 1 -- 172.21.15.78:0/3511518778 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe480072d0 con 0x7efe60072e50 2024-05-21T14:43:28.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.005+0000 7efe65000640 1 -- 172.21.15.78:0/3511518778 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efe601546f0 con 0x7efe60072e50 2024-05-21T14:43:28.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.005+0000 7f5f31600640 1 -- 172.21.15.78:0/2889378710 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5f28012040 con 0x7f5f1c004d50 2024-05-21T14:43:28.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.005+0000 7f84f7400640 1 -- 172.21.15.78:0/1127633484 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f84f800ac30 con 0x7f850006e010 2024-05-21T14:43:28.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.009+0000 7f84f7400640 1 --2- 172.21.15.78:0/1127633484 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f84e00678c0 0x7f84e0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.009+0000 7f84f7400640 1 -- 172.21.15.78:0/1127633484 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f84f8086790 con 0x7f850006e010 2024-05-21T14:43:28.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.009+0000 7faa36200640 1 -- 172.21.15.78:0/2248423765 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa3004f730 con 0x7faa30151ce0 2024-05-21T14:43:28.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.009+0000 7efe4f400640 1 -- 172.21.15.78:0/3511518778 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe6004f730 con 0x7efe60072e50 2024-05-21T14:43:28.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.009+0000 7f5f31600640 1 --2- 172.21.15.78:0/2889378710 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f5f140678c0 0x7f5f14069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.009+0000 7f5f31600640 1 -- 172.21.15.78:0/2889378710 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5f28086420 con 0x7f5f1c004d50 2024-05-21T14:43:28.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.009+0000 7f5f39000640 1 --2- 172.21.15.78:0/2889378710 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f5f140678c0 0x7f5f14069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.009+0000 7f84fea00640 1 --2- 172.21.15.78:0/1127633484 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f84e00678c0 0x7f84e0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.009+0000 7f5f39000640 1 --2- 172.21.15.78:0/2889378710 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f5f140678c0 0x7f5f14069dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5f340cc700 tx=0x7f5f20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:28.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.009+0000 7efe56000640 1 -- 172.21.15.78:0/3511518778 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe4801a070 con 0x7efe60072e50 2024-05-21T14:43:28.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.009+0000 7faa27400640 1 -- 172.21.15.78:0/2248423765 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faa280b1c00 con 0x7faa30151ce0 2024-05-21T14:43:28.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.013+0000 7f84fea00640 1 --2- 172.21.15.78:0/1127633484 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f84e00678c0 0x7f84e0069dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f84ec0b2000 tx=0x7f84ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:28.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.013+0000 7faa27400640 1 --2- 172.21.15.78:0/2248423765 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7faa10067910 0x7faa10069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.013+0000 7faa27400640 1 -- 172.21.15.78:0/2248423765 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7faa28120c40 con 0x7faa30151ce0 2024-05-21T14:43:28.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.013+0000 7efe56000640 1 --2- 172.21.15.78:0/3511518778 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efe3c0678f0 0x7efe3c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:28.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.013+0000 7faa2f400640 1 --2- 172.21.15.78:0/2248423765 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7faa10067910 0x7faa10069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.013+0000 7efe56000640 1 -- 172.21.15.78:0/3511518778 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efe48085060 con 0x7efe60072e50 2024-05-21T14:43:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.013+0000 7efe5d400640 1 --2- 172.21.15.78:0/3511518778 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efe3c0678f0 0x7efe3c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.013+0000 7faa2f400640 1 --2- 172.21.15.78:0/2248423765 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7faa10067910 0x7faa10069e20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009cc0 tx=0x7faa1c006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.013+0000 7efe5d400640 1 --2- 172.21.15.78:0/3511518778 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efe3c0678f0 0x7efe3c069e00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efe600c2180 tx=0x7efe50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.013+0000 7f84f7400640 1 -- 172.21.15.78:0/1127633484 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f84f8057220 con 0x7f850006e010 2024-05-21T14:43:28.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.017+0000 7f70a3400640 1 -- 172.21.15.78:0/2484085568 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f70ac1f95f0 con 0x7f70ac0c7a60 2024-05-21T14:43:28.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.025+0000 7f5f31600640 1 -- 172.21.15.78:0/2889378710 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f5f28019030 con 0x7f5f1c004d50 2024-05-21T14:43:28.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.025+0000 7faa27400640 1 -- 172.21.15.78:0/2248423765 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7faa280ca070 con 0x7faa30151ce0 2024-05-21T14:43:28.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.041+0000 7efe56000640 1 -- 172.21.15.78:0/3511518778 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7efe48055420 con 0x7efe60072e50 2024-05-21T14:43:28.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.325+0000 7fad10000640 1 -- 172.21.15.78:0/1451560345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fad0806c190 con 0x7fad08073560 2024-05-21T14:43:28.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.329+0000 7fad05600640 1 -- 172.21.15.78:0/1451560345 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7facfc056220 con 0x7fad08073560 2024-05-21T14:43:28.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.329+0000 7f3d4da00640 1 -- 172.21.15.78:0/2972081187 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3d24005860 con 0x7f3d400334f0 2024-05-21T14:43:28.339 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2024-05-21T14:43:28.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.333+0000 7fad10000640 1 -- 172.21.15.78:0/1451560345 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7face80678f0 msgr2=0x7face8069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.333+0000 7fad10000640 1 --2- 172.21.15.78:0/1451560345 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7face80678f0 0x7face8069e00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad08144aa0 tx=0x7facf4009040 comp rx=0 tx=0).stop 2024-05-21T14:43:28.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.333+0000 7fad10000640 1 -- 172.21.15.78:0/1451560345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad08073560 msgr2=0x7fad081434c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.333+0000 7fad10000640 1 --2- 172.21.15.78:0/1451560345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad08073560 0x7fad081434c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7facfc00c690 tx=0x7facfc00cb50 comp rx=0 tx=0).stop 2024-05-21T14:43:28.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.333+0000 7f3d3be00640 1 -- 172.21.15.78:0/2972081187 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3d4816da90 con 0x7f3d400334f0 2024-05-21T14:43:28.340 INFO:teuthology.orchestra.run.smithi078.stdout:64424509446 2024-05-21T14:43:28.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.333+0000 7fad10000640 1 -- 172.21.15.78:0/1451560345 shutdown_connections 2024-05-21T14:43:28.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.333+0000 7fad10000640 1 --2- 172.21.15.78:0/1451560345 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7face80678f0 0x7face8069e00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.333+0000 7fad10000640 1 --2- 172.21.15.78:0/1451560345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad08151ce0 0x7fad081440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.333+0000 7fad10000640 1 --2- 172.21.15.78:0/1451560345 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fad080c82d0 0x7fad081f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.333+0000 7fad10000640 1 --2- 172.21.15.78:0/1451560345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad08073560 0x7fad081434c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.333+0000 7fad10000640 1 -- 172.21.15.78:0/1451560345 >> 172.21.15.78:0/1451560345 conn(0x7fad080cd1e0 msgr2=0x7fad080c7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:28.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.333+0000 7f70b2200640 1 -- 172.21.15.78:0/2484085568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f70ac0c8920 con 0x7f70ac0c7a60 2024-05-21T14:43:28.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.333+0000 7fad10000640 1 -- 172.21.15.78:0/1451560345 shutdown_connections 2024-05-21T14:43:28.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.333+0000 7fad10000640 1 -- 172.21.15.78:0/1451560345 wait complete. 2024-05-21T14:43:28.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.333+0000 7f70a3400640 1 -- 172.21.15.78:0/2484085568 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f70a4023070 con 0x7f70ac0c7a60 2024-05-21T14:43:28.342 INFO:teuthology.orchestra.run.smithi078.stdout:64424509446 2024-05-21T14:43:28.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f3d4da00640 1 -- 172.21.15.78:0/2972081187 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f3d28067cf0 msgr2=0x7f3d2806a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f3d4da00640 1 --2- 172.21.15.78:0/2972081187 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f3d28067cf0 0x7f3d2806a200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3d40050880 tx=0x7f3d3c008040 comp rx=0 tx=0).stop 2024-05-21T14:43:28.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f3d4da00640 1 -- 172.21.15.78:0/2972081187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d400334f0 msgr2=0x7f3d4017f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f3d4da00640 1 --2- 172.21.15.78:0/2972081187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d400334f0 0x7f3d4017f640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3d48076e80 tx=0x7f3d48095cf0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f3d4da00640 1 -- 172.21.15.78:0/2972081187 shutdown_connections 2024-05-21T14:43:28.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f3d4da00640 1 --2- 172.21.15.78:0/2972081187 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f3d28067cf0 0x7f3d2806a200 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f3d4da00640 1 --2- 172.21.15.78:0/2972081187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4004c000 0x7f3d400d67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f3d4da00640 1 --2- 172.21.15.78:0/2972081187 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d4004ba50 0x7f3d400d7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f3d4da00640 1 --2- 172.21.15.78:0/2972081187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d400334f0 0x7f3d4017f640 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f3d4da00640 1 -- 172.21.15.78:0/2972081187 >> 172.21.15.78:0/2972081187 conn(0x7f3d400503c0 msgr2=0x7f3d4004a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:28.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f70b2200640 1 -- 172.21.15.78:0/2484085568 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f708c0678c0 msgr2=0x7f708c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f70b2200640 1 --2- 172.21.15.78:0/2484085568 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f708c0678c0 0x7f708c069dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f70980ad000 tx=0x7f70980a6000 comp rx=0 tx=0).stop 2024-05-21T14:43:28.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f70b2200640 1 -- 172.21.15.78:0/2484085568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70ac0c7a60 msgr2=0x7f70ac1592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f70b2200640 1 --2- 172.21.15.78:0/2484085568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70ac0c7a60 0x7f70ac1592d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70a400b9e0 tx=0x7f70a400bea0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f70b2200640 1 -- 172.21.15.78:0/2484085568 shutdown_connections 2024-05-21T14:43:28.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f70b2200640 1 --2- 172.21.15.78:0/2484085568 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f708c0678c0 0x7f708c069dd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f70b2200640 1 --2- 172.21.15.78:0/2484085568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70ac0c7a60 0x7f70ac1592d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f70b2200640 1 --2- 172.21.15.78:0/2484085568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70ac0c5ca0 0x7f70ac0c25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f70b2200640 1 --2- 172.21.15.78:0/2484085568 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f70ac06b8b0 0x7f70ac155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f70b2200640 1 -- 172.21.15.78:0/2484085568 >> 172.21.15.78:0/2484085568 conn(0x7f70ac0cd1e0 msgr2=0x7f70ac0c7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:28.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.337+0000 7f70b2200640 1 -- 172.21.15.78:0/2484085568 shutdown_connections 2024-05-21T14:43:28.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.341+0000 7f70b2200640 1 -- 172.21.15.78:0/2484085568 wait complete. 2024-05-21T14:43:28.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.341+0000 7f3d4da00640 1 -- 172.21.15.78:0/2972081187 shutdown_connections 2024-05-21T14:43:28.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.341+0000 7f3d4da00640 1 -- 172.21.15.78:0/2972081187 wait complete. 2024-05-21T14:43:28.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.349+0000 7fe3dfe00640 1 -- 172.21.15.78:0/233500550 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe3c8005590 con 0x7fe3f415fe20 2024-05-21T14:43:28.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.349+0000 7fe3eaa00640 1 -- 172.21.15.78:0/233500550 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe3e0122090 con 0x7fe3f415fe20 2024-05-21T14:43:28.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.353+0000 7f8506000640 1 -- 172.21.15.78:0/1127633484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8500073e10 con 0x7f850006e010 2024-05-21T14:43:28.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.353+0000 7f84f7400640 1 -- 172.21.15.78:0/1127633484 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f84f8056b20 con 0x7f850006e010 2024-05-21T14:43:28.363 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-05-21T14:43:28.363 INFO:teuthology.orchestra.run.smithi078.stdout:64424509446 2024-05-21T14:43:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7f8506000640 1 -- 172.21.15.78:0/1127633484 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f84e00678c0 msgr2=0x7f84e0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7f8506000640 1 --2- 172.21.15.78:0/1127633484 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f84e00678c0 0x7f84e0069dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f84ec0b2000 tx=0x7f84ec008040 comp rx=0 tx=0).stop 2024-05-21T14:43:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7f8506000640 1 -- 172.21.15.78:0/1127633484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f850006e010 msgr2=0x7f8500158290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7f8506000640 1 --2- 172.21.15.78:0/1127633484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f850006e010 0x7f8500158290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f84f800c7d0 tx=0x7f84f800cc90 comp rx=0 tx=0).stop 2024-05-21T14:43:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7fe3dfe00640 1 -- 172.21.15.78:0/233500550 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe3d40678f0 msgr2=0x7fe3d4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7fe3dfe00640 1 --2- 172.21.15.78:0/233500550 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe3d40678f0 0x7fe3d4069e00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4006fd0 tx=0x7fe3e4008040 comp rx=0 tx=0).stop 2024-05-21T14:43:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7fe3dfe00640 1 -- 172.21.15.78:0/233500550 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe3f415fe20 msgr2=0x7fe3f4145350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7f8506000640 1 -- 172.21.15.78:0/1127633484 shutdown_connections 2024-05-21T14:43:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7f8506000640 1 --2- 172.21.15.78:0/1127633484 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f84e00678c0 0x7f84e0069dd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7f8506000640 1 --2- 172.21.15.78:0/1127633484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8500159740 0x7f8500152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7f8506000640 1 --2- 172.21.15.78:0/1127633484 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8500153960 0x7f85001f64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7f8506000640 1 --2- 172.21.15.78:0/1127633484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f850006e010 0x7f8500158290 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7f8506000640 1 -- 172.21.15.78:0/1127633484 >> 172.21.15.78:0/1127633484 conn(0x7f85000cd550 msgr2=0x7f85000cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7fe3dfe00640 1 --2- 172.21.15.78:0/233500550 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe3f415fe20 0x7fe3f4145350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00b3040 tx=0x7fe3e001bab0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7f8506000640 1 -- 172.21.15.78:0/1127633484 shutdown_connections 2024-05-21T14:43:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7fe3dfe00640 1 -- 172.21.15.78:0/233500550 shutdown_connections 2024-05-21T14:43:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7f8506000640 1 -- 172.21.15.78:0/1127633484 wait complete. 2024-05-21T14:43:28.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7fe3dfe00640 1 --2- 172.21.15.78:0/233500550 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe3d40678f0 0x7fe3d4069e00 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4006fd0 tx=0x7fe3e4008040 comp rx=0 tx=0).stop 2024-05-21T14:43:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7fe3dfe00640 1 --2- 172.21.15.78:0/233500550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3f413f920 0x7fe3f415dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7fe3dfe00640 1 --2- 172.21.15.78:0/233500550 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe3f415fe20 0x7fe3f4145350 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7fe3dfe00640 1 --2- 172.21.15.78:0/233500550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3f415d3b0 0x7fe3f414ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.357+0000 7fe3dfe00640 1 -- 172.21.15.78:0/233500550 >> 172.21.15.78:0/233500550 conn(0x7fe3f40cb4e0 msgr2=0x7fe3f415c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.361+0000 7fe3dfe00640 1 -- 172.21.15.78:0/233500550 shutdown_connections 2024-05-21T14:43:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.361+0000 7fe3dfe00640 1 -- 172.21.15.78:0/233500550 wait complete. 2024-05-21T14:43:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.361+0000 7faa36200640 1 -- 172.21.15.78:0/2248423765 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7faa30148250 con 0x7faa30151ce0 2024-05-21T14:43:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.361+0000 7f5f3c400640 1 -- 172.21.15.78:0/2889378710 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5f3414ff00 con 0x7f5f1c004d50 2024-05-21T14:43:28.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.365+0000 7faa27400640 1 -- 172.21.15.78:0/2248423765 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa28018620 con 0x7faa30151ce0 2024-05-21T14:43:28.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.365+0000 7f5f31600640 1 -- 172.21.15.78:0/2889378710 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5f280567e0 con 0x7f5f1c004d50 2024-05-21T14:43:28.375 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-05-21T14:43:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.369+0000 7faa36200640 1 -- 172.21.15.78:0/2248423765 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7faa10067910 msgr2=0x7faa10069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.369+0000 7faa36200640 1 --2- 172.21.15.78:0/2248423765 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7faa10067910 0x7faa10069e20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009cc0 tx=0x7faa1c006f90 comp rx=0 tx=0).stop 2024-05-21T14:43:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.369+0000 7faa36200640 1 -- 172.21.15.78:0/2248423765 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa30151ce0 msgr2=0x7faa301f9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.369+0000 7faa36200640 1 --2- 172.21.15.78:0/2248423765 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa30151ce0 0x7faa301f9880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faa300ca0d0 tx=0x7faa2801b7d0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.379 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-05-21T14:43:28.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-05-21T14:43:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.369+0000 7faa36200640 1 -- 172.21.15.78:0/2248423765 shutdown_connections 2024-05-21T14:43:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.369+0000 7faa36200640 1 --2- 172.21.15.78:0/2248423765 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7faa10067910 0x7faa10069e20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.369+0000 7faa36200640 1 --2- 172.21.15.78:0/2248423765 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa30151ce0 0x7faa301f9880 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.369+0000 7faa36200640 1 --2- 172.21.15.78:0/2248423765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa300c82d0 0x7faa30161770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.369+0000 7faa36200640 1 --2- 172.21.15.78:0/2248423765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa30073560 0x7faa30161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.369+0000 7faa36200640 1 -- 172.21.15.78:0/2248423765 >> 172.21.15.78:0/2248423765 conn(0x7faa300cd1e0 msgr2=0x7faa30067580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:28.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.369+0000 7f5f3c400640 1 -- 172.21.15.78:0/2889378710 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f5f140678c0 msgr2=0x7f5f14069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.373+0000 7faa36200640 1 -- 172.21.15.78:0/2248423765 shutdown_connections 2024-05-21T14:43:28.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.373+0000 7faa36200640 1 -- 172.21.15.78:0/2248423765 wait complete. 2024-05-21T14:43:28.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.369+0000 7f5f3c400640 1 --2- 172.21.15.78:0/2889378710 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f5f140678c0 0x7f5f14069dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5f340cc700 tx=0x7f5f20009040 comp rx=0 tx=0).stop 2024-05-21T14:43:28.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.369+0000 7f5f3c400640 1 -- 172.21.15.78:0/2889378710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1c004d50 msgr2=0x7f5f34158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.369+0000 7f5f3c400640 1 --2- 172.21.15.78:0/2889378710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1c004d50 0x7f5f34158b20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f280119d0 tx=0x7f5f28011e90 comp rx=0 tx=0).stop 2024-05-21T14:43:28.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.373+0000 7f5f3c400640 1 -- 172.21.15.78:0/2889378710 shutdown_connections 2024-05-21T14:43:28.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.373+0000 7f5f3c400640 1 --2- 172.21.15.78:0/2889378710 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f5f140678c0 0x7f5f14069dd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.373+0000 7f5f3c400640 1 --2- 172.21.15.78:0/2889378710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f340ca600 0x7f5f341f1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.373+0000 7f5f3c400640 1 --2- 172.21.15.78:0/2889378710 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5f34159060 0x7f5f341f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.373+0000 7f5f3c400640 1 --2- 172.21.15.78:0/2889378710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1c004d50 0x7f5f34158b20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.373+0000 7f5f3c400640 1 -- 172.21.15.78:0/2889378710 >> 172.21.15.78:0/2889378710 conn(0x7f5f340cd1e0 msgr2=0x7f5f3406ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:28.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.373+0000 7f5f3c400640 1 -- 172.21.15.78:0/2889378710 shutdown_connections 2024-05-21T14:43:28.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.373+0000 7f5f3c400640 1 -- 172.21.15.78:0/2889378710 wait complete. 2024-05-21T14:43:28.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.373+0000 7efe4f400640 1 -- 172.21.15.78:0/3511518778 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7efe600c8e30 con 0x7efe60072e50 2024-05-21T14:43:28.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.377+0000 7efe56000640 1 -- 172.21.15.78:0/3511518778 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efe48059720 con 0x7efe60072e50 2024-05-21T14:43:28.384 INFO:teuthology.orchestra.run.smithi078.stdout:64424509446 2024-05-21T14:43:28.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2024-05-21T14:43:28.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-05-21T14:43:28.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.377+0000 7efe4f400640 1 -- 172.21.15.78:0/3511518778 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efe3c0678f0 msgr2=0x7efe3c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.377+0000 7efe4f400640 1 --2- 172.21.15.78:0/3511518778 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efe3c0678f0 0x7efe3c069e00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efe600c2180 tx=0x7efe50008040 comp rx=0 tx=0).stop 2024-05-21T14:43:28.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.377+0000 7efe4f400640 1 -- 172.21.15.78:0/3511518778 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe60072e50 msgr2=0x7efe601511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:28.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.377+0000 7efe4f400640 1 --2- 172.21.15.78:0/3511518778 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe60072e50 0x7efe601511c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efe4800c430 tx=0x7efe4800c8f0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.377+0000 7efe4f400640 1 -- 172.21.15.78:0/3511518778 shutdown_connections 2024-05-21T14:43:28.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.377+0000 7efe4f400640 1 --2- 172.21.15.78:0/3511518778 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efe3c0678f0 0x7efe3c069e00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.377+0000 7efe4f400640 1 --2- 172.21.15.78:0/3511518778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe60151ce0 0x7efe60201f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.377+0000 7efe4f400640 1 --2- 172.21.15.78:0/3511518778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe600c82d0 0x7efe6014d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.377+0000 7efe4f400640 1 --2- 172.21.15.78:0/3511518778 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe60072e50 0x7efe601511c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:28.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.377+0000 7efe4f400640 1 -- 172.21.15.78:0/3511518778 >> 172.21.15.78:0/3511518778 conn(0x7efe600cd1e0 msgr2=0x7efe60164d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:28.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.381+0000 7efe4f400640 1 -- 172.21.15.78:0/3511518778 shutdown_connections 2024-05-21T14:43:28.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:28.381+0000 7efe4f400640 1 -- 172.21.15.78:0/3511518778 wait complete. 2024-05-21T14:43:28.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.5 2024-05-21T14:43:28.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2024-05-21T14:43:28.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.2 2024-05-21T14:43:28.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2024-05-21T14:43:28.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2024-05-21T14:43:29.380 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-21T14:43:29.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-21T14:43:29.386 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-21T14:43:29.401 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-21T14:43:29.402 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-21T14:43:29.414 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-21T14:43:29.416 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-21T14:43:29.417 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-21T14:43:29.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.613+0000 7f3d5b200640 1 Processor -- start 2024-05-21T14:43:29.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.613+0000 7f3d5b200640 1 -- start start 2024-05-21T14:43:29.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.617+0000 7f3d5b200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d5c1518e0 0x7f3d5c0c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.617+0000 7f3d5b200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3d5c073cb0 0x7f3d5c0740c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.617+0000 7f3d5b200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d5c0c3ff0 0x7f3d5c0c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.617+0000 7f3d5b200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f3d5c1577c0 con 0x7f3d5c1518e0 2024-05-21T14:43:29.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.617+0000 7f3d5b200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f3d5c157a80 con 0x7f3d5c073cb0 2024-05-21T14:43:29.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.617+0000 7f3d5a800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d5c0c3ff0 0x7f3d5c0c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.617+0000 7f3d5a800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d5c0c3ff0 0x7f3d5c0c4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:55008/0 (socket says 172.21.15.78:55008) 2024-05-21T14:43:29.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.617+0000 7f3d5a800640 1 -- 172.21.15.78:0/4184170817 learned_addr learned my addr 172.21.15.78:0/4184170817 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:29.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.617+0000 7f3d59400640 1 --2- 172.21.15.78:0/4184170817 >> v2:172.21.15.84:3300/0 conn(0x7f3d5c073cb0 0x7f3d5c0740c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.617+0000 7f3d5b200640 1 -- 172.21.15.78:0/4184170817 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f3d5c157d60 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.617+0000 7f3d59e00640 1 --2- 172.21.15.78:0/4184170817 >> v2:172.21.15.78:3300/0 conn(0x7f3d5c1518e0 0x7f3d5c0c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.617+0000 7f3d5a800640 1 -- 172.21.15.78:0/4184170817 >> v2:172.21.15.84:3300/0 conn(0x7f3d5c073cb0 msgr2=0x7f3d5c0740c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:29.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.617+0000 7f3d5a800640 1 --2- 172.21.15.78:0/4184170817 >> v2:172.21.15.84:3300/0 conn(0x7f3d5c073cb0 0x7f3d5c0740c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.617+0000 7f3d5a800640 1 -- 172.21.15.78:0/4184170817 >> v2:172.21.15.78:3300/0 conn(0x7f3d5c1518e0 msgr2=0x7f3d5c0c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:29.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.617+0000 7f3d5a800640 1 --2- 172.21.15.78:0/4184170817 >> v2:172.21.15.78:3300/0 conn(0x7f3d5c1518e0 0x7f3d5c0c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.617+0000 7f3d5a800640 1 -- 172.21.15.78:0/4184170817 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5c158040 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.617+0000 7f3d59e00640 1 --2- 172.21.15.78:0/4184170817 >> v2:172.21.15.78:3300/0 conn(0x7f3d5c1518e0 0x7f3d5c0c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:43:29.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.625+0000 7f3d5a800640 1 --2- 172.21.15.78:0/4184170817 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d5c0c3ff0 0x7f3d5c0c4400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0cd390 tx=0x7f3d48023020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72db1825d0b22b0b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.625+0000 7f3d58a00640 1 -- 172.21.15.78:0/4184170817 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4800d2d0 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.625+0000 7f3d58a00640 1 -- 172.21.15.78:0/4184170817 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d480acbf0 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.625+0000 7f3d58a00640 1 -- 172.21.15.78:0/4184170817 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4800b450 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.625+0000 7f3d5b200640 1 -- 172.21.15.78:0/4184170817 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d5c0c3ff0 msgr2=0x7f3d5c0c4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.625+0000 7f3d5b200640 1 --2- 172.21.15.78:0/4184170817 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d5c0c3ff0 0x7f3d5c0c4400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0cd390 tx=0x7f3d48023020 comp rx=0 tx=0).stop 2024-05-21T14:43:29.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.625+0000 7f3d5b200640 1 -- 172.21.15.78:0/4184170817 shutdown_connections 2024-05-21T14:43:29.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.625+0000 7f3d5b200640 1 --2- 172.21.15.78:0/4184170817 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d5c0c3ff0 0x7f3d5c0c4400 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.625+0000 7f3d5b200640 1 --2- 172.21.15.78:0/4184170817 >> v2:172.21.15.84:3300/0 conn(0x7f3d5c073cb0 0x7f3d5c0740c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.625+0000 7f3d5b200640 1 --2- 172.21.15.78:0/4184170817 >> v2:172.21.15.78:3300/0 conn(0x7f3d5c1518e0 0x7f3d5c0c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.625+0000 7f3d5b200640 1 -- 172.21.15.78:0/4184170817 >> 172.21.15.78:0/4184170817 conn(0x7f3d5c06f520 msgr2=0x7f3d5c0cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:29.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.625+0000 7f3d5b200640 1 -- 172.21.15.78:0/4184170817 shutdown_connections 2024-05-21T14:43:29.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.625+0000 7f3d5b200640 1 -- 172.21.15.78:0/4184170817 wait complete. 2024-05-21T14:43:29.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.629+0000 7f3d5b200640 1 Processor -- start 2024-05-21T14:43:29.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.629+0000 7f3d5b200640 1 -- start start 2024-05-21T14:43:29.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.633+0000 7f3d5b200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d5c073cb0 0x7f3d5c0cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.633+0000 7f3d5b200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d5c0c3ff0 0x7f3d5c14a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.633+0000 7f3d5b200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d5c1518e0 0x7f3d5c0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.633+0000 7f3d59e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d5c073cb0 0x7f3d5c0cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.633+0000 7f3d59e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d5c073cb0 0x7f3d5c0cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:42832/0 (socket says 172.21.15.78:42832) 2024-05-21T14:43:29.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.633+0000 7f3d59400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d5c0c3ff0 0x7f3d5c14a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.633+0000 7f3d59400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d5c0c3ff0 0x7f3d5c14a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:55022/0 (socket says 172.21.15.78:55022) 2024-05-21T14:43:29.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.633+0000 7f3d5a800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d5c1518e0 0x7f3d5c0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.633+0000 7f3d5b200640 1 -- 172.21.15.78:0/2691866115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5c0c4940 con 0x7f3d5c1518e0 2024-05-21T14:43:29.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.633+0000 7f3d59e00640 1 -- 172.21.15.78:0/2691866115 learned_addr learned my addr 172.21.15.78:0/2691866115 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:29.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.633+0000 7f3d5b200640 1 -- 172.21.15.78:0/2691866115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5c0c88d0 con 0x7f3d5c073cb0 2024-05-21T14:43:29.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.633+0000 7f3d5b200640 1 -- 172.21.15.78:0/2691866115 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f3d5c151cf0 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.637+0000 7f3d59400640 1 -- 172.21.15.78:0/2691866115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d5c073cb0 msgr2=0x7f3d5c0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.637+0000 7f3d59400640 1 --2- 172.21.15.78:0/2691866115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d5c073cb0 0x7f3d5c0cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.637+0000 7f3d59400640 1 -- 172.21.15.78:0/2691866115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d5c1518e0 msgr2=0x7f3d5c0cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.637+0000 7f3d59400640 1 --2- 172.21.15.78:0/2691866115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d5c1518e0 0x7f3d5c0cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.637+0000 7f3d59400640 1 -- 172.21.15.78:0/2691866115 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5c0cad00 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.637+0000 7f3d59e00640 1 --2- 172.21.15.78:0/2691866115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d5c073cb0 0x7f3d5c0cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:29.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.637+0000 7f3d59400640 1 --2- 172.21.15.78:0/2691866115 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d5c0c3ff0 0x7f3d5c14a0b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400ebf0 tx=0x7f3d5400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.637+0000 7f3d52000640 1 -- 172.21.15.78:0/2691866115 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d54018020 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.637+0000 7f3d52000640 1 -- 172.21.15.78:0/2691866115 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d5400cda0 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.637+0000 7f3d52000640 1 -- 172.21.15.78:0/2691866115 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d540146c0 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.637+0000 7f3d5b200640 1 -- 172.21.15.78:0/2691866115 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d5c1f13a0 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.637+0000 7f3d5b200640 1 -- 172.21.15.78:0/2691866115 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d5c1f1960 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.641+0000 7f3d5b200640 1 -- 172.21.15.78:0/2691866115 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d5c1574d0 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.645+0000 7f3d52000640 1 -- 172.21.15.78:0/2691866115 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3d5401b020 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.645+0000 7f3d52000640 1 --2- 172.21.15.78:0/2691866115 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f3d3c0678c0 0x7f3d3c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.645+0000 7f3d52000640 1 -- 172.21.15.78:0/2691866115 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3d54087040 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.645+0000 7f3d59e00640 1 --2- 172.21.15.78:0/2691866115 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f3d3c0678c0 0x7f3d3c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.649+0000 7f3d59e00640 1 --2- 172.21.15.78:0/2691866115 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f3d3c0678c0 0x7f3d3c069dd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c006fd0 tx=0x7f3d4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.657+0000 7f3d52000640 1 -- 172.21.15.78:0/2691866115 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f3d54022020 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.701+0000 7f1ab5000640 1 Processor -- start 2024-05-21T14:43:29.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.701+0000 7f1ab5000640 1 -- start start 2024-05-21T14:43:29.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.705+0000 7f5206000640 1 Processor -- start 2024-05-21T14:43:29.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.705+0000 7f5206000640 1 -- start start 2024-05-21T14:43:29.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.705+0000 7f1ab5000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1ab014fce0 0x7f1ab0071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.705+0000 7f1ab5000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ab015ccd0 0x7f1ab0163c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.705+0000 7f1ab5000640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ab00720a0 con 0x7f1ab015c8c0 2024-05-21T14:43:29.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.705+0000 7f1ab5000640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f1ab0159d10 con 0x7f1ab014fce0 2024-05-21T14:43:29.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.705+0000 7f1ab5000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab0072330 con 0x7f1ab015ccd0 2024-05-21T14:43:29.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.705+0000 7f1aa6a00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1ab015c8c0 0x7f1ab0073ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57492/0 (socket says 172.21.15.78:57492) 2024-05-21T14:43:29.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.705+0000 7f1aa6a00640 1 -- 172.21.15.78:0/3114623775 learned_addr learned my addr 172.21.15.78:0/3114623775 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:29.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.705+0000 7f1aafe00640 1 --2- 172.21.15.78:0/3114623775 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ab015ccd0 0x7f1ab0163c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f1aaf400640 1 --2- 172.21.15.78:0/3114623775 >> v2:172.21.15.78:3300/0 conn(0x7f1ab014fce0 0x7f1ab0071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f1aafe00640 1 -- 172.21.15.78:0/3114623775 >> v2:172.21.15.78:3300/0 conn(0x7f1ab014fce0 msgr2=0x7f1ab0071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:29.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f1aafe00640 1 --2- 172.21.15.78:0/3114623775 >> v2:172.21.15.78:3300/0 conn(0x7f1ab014fce0 0x7f1ab0071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f1aafe00640 1 -- 172.21.15.78:0/3114623775 >> v1:172.21.15.78:6789/0 conn(0x7f1ab015c8c0 legacy=0x7f1ab0073ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f1aafe00640 1 -- 172.21.15.78:0/3114623775 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab01593e0 con 0x7f1ab015ccd0 2024-05-21T14:43:29.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f1aaf400640 1 --2- 172.21.15.78:0/3114623775 >> v2:172.21.15.78:3300/0 conn(0x7f1ab014fce0 0x7f1ab0071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:29.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f5206000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5200151da0 0x7f52000c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f1df3200640 1 Processor -- start 2024-05-21T14:43:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f5206000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f52000c7b10 0x7f5200157b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f5206000640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5200073480 con 0x7f52001580a0 2024-05-21T14:43:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f5206000640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f5200071930 con 0x7f52000c7b10 2024-05-21T14:43:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f5206000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f5200071c10 con 0x7f5200151da0 2024-05-21T14:43:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f51ffe00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f52000c7b10 0x7f5200157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f51ffe00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f52000c7b10 0x7f5200157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38510/0 (socket says 172.21.15.78:38510) 2024-05-21T14:43:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f51ffe00640 1 -- 172.21.15.78:0/2672675553 learned_addr learned my addr 172.21.15.78:0/2672675553 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f5204c00640 1 --2- 172.21.15.78:0/2672675553 >> v2:172.21.15.84:3300/0 conn(0x7f5200151da0 0x7f52000c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f51ffe00640 1 -- 172.21.15.78:0/2672675553 >> v2:172.21.15.84:3300/0 conn(0x7f5200151da0 msgr2=0x7f52000c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7fb5ea200640 1 Processor -- start 2024-05-21T14:43:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7fb5ea200640 1 -- start start 2024-05-21T14:43:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f51ffe00640 1 --2- 172.21.15.78:0/2672675553 >> v2:172.21.15.84:3300/0 conn(0x7f5200151da0 0x7f52000c75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f1df3200640 1 -- start start 2024-05-21T14:43:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f51ffe00640 1 -- 172.21.15.78:0/2672675553 >> v1:172.21.15.78:6789/0 conn(0x7f52001580a0 legacy=0x7f52001584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7f2425200640 1 Processor -- start 2024-05-21T14:43:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.709+0000 7f51ffe00640 1 -- 172.21.15.78:0/2672675553 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5200073700 con 0x7f52000c7b10 2024-05-21T14:43:29.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7f2425200640 1 -- start start 2024-05-21T14:43:29.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7f0303c00640 1 Processor -- start 2024-05-21T14:43:29.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7f1aafe00640 1 --2- 172.21.15.78:0/3114623775 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ab015ccd0 0x7f1ab0163c50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0159e90 tx=0x7f1aa801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25cc800d92a49679 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7f1aaea00640 1 -- 172.21.15.78:0/3114623775 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80b5070 con 0x7f1ab015ccd0 2024-05-21T14:43:29.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7f0303c00640 1 -- start start 2024-05-21T14:43:29.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7f1df3200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1de80e10c0 0x7f1de80df440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7f1aaea00640 1 -- 172.21.15.78:0/3114623775 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa80a8990 con 0x7f1ab015ccd0 2024-05-21T14:43:29.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7f1aaea00640 1 -- 172.21.15.78:0/3114623775 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80a8d60 con 0x7f1ab015ccd0 2024-05-21T14:43:29.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7f1df3200640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de8050420 con 0x7f1de80d9830 2024-05-21T14:43:29.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7fb5ea200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5e41581d0 0x7fb5e4151720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7f1df3200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de8006eb0 con 0x7f1de80df980 2024-05-21T14:43:29.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7f1df3200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1de8007190 con 0x7f1de80e10c0 2024-05-21T14:43:29.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7f1df2800640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1de80df980 0x7f1de80e9d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.78:34734/0 (socket says 172.21.15.78:34734) 2024-05-21T14:43:29.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7f1df2800640 1 -- 172.21.15.78:0/1531302850 learned_addr learned my addr 172.21.15.78:0/1531302850 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:29.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7fb5ea200640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e40c7670 con 0x7fb5e40c8ad0 2024-05-21T14:43:29.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7fb5ea200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e4071b60 con 0x7fb5e406c8e0 2024-05-21T14:43:29.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7fb5ea200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e4151c60 con 0x7fb5e41581d0 2024-05-21T14:43:29.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.713+0000 7fb5e3400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5e41581d0 0x7fb5e4151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7fb5e3400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5e41581d0 0x7fb5e4151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:55070/0 (socket says 172.21.15.78:55070) 2024-05-21T14:43:29.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7fb5e3400640 1 -- 172.21.15.78:0/2393450554 learned_addr learned my addr 172.21.15.78:0/2393450554 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:29.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f2425200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f24200c66e0 0x7f2420155b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1ab5000640 1 -- 172.21.15.78:0/3114623775 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ab015ccd0 msgr2=0x7f1ab0163c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1ab5000640 1 --2- 172.21.15.78:0/3114623775 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ab015ccd0 0x7f1ab0163c50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0159e90 tx=0x7f1aa801ec90 comp rx=0 tx=0).stop 2024-05-21T14:43:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df0a00640 1 -- 172.21.15.78:0/1531302850 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 227740642 0 0) 0x7f1de8006eb0 con 0x7f1de80df980 2024-05-21T14:43:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df0a00640 1 -- 172.21.15.78:0/1531302850 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dd4003530 con 0x7f1de80df980 2024-05-21T14:43:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df1400640 1 --2- 172.21.15.78:0/1531302850 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1de80e10c0 0x7f1de80df440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f2425200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24200cc6e0 0x7f24200ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f2425200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24200c71b0 con 0x7f24200c7970 2024-05-21T14:43:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f2425200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f24200c8b60 con 0x7f24200c66e0 2024-05-21T14:43:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f2425200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f24200c9920 con 0x7f24200cc6e0 2024-05-21T14:43:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1ab5000640 1 -- 172.21.15.78:0/3114623775 shutdown_connections 2024-05-21T14:43:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1ab5000640 1 --2- 172.21.15.78:0/3114623775 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ab015ccd0 0x7f1ab0163c50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1ab5000640 1 --2- 172.21.15.78:0/3114623775 >> v2:172.21.15.78:3300/0 conn(0x7f1ab014fce0 0x7f1ab0071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1ab5000640 1 -- 172.21.15.78:0/3114623775 >> 172.21.15.78:0/3114623775 conn(0x7f1ab006f520 msgr2=0x7f1ab00cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df0a00640 1 -- 172.21.15.78:0/1531302850 <== mon.1 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3427218532 0 0) 0x7f1dd4003530 con 0x7f1de80df980 2024-05-21T14:43:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df0a00640 1 -- 172.21.15.78:0/1531302850 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1de80e10c0 msgr2=0x7f1de80df440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df0a00640 1 --2- 172.21.15.78:0/1531302850 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1de80e10c0 0x7f1de80df440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df0a00640 1 -- 172.21.15.78:0/1531302850 >> v1:172.21.15.78:6789/0 conn(0x7f1de80d9830 legacy=0x7f1de80e09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df0a00640 1 -- 172.21.15.78:0/1531302850 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de8007470 con 0x7f1de80df980 2024-05-21T14:43:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df0a00640 1 -- 172.21.15.78:0/1531302850 <== mon.1 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7f1dec068700 con 0x7f1de80df980 2024-05-21T14:43:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df0a00640 1 -- 172.21.15.78:0/1531302850 >> v1:172.21.15.84:6789/0 conn(0x7f1de80df980 legacy=0x7f1de80e9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df0a00640 1 --2- 172.21.15.78:0/1531302850 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1dd40039c0 0x7f1dd4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df0a00640 1 --2- 172.21.15.78:0/1531302850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dd4004810 0x7f1dd4004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df0a00640 1 --2- 172.21.15.78:0/1531302850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd4005160 0x7f1dd400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df0a00640 1 -- 172.21.15.78:0/1531302850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1de8007190 con 0x7f1dd4005160 2024-05-21T14:43:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df0a00640 1 -- 172.21.15.78:0/1531302850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd400c050 con 0x7f1dd4004810 2024-05-21T14:43:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df0a00640 1 -- 172.21.15.78:0/1531302850 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1dd400c250 con 0x7f1dd40039c0 2024-05-21T14:43:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f241ea00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24200cc6e0 0x7f24200ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f241fe00640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f24200c7970 0x7f24200c7d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.78:34758/0 (socket says 172.21.15.78:34758) 2024-05-21T14:43:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f241fe00640 1 -- 172.21.15.78:0/1351830744 learned_addr learned my addr 172.21.15.78:0/1351830744 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7fb5e3400640 1 -- 172.21.15.78:0/2393450554 >> v1:172.21.15.84:6789/0 conn(0x7fb5e406c8e0 legacy=0x7fb5e40c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7fb5e3400640 1 -- 172.21.15.78:0/2393450554 >> v1:172.21.15.78:6789/0 conn(0x7fb5e40c8ad0 legacy=0x7fb5e4162960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7fb5e3400640 1 -- 172.21.15.78:0/2393450554 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e40c78e0 con 0x7fb5e41581d0 2024-05-21T14:43:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1ab5000640 1 -- 172.21.15.78:0/3114623775 shutdown_connections 2024-05-21T14:43:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f241f400640 1 --2- 172.21.15.78:0/1351830744 >> v2:172.21.15.78:3300/0 conn(0x7f24200c66e0 0x7f2420155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df1e00640 1 --2- 172.21.15.78:0/1531302850 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1dd40039c0 0x7f1dd4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df1400640 1 --2- 172.21.15.78:0/1531302850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dd4004810 0x7f1dd4004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df2800640 1 --2- 172.21.15.78:0/1531302850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd4005160 0x7f1dd400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f241e000640 1 -- 172.21.15.78:0/1351830744 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2051556721 0 0) 0x7f24200c71b0 con 0x7f24200c7970 2024-05-21T14:43:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f241e000640 1 -- 172.21.15.78:0/1351830744 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2404003530 con 0x7f24200c7970 2024-05-21T14:43:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1ab5000640 1 -- 172.21.15.78:0/3114623775 wait complete. 2024-05-21T14:43:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f51ffe00640 1 --2- 172.21.15.78:0/2672675553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52000c7b10 0x7f5200157b60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f52000c3fa0 tx=0x7f51f401fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e890b55846a43420 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f241ea00640 1 -- 172.21.15.78:0/1351830744 >> v2:172.21.15.78:3300/0 conn(0x7f24200c66e0 msgr2=0x7f2420155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f241ea00640 1 --2- 172.21.15.78:0/1351830744 >> v2:172.21.15.78:3300/0 conn(0x7f24200c66e0 0x7f2420155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df1400640 1 -- 172.21.15.78:0/1531302850 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1dd40039c0 msgr2=0x7f1dd4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df1400640 1 --2- 172.21.15.78:0/1531302850 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1dd40039c0 0x7f1dd4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df1400640 1 -- 172.21.15.78:0/1531302850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd4005160 msgr2=0x7f1dd400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df1400640 1 --2- 172.21.15.78:0/1531302850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd4005160 0x7f1dd400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f1df1400640 1 -- 172.21.15.78:0/1531302850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de8007470 con 0x7f1dd4004810 2024-05-21T14:43:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f51ff400640 1 -- 172.21.15.78:0/2672675553 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f40b6070 con 0x7f52000c7b10 2024-05-21T14:43:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f51ff400640 1 -- 172.21.15.78:0/2672675553 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f40a9b30 con 0x7f52000c7b10 2024-05-21T14:43:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f51ff400640 1 -- 172.21.15.78:0/2672675553 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f40b1440 con 0x7f52000c7b10 2024-05-21T14:43:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f241e000640 1 -- 172.21.15.78:0/1351830744 <== mon.1 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3668499529 0 0) 0x7f2404003530 con 0x7f24200c7970 2024-05-21T14:43:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f241ea00640 1 -- 172.21.15.78:0/1351830744 >> v1:172.21.15.84:6789/0 conn(0x7f24200c7970 legacy=0x7f24200c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f241ea00640 1 -- 172.21.15.78:0/1351830744 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24200c8d90 con 0x7f24200cc6e0 2024-05-21T14:43:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.717+0000 7f7cd2a00640 1 Processor -- start 2024-05-21T14:43:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f7cd2a00640 1 -- start start 2024-05-21T14:43:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f0303c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f02fc0c5e70 0x7f02fc0c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f0301200640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f02fc06b8b0 0x7f02fc0c5760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57532/0 (socket says 172.21.15.78:57532) 2024-05-21T14:43:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f0301200640 1 -- 172.21.15.78:0/402779003 learned_addr learned my addr 172.21.15.78:0/402779003 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f5206000640 1 -- 172.21.15.78:0/2672675553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52000c7b10 msgr2=0x7f5200157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f5206000640 1 --2- 172.21.15.78:0/2672675553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52000c7b10 0x7f5200157b60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f52000c3fa0 tx=0x7f51f401fd20 comp rx=0 tx=0).stop 2024-05-21T14:43:29.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f5206000640 1 -- 172.21.15.78:0/2672675553 shutdown_connections 2024-05-21T14:43:29.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f5206000640 1 --2- 172.21.15.78:0/2672675553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52000c7b10 0x7f5200157b60 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f52000c3fa0 tx=0x7f51f401fd20 comp rx=0 tx=0).stop 2024-05-21T14:43:29.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f5206000640 1 --2- 172.21.15.78:0/2672675553 >> v2:172.21.15.84:3300/0 conn(0x7f5200151da0 0x7f52000c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f5206000640 1 -- 172.21.15.78:0/2672675553 >> 172.21.15.78:0/2672675553 conn(0x7f52000c96d0 msgr2=0x7f52000c9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:29.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f0303c00640 1 -- 172.21.15.78:0/402779003 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02fc15fc70 con 0x7f02fc06b8b0 2024-05-21T14:43:29.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7fb5e3400640 1 --2- 172.21.15.78:0/2393450554 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5e41581d0 0x7fb5e4151720 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00098a0 tx=0x7fb5d001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d1e7b9ee4147542 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7fb5e2000640 1 -- 172.21.15.78:0/2393450554 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d00a9620 con 0x7fb5e41581d0 2024-05-21T14:43:29.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02f3e00640 1 --2- 172.21.15.78:0/402779003 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f02fc0c5e70 0x7f02fc0c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f0303c00640 1 -- 172.21.15.78:0/402779003 --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02fc15fef0 con 0x7f02fc0c7890 2024-05-21T14:43:29.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f0303c00640 1 -- 172.21.15.78:0/402779003 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f02fc1601d0 con 0x7f02fc0c5e70 2024-05-21T14:43:29.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7fb5e2000640 1 -- 172.21.15.78:0/2393450554 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5d00a97c0 con 0x7fb5e41581d0 2024-05-21T14:43:29.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7fb5e2000640 1 -- 172.21.15.78:0/2393450554 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d00a9b90 con 0x7fb5e41581d0 2024-05-21T14:43:29.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02fbe00640 1 -- 172.21.15.78:0/402779003 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4096537673 0 0) 0x7f02e4001120 con 0x7f02fc06b8b0 2024-05-21T14:43:29.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02fbe00640 1 -- 172.21.15.78:0/402779003 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02e0003530 con 0x7f02fc06b8b0 2024-05-21T14:43:29.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f1ab5000640 1 Processor -- start 2024-05-21T14:43:29.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02fbe00640 1 -- 172.21.15.78:0/402779003 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 888667178 0 0) 0x7f02fc15fef0 con 0x7f02fc0c7890 2024-05-21T14:43:29.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f1ab5000640 1 -- start start 2024-05-21T14:43:29.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02fbe00640 1 -- 172.21.15.78:0/402779003 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02e4001120 con 0x7f02fc0c7890 2024-05-21T14:43:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02fbe00640 1 -- 172.21.15.78:0/402779003 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 730323098 0 0) 0x7f02e0003530 con 0x7f02fc06b8b0 2024-05-21T14:43:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02fbe00640 1 -- 172.21.15.78:0/402779003 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f02fc0c5e70 msgr2=0x7f02fc0c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7fb5ea200640 1 -- 172.21.15.78:0/2393450554 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5e41581d0 msgr2=0x7fb5e4151720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7fb5ea200640 1 --2- 172.21.15.78:0/2393450554 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5e41581d0 0x7fb5e4151720 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00098a0 tx=0x7fb5d001c540 comp rx=0 tx=0).stop 2024-05-21T14:43:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02fbe00640 1 --2- 172.21.15.78:0/402779003 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f02fc0c5e70 0x7f02fc0c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f7cd2a00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7cc40e5340 0x7f7cc40e7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f7cd2a00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cc4047540 con 0x7f7cc404c8e0 2024-05-21T14:43:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f7cd2a00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cc40461c0 con 0x7f7cc40db2b0 2024-05-21T14:43:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f7cd2a00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc4006980 con 0x7f7cc40e5340 2024-05-21T14:43:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02fbe00640 1 -- 172.21.15.78:0/402779003 >> v1:172.21.15.84:6789/0 conn(0x7f02fc0c7890 legacy=0x7f02fc16a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02fbe00640 1 -- 172.21.15.78:0/402779003 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02fc1604b0 con 0x7f02fc06b8b0 2024-05-21T14:43:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02fbe00640 1 -- 172.21.15.78:0/402779003 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7f02e4001850 con 0x7f02fc06b8b0 2024-05-21T14:43:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02fbe00640 1 -- 172.21.15.78:0/402779003 >> v1:172.21.15.78:6789/0 conn(0x7f02fc06b8b0 legacy=0x7f02fc0c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02fbe00640 1 --2- 172.21.15.78:0/402779003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02e0003bf0 0x7f02e0004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02fbe00640 1 --2- 172.21.15.78:0/402779003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02e0004810 0x7f02e0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02fbe00640 1 --2- 172.21.15.78:0/402779003 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f02e0005220 0x7f02e000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02fbe00640 1 -- 172.21.15.78:0/402779003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc1601d0 con 0x7f02e0004810 2024-05-21T14:43:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02fbe00640 1 -- 172.21.15.78:0/402779003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f02e000c100 con 0x7f02e0003bf0 2024-05-21T14:43:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f02fbe00640 1 -- 172.21.15.78:0/402779003 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f02e000c300 con 0x7f02e0005220 2024-05-21T14:43:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f7cd2000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7cc40e5340 0x7f7cc40e7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f7cd2000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7cc40e5340 0x7f7cc40e7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:55110/0 (socket says 172.21.15.78:55110) 2024-05-21T14:43:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f7cd2000640 1 -- 172.21.15.78:0/2432996008 learned_addr learned my addr 172.21.15.78:0/2432996008 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.721+0000 7f0301c00640 1 --2- 172.21.15.78:0/402779003 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f02e0005220 0x7f02e000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f0301200640 1 --2- 172.21.15.78:0/402779003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02e0003bf0 0x7f02e0004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1df1400640 1 --2- 172.21.15.78:0/1531302850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dd4004810 0x7f1dd4004c20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1de80123f0 tx=0x7f1ddc01c580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a47357248f0d045 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7fb5ea200640 1 -- 172.21.15.78:0/2393450554 shutdown_connections 2024-05-21T14:43:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7fb5ea200640 1 --2- 172.21.15.78:0/2393450554 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5e41581d0 0x7fb5e4151720 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7fb5ea200640 1 -- 172.21.15.78:0/2393450554 >> 172.21.15.78:0/2393450554 conn(0x7fb5e40ccbd0 msgr2=0x7fb5e40ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f5206000640 1 -- 172.21.15.78:0/2672675553 shutdown_connections 2024-05-21T14:43:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f7ccbe00640 1 -- 172.21.15.78:0/2432996008 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1920530062 0 0) 0x7f7cc40461c0 con 0x7f7cc40db2b0 2024-05-21T14:43:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f7ccbe00640 1 -- 172.21.15.78:0/2432996008 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cb4003530 con 0x7f7cc40db2b0 2024-05-21T14:43:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f7cd2000640 1 -- 172.21.15.78:0/2432996008 >> v1:172.21.15.84:6789/0 conn(0x7f7cc40db2b0 legacy=0x7f7cc40e3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f7cd2000640 1 -- 172.21.15.78:0/2432996008 >> v1:172.21.15.78:6789/0 conn(0x7f7cc404c8e0 legacy=0x7f7cc404bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f7cd2000640 1 -- 172.21.15.78:0/2432996008 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc40464a0 con 0x7f7cc40e5340 2024-05-21T14:43:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7fb5ea200640 1 -- 172.21.15.78:0/2393450554 shutdown_connections 2024-05-21T14:43:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7fb5ea200640 1 -- 172.21.15.78:0/2393450554 wait complete. 2024-05-21T14:43:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f0301c00640 1 -- 172.21.15.78:0/402779003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02e0003bf0 msgr2=0x7f02e0004040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f0301c00640 1 --2- 172.21.15.78:0/402779003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02e0003bf0 0x7f02e0004040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f0301c00640 1 -- 172.21.15.78:0/402779003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02e0004810 msgr2=0x7f02e0004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f0301c00640 1 --2- 172.21.15.78:0/402779003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02e0004810 0x7f02e0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f0301c00640 1 -- 172.21.15.78:0/402779003 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02fc1604b0 con 0x7f02e0005220 2024-05-21T14:43:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f0301200640 1 --2- 172.21.15.78:0/402779003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02e0003bf0 0x7f02e0004040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1ab5000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ab014fce0 0x7f1ab0156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1df0a00640 1 -- 172.21.15.78:0/1531302850 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc00b550 con 0x7f1dd4004810 2024-05-21T14:43:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1df0a00640 1 -- 172.21.15.78:0/1531302850 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ddc0b1070 con 0x7f1dd4004810 2024-05-21T14:43:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1df0a00640 1 -- 172.21.15.78:0/1531302850 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc0ac890 con 0x7f1dd4004810 2024-05-21T14:43:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1df3200640 1 -- 172.21.15.78:0/1531302850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dd4004810 msgr2=0x7f1dd4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1df3200640 1 --2- 172.21.15.78:0/1531302850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dd4004810 0x7f1dd4004c20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1de80123f0 tx=0x7f1ddc01c580 comp rx=0 tx=0).stop 2024-05-21T14:43:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1df2800640 1 -- 172.21.15.78:0/1531302850 reap_dead start 2024-05-21T14:43:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1df3200640 1 -- 172.21.15.78:0/1531302850 shutdown_connections 2024-05-21T14:43:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1df3200640 1 -- 172.21.15.78:0/1531302850 >> 172.21.15.78:0/1531302850 conn(0x7f1de8054850 msgr2=0x7f1de8054c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1df3200640 1 -- 172.21.15.78:0/1531302850 shutdown_connections 2024-05-21T14:43:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1df3200640 1 -- 172.21.15.78:0/1531302850 wait complete. 2024-05-21T14:43:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7fb5ea200640 1 Processor -- start 2024-05-21T14:43:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1ab5000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ab015c8c0 0x7f1ab01f9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1ab5000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ab015ccd0 0x7f1ab00c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1aa6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ab015c8c0 0x7f1ab01f9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1aaf400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ab014fce0 0x7f1ab0156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1ab5000640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab006c870 con 0x7f1ab015ccd0 2024-05-21T14:43:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1ab5000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab01599a0 con 0x7f1ab015c8c0 2024-05-21T14:43:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1ab5000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab015a1a0 con 0x7f1ab014fce0 2024-05-21T14:43:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1aaf400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ab014fce0 0x7f1ab0156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:55122/0 (socket says 172.21.15.78:55122) 2024-05-21T14:43:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1aaf400640 1 -- 172.21.15.78:0/697013329 learned_addr learned my addr 172.21.15.78:0/697013329 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f1aafe00640 1 --2- 172.21.15.78:0/697013329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ab015ccd0 0x7f1ab00c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7f1aa6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ab015c8c0 0x7f1ab01f9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:42884/0 (socket says 172.21.15.78:42884) 2024-05-21T14:43:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f1aaf400640 1 -- 172.21.15.78:0/697013329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ab015c8c0 msgr2=0x7f1ab01f9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f1aaf400640 1 --2- 172.21.15.78:0/697013329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ab015c8c0 0x7f1ab01f9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f1aaf400640 1 -- 172.21.15.78:0/697013329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ab015ccd0 msgr2=0x7f1ab00c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f1aaf400640 1 --2- 172.21.15.78:0/697013329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ab015ccd0 0x7f1ab00c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f1aaf400640 1 -- 172.21.15.78:0/697013329 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab01f9e90 con 0x7f1ab014fce0 2024-05-21T14:43:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f1aa6a00640 1 --2- 172.21.15.78:0/697013329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ab015c8c0 0x7f1ab01f9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f1aafe00640 1 --2- 172.21.15.78:0/697013329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ab015ccd0 0x7f1ab00c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:43:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.725+0000 7fb5ea200640 1 -- start start 2024-05-21T14:43:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f1aaf400640 1 --2- 172.21.15.78:0/697013329 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ab014fce0 0x7f1ab0156320 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000d0d0 tx=0x7f1aa000d590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7fb5ea200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5e406c8e0 0x7fb5e4159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7fb5ea200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5e40c8ad0 0x7fb5e41f6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f1aa7e00640 1 -- 172.21.15.78:0/697013329 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa001a070 con 0x7f1ab014fce0 2024-05-21T14:43:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f1aa7e00640 1 -- 172.21.15.78:0/697013329 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa0015600 con 0x7f1ab014fce0 2024-05-21T14:43:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f1aa7e00640 1 -- 172.21.15.78:0/697013329 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa00159b0 con 0x7f1ab014fce0 2024-05-21T14:43:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7fb5ea200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5e41581d0 0x7fb5e41f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7fb5e8c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5e41581d0 0x7fb5e41f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7fb5e8c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5e41581d0 0x7fb5e41f6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38562/0 (socket says 172.21.15.78:38562) 2024-05-21T14:43:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7fb5e2a00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5e40c8ad0 0x7fb5e41f6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7fb5e8c00640 1 -- 172.21.15.78:0/4178545572 learned_addr learned my addr 172.21.15.78:0/4178545572 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7fb5ea200640 1 -- 172.21.15.78:0/4178545572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e40c7010 con 0x7fb5e41581d0 2024-05-21T14:43:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7fb5ea200640 1 -- 172.21.15.78:0/4178545572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e40718d0 con 0x7fb5e406c8e0 2024-05-21T14:43:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7fb5ea200640 1 -- 172.21.15.78:0/4178545572 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e41585e0 con 0x7fb5e40c8ad0 2024-05-21T14:43:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f5206000640 1 -- 172.21.15.78:0/2672675553 wait complete. 2024-05-21T14:43:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7fb5e3400640 1 --2- 172.21.15.78:0/4178545572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5e406c8e0 0x7fb5e4159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7fb5e8c00640 1 -- 172.21.15.78:0/4178545572 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5e40c8ad0 msgr2=0x7fb5e41f6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7fb5e8c00640 1 --2- 172.21.15.78:0/4178545572 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5e40c8ad0 0x7fb5e41f6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7fb5e8c00640 1 -- 172.21.15.78:0/4178545572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5e406c8e0 msgr2=0x7fb5e4159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f0301c00640 1 --2- 172.21.15.78:0/402779003 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f02e0005220 0x7f02e000b9d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f02fc0c4280 tx=0x7f02f401f030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e3bda88de21a744 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f1ab5000640 1 -- 172.21.15.78:0/697013329 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab0153d60 con 0x7f1ab014fce0 2024-05-21T14:43:29.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7fb5e8c00640 1 --2- 172.21.15.78:0/4178545572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5e406c8e0 0x7fb5e4159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7fb5e8c00640 1 -- 172.21.15.78:0/4178545572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e415a190 con 0x7fb5e41581d0 2024-05-21T14:43:29.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f1ab5000640 1 -- 172.21.15.78:0/697013329 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab01542e0 con 0x7f1ab014fce0 2024-05-21T14:43:29.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f241ea00640 1 --2- 172.21.15.78:0/1351830744 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24200cc6e0 0x7f24200ccaf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f240c0097c0 tx=0x7f240c01ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec8f4b95b51d1e80 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f1df3200640 1 Processor -- start 2024-05-21T14:43:29.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.729+0000 7f02fbe00640 1 -- 172.21.15.78:0/402779003 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4001c10 con 0x7f02e0005220 2024-05-21T14:43:29.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f7cd2000640 1 --2- 172.21.15.78:0/2432996008 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7cc40e5340 0x7f7cc40e7760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00098a0 tx=0x7f7cc001e8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67b987c9ec211ca server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f1df3200640 1 -- start start 2024-05-21T14:43:29.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f1df3200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd4004810 0x7f1de800baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f1df3200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1de800db80 0x7f1de80d7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f1df3200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de80d80b0 0x7f1de8170f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f1df3200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1de8048090 con 0x7f1dd4004810 2024-05-21T14:43:29.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f1df3200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1de8007a30 con 0x7f1de80d80b0 2024-05-21T14:43:29.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f1df3200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1de80506d0 con 0x7f1de800db80 2024-05-21T14:43:29.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7fb5e8c00640 1 --2- 172.21.15.78:0/4178545572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5e41581d0 0x7fb5e41f6ea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00b9e0 tx=0x7fb5dc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7fb5d7400640 1 -- 172.21.15.78:0/4178545572 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc019070 con 0x7fb5e41581d0 2024-05-21T14:43:29.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7fb5d7400640 1 -- 172.21.15.78:0/4178545572 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5dc00cb20 con 0x7fb5e41581d0 2024-05-21T14:43:29.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7fb5d7400640 1 -- 172.21.15.78:0/4178545572 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc014440 con 0x7fb5e41581d0 2024-05-21T14:43:29.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7fb5ea200640 1 -- 172.21.15.78:0/4178545572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e41520c0 con 0x7fb5e41581d0 2024-05-21T14:43:29.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7fb5ea200640 1 -- 172.21.15.78:0/4178545572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e4159450 con 0x7fb5e41581d0 2024-05-21T14:43:29.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7fb5ea200640 1 -- 172.21.15.78:0/4178545572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c00052a0 con 0x7fb5e41581d0 2024-05-21T14:43:29.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7fb5d7400640 1 -- 172.21.15.78:0/4178545572 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb5dc01c070 con 0x7fb5e41581d0 2024-05-21T14:43:29.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f5206000640 1 Processor -- start 2024-05-21T14:43:29.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f5206000640 1 -- start start 2024-05-21T14:43:29.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f5206000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5200151da0 0x7f5200147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f5206000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52001580a0 0x7f52001677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f241e000640 1 -- 172.21.15.78:0/1351830744 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c0b5070 con 0x7f24200cc6e0 2024-05-21T14:43:29.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f241e000640 1 -- 172.21.15.78:0/1351830744 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f240c0a85f0 con 0x7f24200cc6e0 2024-05-21T14:43:29.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f241e000640 1 -- 172.21.15.78:0/1351830744 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2418001a00 con 0x7f24200cc6e0 2024-05-21T14:43:29.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f1ab5000640 1 -- 172.21.15.78:0/697013329 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab004f730 con 0x7f1ab014fce0 2024-05-21T14:43:29.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f02fbe00640 1 -- 172.21.15.78:0/402779003 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f40a8c50 con 0x7f02e0005220 2024-05-21T14:43:29.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f02fbe00640 1 -- 172.21.15.78:0/402779003 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4003980 con 0x7f02e0005220 2024-05-21T14:43:29.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f0303c00640 1 -- 172.21.15.78:0/402779003 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f02e0005220 msgr2=0x7f02e000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f0303c00640 1 --2- 172.21.15.78:0/402779003 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f02e0005220 0x7f02e000b9d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f02fc0c4280 tx=0x7f02f401f030 comp rx=0 tx=0).stop 2024-05-21T14:43:29.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f0301c00640 1 -- 172.21.15.78:0/402779003 reap_dead start 2024-05-21T14:43:29.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f0303c00640 1 -- 172.21.15.78:0/402779003 shutdown_connections 2024-05-21T14:43:29.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f0303c00640 1 -- 172.21.15.78:0/402779003 >> 172.21.15.78:0/402779003 conn(0x7f02fc0cd1e0 msgr2=0x7f02fc0c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:29.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f0303c00640 1 -- 172.21.15.78:0/402779003 shutdown_connections 2024-05-21T14:43:29.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f0303c00640 1 -- 172.21.15.78:0/402779003 wait complete. 2024-05-21T14:43:29.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f7ccbe00640 1 -- 172.21.15.78:0/2432996008 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00b4070 con 0x7f7cc40e5340 2024-05-21T14:43:29.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f7ccbe00640 1 -- 172.21.15.78:0/2432996008 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc00a77e0 con 0x7f7cc40e5340 2024-05-21T14:43:29.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f7ccbe00640 1 -- 172.21.15.78:0/2432996008 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00a7b90 con 0x7f7cc40e5340 2024-05-21T14:43:29.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f7cd2a00640 1 -- 172.21.15.78:0/2432996008 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7cc40e5340 msgr2=0x7f7cc40e7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f7cd2a00640 1 --2- 172.21.15.78:0/2432996008 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7cc40e5340 0x7f7cc40e7760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00098a0 tx=0x7f7cc001e8a0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f7cd2a00640 1 -- 172.21.15.78:0/2432996008 shutdown_connections 2024-05-21T14:43:29.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f7cd2a00640 1 --2- 172.21.15.78:0/2432996008 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7cc40e5340 0x7f7cc40e7760 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f7cd2a00640 1 -- 172.21.15.78:0/2432996008 >> 172.21.15.78:0/2432996008 conn(0x7f7cc40503c0 msgr2=0x7f7cc40507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:29.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f7cd2a00640 1 -- 172.21.15.78:0/2432996008 shutdown_connections 2024-05-21T14:43:29.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f7cd2a00640 1 -- 172.21.15.78:0/2432996008 wait complete. 2024-05-21T14:43:29.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f2425200640 1 -- 172.21.15.78:0/1351830744 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24200cc6e0 msgr2=0x7f24200ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f2425200640 1 --2- 172.21.15.78:0/1351830744 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24200cc6e0 0x7f24200ccaf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f240c0097c0 tx=0x7f240c01ebb0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f1df1400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1de800db80 0x7f1de80d7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f1df1400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1de800db80 0x7f1de80d7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:55136/0 (socket says 172.21.15.78:55136) 2024-05-21T14:43:29.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f1df1400640 1 -- 172.21.15.78:0/1662040946 learned_addr learned my addr 172.21.15.78:0/1662040946 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:29.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f1df1400640 1 -- 172.21.15.78:0/1662040946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de80d80b0 msgr2=0x7f1de8170f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-21T14:43:29.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f1df1400640 1 --2- 172.21.15.78:0/1662040946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de80d80b0 0x7f1de8170f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f1df1400640 1 -- 172.21.15.78:0/1662040946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd4004810 msgr2=0x7f1de800baf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-21T14:43:29.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f1df1400640 1 --2- 172.21.15.78:0/1662040946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd4004810 0x7f1de800baf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.733+0000 7f1df1400640 1 -- 172.21.15.78:0/1662040946 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de800c030 con 0x7f1de800db80 2024-05-21T14:43:29.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f1df1400640 1 --2- 172.21.15.78:0/1662040946 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1de800db80 0x7f1de80d7b70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0ae040 tx=0x7f1dd4005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f1de6000640 1 -- 172.21.15.78:0/1662040946 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc00b550 con 0x7f1de800db80 2024-05-21T14:43:29.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f1de6000640 1 -- 172.21.15.78:0/1662040946 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ddc003de0 con 0x7f1de800db80 2024-05-21T14:43:29.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f1de6000640 1 -- 172.21.15.78:0/1662040946 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc0ac670 con 0x7f1de800db80 2024-05-21T14:43:29.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f0303c00640 1 Processor -- start 2024-05-21T14:43:29.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f2425200640 1 -- 172.21.15.78:0/1351830744 shutdown_connections 2024-05-21T14:43:29.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f2425200640 1 --2- 172.21.15.78:0/1351830744 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24200cc6e0 0x7f24200ccaf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f2425200640 1 --2- 172.21.15.78:0/1351830744 >> v2:172.21.15.78:3300/0 conn(0x7f24200c66e0 0x7f2420155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f2425200640 1 -- 172.21.15.78:0/1351830744 >> 172.21.15.78:0/1351830744 conn(0x7f242006b7f0 msgr2=0x7f242006bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:29.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7fb5d7400640 1 --2- 172.21.15.78:0/4178545572 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb5c4067910 0x7fb5c4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7fb5d7400640 1 -- 172.21.15.78:0/4178545572 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb5dc0859a0 con 0x7fb5e41581d0 2024-05-21T14:43:29.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7fb5e3400640 1 --2- 172.21.15.78:0/4178545572 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb5c4067910 0x7fb5c4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f5204c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5200151da0 0x7f5200147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f5204c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5200151da0 0x7f5200147020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:55152/0 (socket says 172.21.15.78:55152) 2024-05-21T14:43:29.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f0303c00640 1 -- start start 2024-05-21T14:43:29.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f2425200640 1 -- 172.21.15.78:0/1351830744 shutdown_connections 2024-05-21T14:43:29.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f2425200640 1 -- 172.21.15.78:0/1351830744 wait complete. 2024-05-21T14:43:29.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f7cd2a00640 1 Processor -- start 2024-05-21T14:43:29.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f7cd2a00640 1 -- start start 2024-05-21T14:43:29.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f1aa7e00640 1 -- 172.21.15.78:0/697013329 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1aa001d070 con 0x7f1ab014fce0 2024-05-21T14:43:29.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f1aa7e00640 1 --2- 172.21.15.78:0/697013329 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1a8c067990 0x7f1a8c069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f1aa7e00640 1 -- 172.21.15.78:0/697013329 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1aa0086000 con 0x7f1ab014fce0 2024-05-21T14:43:29.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f1aa6a00640 1 --2- 172.21.15.78:0/697013329 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1a8c067990 0x7f1a8c069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f1df3200640 1 -- 172.21.15.78:0/1662040946 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de80dcb70 con 0x7f1de800db80 2024-05-21T14:43:29.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f1df3200640 1 -- 172.21.15.78:0/1662040946 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de80dc230 con 0x7f1de800db80 2024-05-21T14:43:29.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f5204c00640 1 -- 172.21.15.78:0/3894937636 learned_addr learned my addr 172.21.15.78:0/3894937636 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:29.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7f5206000640 1 --2- 172.21.15.78:0/3894937636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5200154870 0x7f5200152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f5206000640 1 -- 172.21.15.78:0/3894937636 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f52001521b0 con 0x7f52001580a0 2024-05-21T14:43:29.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f5206000640 1 -- 172.21.15.78:0/3894937636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f52000c7f20 con 0x7f5200154870 2024-05-21T14:43:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f5206000640 1 -- 172.21.15.78:0/3894937636 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f520006c4d0 con 0x7f5200151da0 2024-05-21T14:43:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f5205600640 1 --2- 172.21.15.78:0/3894937636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5200154870 0x7f5200152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f5204c00640 1 -- 172.21.15.78:0/3894937636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5200154870 msgr2=0x7f5200152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f5204c00640 1 --2- 172.21.15.78:0/3894937636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5200154870 0x7f5200152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f5204c00640 1 -- 172.21.15.78:0/3894937636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52001580a0 msgr2=0x7f52001677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f51ffe00640 1 --2- 172.21.15.78:0/3894937636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52001580a0 0x7f52001677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f5204c00640 1 --2- 172.21.15.78:0/3894937636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52001580a0 0x7f52001677e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f5204c00640 1 -- 172.21.15.78:0/3894937636 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5200152450 con 0x7f5200151da0 2024-05-21T14:43:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.737+0000 7fb5e3400640 1 --2- 172.21.15.78:0/4178545572 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb5c4067910 0x7fb5c4069e20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00ae000 tx=0x7fb5d00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f5204c00640 1 --2- 172.21.15.78:0/3894937636 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5200151da0 0x7f5200147020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00c7f0 tx=0x7f51ec00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f1aa6a00640 1 --2- 172.21.15.78:0/697013329 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1a8c067990 0x7f1a8c069ea0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1a98007fd0 tx=0x7f1a98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cc404c8e0 0x7f7cc40c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f0303c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f02e0005220 0x7f02fc0cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f0303c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02fc15b7a0 0x7f02fc15bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f0303c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02fc15a0a0 0x7f02fc15a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f0303c00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc0c3810 con 0x7f02fc15b7a0 2024-05-21T14:43:29.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f0303c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc0c7ca0 con 0x7f02fc15a0a0 2024-05-21T14:43:29.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f0303c00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f02fc0c3990 con 0x7f02e0005220 2024-05-21T14:43:29.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd2a00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7cc40db2b0 0x7f7cc40e5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f0301200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f02e0005220 0x7f02fc0cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd2a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc40e5340 0x7f7cc40ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd2a00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc40341b0 con 0x7f7cc40e5340 2024-05-21T14:43:29.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd2a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc4047020 con 0x7f7cc404c8e0 2024-05-21T14:43:29.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd2a00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc4034490 con 0x7f7cc40db2b0 2024-05-21T14:43:29.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd1600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cc404c8e0 0x7f7cc40c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd1600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cc404c8e0 0x7f7cc40c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:42908/0 (socket says 172.21.15.78:42908) 2024-05-21T14:43:29.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd1600640 1 -- 172.21.15.78:0/2651782354 learned_addr learned my addr 172.21.15.78:0/2651782354 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:29.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f0301200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f02e0005220 0x7f02fc0cb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:55154/0 (socket says 172.21.15.78:55154) 2024-05-21T14:43:29.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f0301200640 1 -- 172.21.15.78:0/2773238862 learned_addr learned my addr 172.21.15.78:0/2773238862 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:29.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd2000640 1 --2- 172.21.15.78:0/2651782354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc40e5340 0x7f7cc40ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd0c00640 1 --2- 172.21.15.78:0/2651782354 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7cc40db2b0 0x7f7cc40e5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd1600640 1 -- 172.21.15.78:0/2651782354 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7cc40db2b0 msgr2=0x7f7cc40e5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f0301200640 1 -- 172.21.15.78:0/2773238862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02fc15a0a0 msgr2=0x7f02fc15a4b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-21T14:43:29.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f0301200640 1 --2- 172.21.15.78:0/2773238862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02fc15a0a0 0x7f02fc15a4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f0301200640 1 -- 172.21.15.78:0/2773238862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02fc15b7a0 msgr2=0x7f02fc15bbb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-21T14:43:29.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f0301200640 1 --2- 172.21.15.78:0/2773238862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02fc15b7a0 0x7f02fc15bbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f0301200640 1 -- 172.21.15.78:0/2773238862 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02fc15c7e0 con 0x7f02e0005220 2024-05-21T14:43:29.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd1600640 1 --2- 172.21.15.78:0/2651782354 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7cc40db2b0 0x7f7cc40e5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd1600640 1 -- 172.21.15.78:0/2651782354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc40e5340 msgr2=0x7f7cc40ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd1600640 1 --2- 172.21.15.78:0/2651782354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc40e5340 0x7f7cc40ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd1600640 1 -- 172.21.15.78:0/2651782354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc404e240 con 0x7f7cc404c8e0 2024-05-21T14:43:29.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd0c00640 1 --2- 172.21.15.78:0/2651782354 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7cc40db2b0 0x7f7cc40e5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:43:29.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f2425200640 1 Processor -- start 2024-05-21T14:43:29.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f1df3200640 1 -- 172.21.15.78:0/1662040946 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1de8005900 con 0x7f1de800db80 2024-05-21T14:43:29.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f0301200640 1 --2- 172.21.15.78:0/2773238862 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f02e0005220 0x7f02fc0cb1d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f02e4007330 tx=0x7f02e40077f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f2425200640 1 -- start start 2024-05-21T14:43:29.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd1600640 1 --2- 172.21.15.78:0/2651782354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cc404c8e0 0x7f7cc40c66f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc065070 tx=0x7f7ccc068ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cc9600640 1 -- 172.21.15.78:0/2651782354 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc092070 con 0x7f7cc404c8e0 2024-05-21T14:43:29.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cc9600640 1 -- 172.21.15.78:0/2651782354 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ccc06b620 con 0x7f7cc404c8e0 2024-05-21T14:43:29.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cc9600640 1 -- 172.21.15.78:0/2651782354 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc06ba10 con 0x7f7cc404c8e0 2024-05-21T14:43:29.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.741+0000 7f7cd2a00640 1 -- 172.21.15.78:0/2651782354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc404e520 con 0x7f7cc404c8e0 2024-05-21T14:43:29.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f7cd2a00640 1 -- 172.21.15.78:0/2651782354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc404eae0 con 0x7f7cc404c8e0 2024-05-21T14:43:29.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f2425200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24200c66e0 0x7f2420149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f2425200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24200c7970 0x7f2420148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f241f400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24200c66e0 0x7f2420149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f7cd2a00640 1 -- 172.21.15.78:0/2651782354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cc40054b0 con 0x7f7cc404c8e0 2024-05-21T14:43:29.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f241f400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24200c66e0 0x7f2420149f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:55170/0 (socket says 172.21.15.78:55170) 2024-05-21T14:43:29.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f241ea00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24200c7970 0x7f2420148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f241f400640 1 -- 172.21.15.78:0/2876854024 learned_addr learned my addr 172.21.15.78:0/2876854024 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:29.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f2425200640 1 --2- 172.21.15.78:0/2876854024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24200cc6e0 0x7f2420148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f2425200640 1 -- 172.21.15.78:0/2876854024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f242015c730 con 0x7f24200c7970 2024-05-21T14:43:29.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f2425200640 1 -- 172.21.15.78:0/2876854024 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f24200c7450 con 0x7f24200cc6e0 2024-05-21T14:43:29.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f2425200640 1 -- 172.21.15.78:0/2876854024 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f24200c9ff0 con 0x7f24200c66e0 2024-05-21T14:43:29.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f241fe00640 1 --2- 172.21.15.78:0/2876854024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24200cc6e0 0x7f2420148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f241ea00640 1 -- 172.21.15.78:0/2876854024 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24200c66e0 msgr2=0x7f2420149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f241ea00640 1 --2- 172.21.15.78:0/2876854024 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24200c66e0 0x7f2420149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f241ea00640 1 -- 172.21.15.78:0/2876854024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24200cc6e0 msgr2=0x7f2420148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f241ea00640 1 --2- 172.21.15.78:0/2876854024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24200cc6e0 0x7f2420148780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f241ea00640 1 -- 172.21.15.78:0/2876854024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2420148cc0 con 0x7f24200c7970 2024-05-21T14:43:29.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f241f400640 1 --2- 172.21.15.78:0/2876854024 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24200c66e0 0x7f2420149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:29.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f241ea00640 1 --2- 172.21.15.78:0/2876854024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24200c7970 0x7f2420148240 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f24200c7380 tx=0x7f240c01b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f7cc9600640 1 -- 172.21.15.78:0/2651782354 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7ccc06bbb0 con 0x7f7cc404c8e0 2024-05-21T14:43:29.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f7cc9600640 1 --2- 172.21.15.78:0/2651782354 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7cac0678c0 0x7f7cac069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f7cc9600640 1 -- 172.21.15.78:0/2651782354 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7ccc100d70 con 0x7f7cc404c8e0 2024-05-21T14:43:29.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f7cd0c00640 1 --2- 172.21.15.78:0/2651782354 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7cac0678c0 0x7f7cac069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f2417400640 1 -- 172.21.15.78:0/2876854024 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c0bf070 con 0x7f24200c7970 2024-05-21T14:43:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f2417400640 1 -- 172.21.15.78:0/2876854024 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f240c0b0640 con 0x7f24200c7970 2024-05-21T14:43:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f2417400640 1 -- 172.21.15.78:0/2876854024 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c0b5040 con 0x7f24200c7970 2024-05-21T14:43:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.745+0000 7f2425200640 1 -- 172.21.15.78:0/2876854024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f242015a370 con 0x7f24200c7970 2024-05-21T14:43:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.749+0000 7f2425200640 1 -- 172.21.15.78:0/2876854024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f242015a930 con 0x7f24200c7970 2024-05-21T14:43:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.749+0000 7fb5d7400640 1 -- 172.21.15.78:0/4178545572 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb5dc0564c0 con 0x7fb5e41581d0 2024-05-21T14:43:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.749+0000 7f2425200640 1 -- 172.21.15.78:0/2876854024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2420069f30 con 0x7f24200c7970 2024-05-21T14:43:29.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.749+0000 7f7cd0c00640 1 --2- 172.21.15.78:0/2651782354 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7cac0678c0 0x7f7cac069dd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7cc404c1d0 tx=0x7f7cb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.749+0000 7f2417400640 1 -- 172.21.15.78:0/2876854024 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f240c0b0a30 con 0x7f24200c7970 2024-05-21T14:43:29.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.749+0000 7f2417400640 1 --2- 172.21.15.78:0/2876854024 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24000678f0 0x7f2400069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.753+0000 7f2417400640 1 -- 172.21.15.78:0/2876854024 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f240c1222e0 con 0x7f24200c7970 2024-05-21T14:43:29.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.753+0000 7f241f400640 1 --2- 172.21.15.78:0/2876854024 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24000678f0 0x7f2400069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.753+0000 7f1aa7e00640 1 -- 172.21.15.78:0/697013329 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1aa0010070 con 0x7f1ab014fce0 2024-05-21T14:43:29.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.753+0000 7f51fcc00640 1 -- 172.21.15.78:0/3894937636 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec015070 con 0x7f5200151da0 2024-05-21T14:43:29.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.753+0000 7f02f9600640 1 -- 172.21.15.78:0/2773238862 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e400e930 con 0x7f02e0005220 2024-05-21T14:43:29.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.753+0000 7f51fcc00640 1 -- 172.21.15.78:0/3894937636 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51ec007820 con 0x7f5200151da0 2024-05-21T14:43:29.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.753+0000 7f0303c00640 1 -- 172.21.15.78:0/2773238862 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02fc0cb710 con 0x7f02e0005220 2024-05-21T14:43:29.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.753+0000 7f02f9600640 1 -- 172.21.15.78:0/2773238862 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e400ead0 con 0x7f02e0005220 2024-05-21T14:43:29.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.753+0000 7f02f9600640 1 -- 172.21.15.78:0/2773238862 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e400ec80 con 0x7f02e0005220 2024-05-21T14:43:29.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.753+0000 7f0303c00640 1 -- 172.21.15.78:0/2773238862 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f02fc15c500 con 0x7f02e0005220 2024-05-21T14:43:29.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.753+0000 7f5206000640 1 -- 172.21.15.78:0/3894937636 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52001554a0 con 0x7f5200151da0 2024-05-21T14:43:29.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.753+0000 7f5206000640 1 -- 172.21.15.78:0/3894937636 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f52001ffe50 con 0x7f5200151da0 2024-05-21T14:43:29.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.753+0000 7f51fcc00640 1 -- 172.21.15.78:0/3894937636 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec007bf0 con 0x7f5200151da0 2024-05-21T14:43:29.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.753+0000 7f241f400640 1 --2- 172.21.15.78:0/2876854024 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24000678f0 0x7f2400069e00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2410009bd0 tx=0x7f2410008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.753+0000 7f0303c00640 1 -- 172.21.15.78:0/2773238862 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02fc0c8920 con 0x7f02e0005220 2024-05-21T14:43:29.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.757+0000 7f1de6000640 1 -- 172.21.15.78:0/1662040946 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1ddc0bd030 con 0x7f1de800db80 2024-05-21T14:43:29.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.757+0000 7f5206000640 1 -- 172.21.15.78:0/3894937636 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51dc0052a0 con 0x7f5200151da0 2024-05-21T14:43:29.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.757+0000 7f7cc9600640 1 -- 172.21.15.78:0/2651782354 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f7ccc105070 con 0x7f7cc404c8e0 2024-05-21T14:43:29.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.757+0000 7f1de6000640 1 --2- 172.21.15.78:0/1662040946 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1dd0067990 0x7f1dd0069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.757+0000 7f1de6000640 1 -- 172.21.15.78:0/1662040946 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1ddc120960 con 0x7f1de800db80 2024-05-21T14:43:29.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.757+0000 7f2417400640 1 -- 172.21.15.78:0/2876854024 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f240c018710 con 0x7f24200c7970 2024-05-21T14:43:29.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.757+0000 7f1df1e00640 1 --2- 172.21.15.78:0/1662040946 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1dd0067990 0x7f1dd0069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.757+0000 7f1df1e00640 1 --2- 172.21.15.78:0/1662040946 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1dd0067990 0x7f1dd0069ea0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1de0007fd0 tx=0x7f1de0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.769+0000 7f1de6000640 1 -- 172.21.15.78:0/1662040946 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1ddc016290 con 0x7f1de800db80 2024-05-21T14:43:29.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.769+0000 7f02f9600640 1 -- 172.21.15.78:0/2773238862 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f02e401a020 con 0x7f02e0005220 2024-05-21T14:43:29.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.769+0000 7f51fcc00640 1 -- 172.21.15.78:0/3894937636 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f51ec018070 con 0x7f5200151da0 2024-05-21T14:43:29.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.769+0000 7f02f9600640 1 --2- 172.21.15.78:0/2773238862 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f02d80678c0 0x7f02d8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.773+0000 7f02f9600640 1 -- 172.21.15.78:0/2773238862 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f02e4086240 con 0x7f02e0005220 2024-05-21T14:43:29.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.773+0000 7f51fcc00640 1 --2- 172.21.15.78:0/3894937636 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f51e00678c0 0x7f51e0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:29.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.773+0000 7f02f3e00640 1 --2- 172.21.15.78:0/2773238862 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f02d80678c0 0x7f02d8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.773+0000 7f51fcc00640 1 -- 172.21.15.78:0/3894937636 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f51ec0860e0 con 0x7f5200151da0 2024-05-21T14:43:29.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.773+0000 7f51ffe00640 1 --2- 172.21.15.78:0/3894937636 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f51e00678c0 0x7f51e0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:29.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.773+0000 7f51ffe00640 1 --2- 172.21.15.78:0/3894937636 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f51e00678c0 0x7f51e0069dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f51f40b3000 tx=0x7f51f40ab070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.777+0000 7f02f3e00640 1 --2- 172.21.15.78:0/2773238862 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f02d80678c0 0x7f02d8069dd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f02fc1eea30 tx=0x7f02ec004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:29.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.781+0000 7f02f9600640 1 -- 172.21.15.78:0/2773238862 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f02fc15fc70 con 0x7f02e0005220 2024-05-21T14:43:29.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.797+0000 7f51fcc00640 1 -- 172.21.15.78:0/3894937636 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f51ec056c90 con 0x7f5200151da0 2024-05-21T14:43:29.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.969+0000 7f3d5b200640 1 -- 172.21.15.78:0/2691866115 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3d5c0c8ed0 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.969+0000 7f3d52000640 1 -- 172.21.15.78:0/2691866115 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3d54010040 con 0x7f3d5c0c3ff0 2024-05-21T14:43:29.979 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2024-05-21T14:43:29.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.973+0000 7f3d5b200640 1 -- 172.21.15.78:0/2691866115 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f3d3c0678c0 msgr2=0x7f3d3c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.973+0000 7f3d5b200640 1 --2- 172.21.15.78:0/2691866115 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f3d3c0678c0 0x7f3d3c069dd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c006fd0 tx=0x7f3d4c008040 comp rx=0 tx=0).stop 2024-05-21T14:43:29.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.973+0000 7f3d5b200640 1 -- 172.21.15.78:0/2691866115 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d5c0c3ff0 msgr2=0x7f3d5c14a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:29.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.973+0000 7f3d5b200640 1 --2- 172.21.15.78:0/2691866115 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d5c0c3ff0 0x7f3d5c14a0b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400ebf0 tx=0x7f3d5400c490 comp rx=0 tx=0).stop 2024-05-21T14:43:29.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.973+0000 7f3d5b200640 1 -- 172.21.15.78:0/2691866115 shutdown_connections 2024-05-21T14:43:29.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.973+0000 7f3d5b200640 1 --2- 172.21.15.78:0/2691866115 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f3d3c0678c0 0x7f3d3c069dd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.973+0000 7f3d5b200640 1 --2- 172.21.15.78:0/2691866115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d5c1518e0 0x7f3d5c0cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.973+0000 7f3d5b200640 1 --2- 172.21.15.78:0/2691866115 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3d5c0c3ff0 0x7f3d5c14a0b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.973+0000 7f3d5b200640 1 --2- 172.21.15.78:0/2691866115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d5c073cb0 0x7f3d5c0cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:29.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.973+0000 7f3d5b200640 1 -- 172.21.15.78:0/2691866115 >> 172.21.15.78:0/2691866115 conn(0x7f3d5c06f520 msgr2=0x7f3d5c149520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:29.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.973+0000 7f3d5b200640 1 -- 172.21.15.78:0/2691866115 shutdown_connections 2024-05-21T14:43:29.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:29.977+0000 7f3d5b200640 1 -- 172.21.15.78:0/2691866115 wait complete. 2024-05-21T14:43:30.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-05-21T14:43:30.016 DEBUG:teuthology.parallel:result is None 2024-05-21T14:43:30.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.041+0000 7fb5ea200640 1 -- 172.21.15.78:0/4178545572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb5c0005590 con 0x7fb5e41581d0 2024-05-21T14:43:30.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.041+0000 7fb5d7400640 1 -- 172.21.15.78:0/4178545572 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb5dc0564c0 con 0x7fb5e41581d0 2024-05-21T14:43:30.049 INFO:teuthology.orchestra.run.smithi078.stdout:64424509447 2024-05-21T14:43:30.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.045+0000 7fb5ea200640 1 -- 172.21.15.78:0/4178545572 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb5c4067910 msgr2=0x7fb5c4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.045+0000 7fb5ea200640 1 --2- 172.21.15.78:0/4178545572 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb5c4067910 0x7fb5c4069e20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00ae000 tx=0x7fb5d00a7000 comp rx=0 tx=0).stop 2024-05-21T14:43:30.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.045+0000 7fb5ea200640 1 -- 172.21.15.78:0/4178545572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5e41581d0 msgr2=0x7fb5e41f6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.045+0000 7fb5ea200640 1 --2- 172.21.15.78:0/4178545572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5e41581d0 0x7fb5e41f6ea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00b9e0 tx=0x7fb5dc00bea0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.045+0000 7fb5ea200640 1 -- 172.21.15.78:0/4178545572 shutdown_connections 2024-05-21T14:43:30.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.045+0000 7fb5ea200640 1 --2- 172.21.15.78:0/4178545572 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb5c4067910 0x7fb5c4069e20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.045+0000 7fb5ea200640 1 --2- 172.21.15.78:0/4178545572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5e41581d0 0x7fb5e41f6ea0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.045+0000 7fb5ea200640 1 --2- 172.21.15.78:0/4178545572 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5e40c8ad0 0x7fb5e41f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.045+0000 7fb5ea200640 1 --2- 172.21.15.78:0/4178545572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5e406c8e0 0x7fb5e4159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.045+0000 7fb5ea200640 1 -- 172.21.15.78:0/4178545572 >> 172.21.15.78:0/4178545572 conn(0x7fb5e40ccbd0 msgr2=0x7fb5e406d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:30.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.045+0000 7fb5ea200640 1 -- 172.21.15.78:0/4178545572 shutdown_connections 2024-05-21T14:43:30.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.045+0000 7fb5ea200640 1 -- 172.21.15.78:0/4178545572 wait complete. 2024-05-21T14:43:30.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.057+0000 7f7cd2a00640 1 -- 172.21.15.78:0/2651782354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7cc40332e0 con 0x7f7cc404c8e0 2024-05-21T14:43:30.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.057+0000 7f7cc9600640 1 -- 172.21.15.78:0/2651782354 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7ccc0d11c0 con 0x7f7cc404c8e0 2024-05-21T14:43:30.066 INFO:teuthology.orchestra.run.smithi078.stdout:64424509446 2024-05-21T14:43:30.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.061+0000 7f7cd2a00640 1 -- 172.21.15.78:0/2651782354 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7cac0678c0 msgr2=0x7f7cac069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.061+0000 7f7cd2a00640 1 --2- 172.21.15.78:0/2651782354 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7cac0678c0 0x7f7cac069dd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7cc404c1d0 tx=0x7f7cb8009040 comp rx=0 tx=0).stop 2024-05-21T14:43:30.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.061+0000 7f7cd2a00640 1 -- 172.21.15.78:0/2651782354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cc404c8e0 msgr2=0x7f7cc40c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.061+0000 7f7cd2a00640 1 --2- 172.21.15.78:0/2651782354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cc404c8e0 0x7f7cc40c66f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc065070 tx=0x7f7ccc068ea0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.061+0000 7f7cd2a00640 1 -- 172.21.15.78:0/2651782354 shutdown_connections 2024-05-21T14:43:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.061+0000 7f7cd2a00640 1 --2- 172.21.15.78:0/2651782354 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7cac0678c0 0x7f7cac069dd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.061+0000 7f7cd2a00640 1 --2- 172.21.15.78:0/2651782354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc40e5340 0x7f7cc40ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.061+0000 7f7cd2a00640 1 --2- 172.21.15.78:0/2651782354 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7cc40db2b0 0x7f7cc40e5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.061+0000 7f7cd2a00640 1 --2- 172.21.15.78:0/2651782354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cc404c8e0 0x7f7cc40c66f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.061+0000 7f7cd2a00640 1 -- 172.21.15.78:0/2651782354 >> 172.21.15.78:0/2651782354 conn(0x7f7cc40503c0 msgr2=0x7f7cc404ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.061+0000 7f7cd2a00640 1 -- 172.21.15.78:0/2651782354 shutdown_connections 2024-05-21T14:43:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.061+0000 7f7cd2a00640 1 -- 172.21.15.78:0/2651782354 wait complete. 2024-05-21T14:43:30.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-05-21T14:43:30.087 DEBUG:teuthology.parallel:result is None 2024-05-21T14:43:30.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2024-05-21T14:43:30.090 DEBUG:teuthology.parallel:result is None 2024-05-21T14:43:30.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.085+0000 7f2425200640 1 -- 172.21.15.78:0/2876854024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f24200c8940 con 0x7f24200c7970 2024-05-21T14:43:30.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.089+0000 7f2417400640 1 -- 172.21.15.78:0/2876854024 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f240c0f2cf0 con 0x7f24200c7970 2024-05-21T14:43:30.095 INFO:teuthology.orchestra.run.smithi078.stdout:64424509446 2024-05-21T14:43:30.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.089+0000 7f2425200640 1 -- 172.21.15.78:0/2876854024 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24000678f0 msgr2=0x7f2400069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.089+0000 7f2425200640 1 --2- 172.21.15.78:0/2876854024 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24000678f0 0x7f2400069e00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2410009bd0 tx=0x7f2410008040 comp rx=0 tx=0).stop 2024-05-21T14:43:30.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.089+0000 7f2425200640 1 -- 172.21.15.78:0/2876854024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24200c7970 msgr2=0x7f2420148240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.089+0000 7f2425200640 1 --2- 172.21.15.78:0/2876854024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24200c7970 0x7f2420148240 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f24200c7380 tx=0x7f240c01b950 comp rx=0 tx=0).stop 2024-05-21T14:43:30.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.089+0000 7f2425200640 1 -- 172.21.15.78:0/2876854024 shutdown_connections 2024-05-21T14:43:30.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.089+0000 7f2425200640 1 --2- 172.21.15.78:0/2876854024 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24000678f0 0x7f2400069e00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.089+0000 7f2425200640 1 --2- 172.21.15.78:0/2876854024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24200cc6e0 0x7f2420148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.093+0000 7f2425200640 1 --2- 172.21.15.78:0/2876854024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24200c7970 0x7f2420148240 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.093+0000 7f2425200640 1 --2- 172.21.15.78:0/2876854024 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f24200c66e0 0x7f2420149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.093+0000 7f2425200640 1 -- 172.21.15.78:0/2876854024 >> 172.21.15.78:0/2876854024 conn(0x7f242006b7f0 msgr2=0x7f2420153e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:30.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.093+0000 7f2425200640 1 -- 172.21.15.78:0/2876854024 shutdown_connections 2024-05-21T14:43:30.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.093+0000 7f2425200640 1 -- 172.21.15.78:0/2876854024 wait complete. 2024-05-21T14:43:30.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.097+0000 7f1ab5000640 1 -- 172.21.15.78:0/697013329 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1ab0068bb0 con 0x7f1ab014fce0 2024-05-21T14:43:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.097+0000 7f1aa7e00640 1 -- 172.21.15.78:0/697013329 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1aa00564d0 con 0x7f1ab014fce0 2024-05-21T14:43:30.104 INFO:teuthology.orchestra.run.smithi078.stdout:64424509447 2024-05-21T14:43:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.101+0000 7f1df3200640 1 -- 172.21.15.78:0/1662040946 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1de8050a50 con 0x7f1de800db80 2024-05-21T14:43:30.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.101+0000 7f1ab5000640 1 -- 172.21.15.78:0/697013329 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1a8c067990 msgr2=0x7f1a8c069ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.101+0000 7f1ab5000640 1 --2- 172.21.15.78:0/697013329 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1a8c067990 0x7f1a8c069ea0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1a98007fd0 tx=0x7f1a98009040 comp rx=0 tx=0).stop 2024-05-21T14:43:30.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.101+0000 7f1ab5000640 1 -- 172.21.15.78:0/697013329 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ab014fce0 msgr2=0x7f1ab0156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.101+0000 7f1ab5000640 1 --2- 172.21.15.78:0/697013329 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ab014fce0 0x7f1ab0156320 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000d0d0 tx=0x7f1aa000d590 comp rx=0 tx=0).stop 2024-05-21T14:43:30.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.101+0000 7f1ab5000640 1 -- 172.21.15.78:0/697013329 shutdown_connections 2024-05-21T14:43:30.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.101+0000 7f1ab5000640 1 --2- 172.21.15.78:0/697013329 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1a8c067990 0x7f1a8c069ea0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.101+0000 7f1ab5000640 1 --2- 172.21.15.78:0/697013329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ab015ccd0 0x7f1ab00c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.101+0000 7f1ab5000640 1 --2- 172.21.15.78:0/697013329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ab015c8c0 0x7f1ab01f9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.101+0000 7f1ab5000640 1 --2- 172.21.15.78:0/697013329 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ab014fce0 0x7f1ab0156320 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.101+0000 7f1ab5000640 1 -- 172.21.15.78:0/697013329 >> 172.21.15.78:0/697013329 conn(0x7f1ab006f520 msgr2=0x7f1ab014a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:30.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.101+0000 7f1ab5000640 1 -- 172.21.15.78:0/697013329 shutdown_connections 2024-05-21T14:43:30.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.101+0000 7f1ab5000640 1 -- 172.21.15.78:0/697013329 wait complete. 2024-05-21T14:43:30.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.101+0000 7f1de6000640 1 -- 172.21.15.78:0/1662040946 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1ddc0f0ec0 con 0x7f1de800db80 2024-05-21T14:43:30.109 INFO:teuthology.orchestra.run.smithi078.stdout:64424509447 2024-05-21T14:43:30.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.105+0000 7f1df3200640 1 -- 172.21.15.78:0/1662040946 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1dd0067990 msgr2=0x7f1dd0069ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.105+0000 7f1df3200640 1 --2- 172.21.15.78:0/1662040946 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1dd0067990 0x7f1dd0069ea0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1de0007fd0 tx=0x7f1de0009040 comp rx=0 tx=0).stop 2024-05-21T14:43:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.105+0000 7f1df3200640 1 -- 172.21.15.78:0/1662040946 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1de800db80 msgr2=0x7f1de80d7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.105+0000 7f1df3200640 1 --2- 172.21.15.78:0/1662040946 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1de800db80 0x7f1de80d7b70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0ae040 tx=0x7f1dd4005840 comp rx=0 tx=0).stop 2024-05-21T14:43:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.105+0000 7f1df3200640 1 -- 172.21.15.78:0/1662040946 shutdown_connections 2024-05-21T14:43:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.105+0000 7f1df3200640 1 --2- 172.21.15.78:0/1662040946 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1dd0067990 0x7f1dd0069ea0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.105+0000 7f1df3200640 1 --2- 172.21.15.78:0/1662040946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de80d80b0 0x7f1de8170f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.105+0000 7f1df3200640 1 --2- 172.21.15.78:0/1662040946 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1de800db80 0x7f1de80d7b70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.105+0000 7f1df3200640 1 --2- 172.21.15.78:0/1662040946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dd4004810 0x7f1de800baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.105+0000 7f1df3200640 1 -- 172.21.15.78:0/1662040946 >> 172.21.15.78:0/1662040946 conn(0x7f1de8054850 msgr2=0x7f1de80d8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.105+0000 7f1df3200640 1 -- 172.21.15.78:0/1662040946 shutdown_connections 2024-05-21T14:43:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.105+0000 7f1df3200640 1 -- 172.21.15.78:0/1662040946 wait complete. 2024-05-21T14:43:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.113+0000 7f0303c00640 1 -- 172.21.15.78:0/2773238862 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f02fc15c9b0 con 0x7f02e0005220 2024-05-21T14:43:30.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.113+0000 7f02f9600640 1 -- 172.21.15.78:0/2773238862 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f02e40112e0 con 0x7f02e0005220 2024-05-21T14:43:30.121 INFO:teuthology.orchestra.run.smithi078.stdout:64424509446 2024-05-21T14:43:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.117+0000 7f0303c00640 1 -- 172.21.15.78:0/2773238862 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f02d80678c0 msgr2=0x7f02d8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.117+0000 7f0303c00640 1 --2- 172.21.15.78:0/2773238862 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f02d80678c0 0x7f02d8069dd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f02fc1eea30 tx=0x7f02ec004740 comp rx=0 tx=0).stop 2024-05-21T14:43:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.117+0000 7f0303c00640 1 -- 172.21.15.78:0/2773238862 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f02e0005220 msgr2=0x7f02fc0cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.117+0000 7f0303c00640 1 --2- 172.21.15.78:0/2773238862 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f02e0005220 0x7f02fc0cb1d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f02e4007330 tx=0x7f02e40077f0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.117+0000 7f0303c00640 1 -- 172.21.15.78:0/2773238862 shutdown_connections 2024-05-21T14:43:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.117+0000 7f0303c00640 1 --2- 172.21.15.78:0/2773238862 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f02d80678c0 0x7f02d8069dd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.117+0000 7f0303c00640 1 --2- 172.21.15.78:0/2773238862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02fc15a0a0 0x7f02fc15a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.117+0000 7f0303c00640 1 --2- 172.21.15.78:0/2773238862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02fc15b7a0 0x7f02fc15bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.117+0000 7f0303c00640 1 --2- 172.21.15.78:0/2773238862 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f02e0005220 0x7f02fc0cb1d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.117+0000 7f0303c00640 1 -- 172.21.15.78:0/2773238862 >> 172.21.15.78:0/2773238862 conn(0x7f02fc0cd1e0 msgr2=0x7f02fc0718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.117+0000 7f0303c00640 1 -- 172.21.15.78:0/2773238862 shutdown_connections 2024-05-21T14:43:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.117+0000 7f0303c00640 1 -- 172.21.15.78:0/2773238862 wait complete. 2024-05-21T14:43:30.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-05-21T14:43:30.128 DEBUG:teuthology.parallel:result is None 2024-05-21T14:43:30.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.121+0000 7f5206000640 1 -- 172.21.15.78:0/3894937636 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f51dc005860 con 0x7f5200151da0 2024-05-21T14:43:30.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.121+0000 7f51fcc00640 1 -- 172.21.15.78:0/3894937636 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f51ec056590 con 0x7f5200151da0 2024-05-21T14:43:30.130 INFO:teuthology.orchestra.run.smithi078.stdout:64424509447 2024-05-21T14:43:30.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.125+0000 7f5206000640 1 -- 172.21.15.78:0/3894937636 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f51e00678c0 msgr2=0x7f51e0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.125+0000 7f5206000640 1 --2- 172.21.15.78:0/3894937636 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f51e00678c0 0x7f51e0069dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f51f40b3000 tx=0x7f51f40ab070 comp rx=0 tx=0).stop 2024-05-21T14:43:30.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.125+0000 7f5206000640 1 -- 172.21.15.78:0/3894937636 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5200151da0 msgr2=0x7f5200147020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.125+0000 7f5206000640 1 --2- 172.21.15.78:0/3894937636 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5200151da0 0x7f5200147020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00c7f0 tx=0x7f51ec00ccb0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.125+0000 7f5206000640 1 -- 172.21.15.78:0/3894937636 shutdown_connections 2024-05-21T14:43:30.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.125+0000 7f5206000640 1 --2- 172.21.15.78:0/3894937636 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f51e00678c0 0x7f51e0069dd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.125+0000 7f5206000640 1 --2- 172.21.15.78:0/3894937636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5200154870 0x7f5200152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.125+0000 7f5206000640 1 --2- 172.21.15.78:0/3894937636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52001580a0 0x7f52001677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.125+0000 7f5206000640 1 --2- 172.21.15.78:0/3894937636 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5200151da0 0x7f5200147020 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.125+0000 7f5206000640 1 -- 172.21.15.78:0/3894937636 >> 172.21.15.78:0/3894937636 conn(0x7f52000c96d0 msgr2=0x7f5200067610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:30.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.125+0000 7f5206000640 1 -- 172.21.15.78:0/3894937636 shutdown_connections 2024-05-21T14:43:30.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.125+0000 7f5206000640 1 -- 172.21.15.78:0/3894937636 wait complete. 2024-05-21T14:43:30.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-05-21T14:43:30.135 DEBUG:teuthology.parallel:result is None 2024-05-21T14:43:30.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-05-21T14:43:30.149 DEBUG:teuthology.parallel:result is None 2024-05-21T14:43:30.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-05-21T14:43:30.149 DEBUG:teuthology.parallel:result is None 2024-05-21T14:43:30.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-05-21T14:43:30.158 DEBUG:teuthology.parallel:result is None 2024-05-21T14:43:30.158 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-21T14:43:30.158 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T14:43:30.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.337+0000 7fe9f2200640 1 Processor -- start 2024-05-21T14:43:30.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.337+0000 7fe9f2200640 1 -- start start 2024-05-21T14:43:30.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.337+0000 7fe9f2200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe9ec073300 0x7fe9ec0c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:30.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.337+0000 7fe9f2200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe9ec0714c0 0x7fe9ec06b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:30.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.337+0000 7fe9f2200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9ec0c5f20 con 0x7fe9ec0718d0 2024-05-21T14:43:30.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.337+0000 7fe9f2200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fe9ec073710 con 0x7fe9ec0714c0 2024-05-21T14:43:30.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.337+0000 7fe9f2200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fe9ec15c3b0 con 0x7fe9ec073300 2024-05-21T14:43:30.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.337+0000 7fe9eaa00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe9ec0714c0 0x7fe9ec06b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:30.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.337+0000 7fe9eaa00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe9ec0714c0 0x7fe9ec06b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38592/0 (socket says 172.21.15.78:38592) 2024-05-21T14:43:30.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.337+0000 7fe9eaa00640 1 -- 172.21.15.78:0/4019390700 learned_addr learned my addr 172.21.15.78:0/4019390700 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:30.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.337+0000 7fe9eb400640 1 --2- 172.21.15.78:0/4019390700 >> v2:172.21.15.84:3300/0 conn(0x7fe9ec073300 0x7fe9ec0c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:30.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.337+0000 7fe9eaa00640 1 -- 172.21.15.78:0/4019390700 >> v2:172.21.15.84:3300/0 conn(0x7fe9ec073300 msgr2=0x7fe9ec0c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:30.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.337+0000 7fe9eaa00640 1 --2- 172.21.15.78:0/4019390700 >> v2:172.21.15.84:3300/0 conn(0x7fe9ec073300 0x7fe9ec0c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.337+0000 7fe9eaa00640 1 -- 172.21.15.78:0/4019390700 >> v1:172.21.15.84:6789/0 conn(0x7fe9ec0718d0 legacy=0x7fe9ec15eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.337+0000 7fe9eaa00640 1 -- 172.21.15.78:0/4019390700 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec15c840 con 0x7fe9ec0714c0 2024-05-21T14:43:30.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.341+0000 7fe9eaa00640 1 --2- 172.21.15.78:0/4019390700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9ec0714c0 0x7fe9ec06b620 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec06c930 tx=0x7fe9d801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4fca4ca396505d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:30.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.341+0000 7fe9ea000640 1 -- 172.21.15.78:0/4019390700 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80b0070 con 0x7fe9ec0714c0 2024-05-21T14:43:30.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.341+0000 7fe9ea000640 1 -- 172.21.15.78:0/4019390700 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d80ab600 con 0x7fe9ec0714c0 2024-05-21T14:43:30.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.341+0000 7fe9ea000640 1 -- 172.21.15.78:0/4019390700 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80ab9d0 con 0x7fe9ec0714c0 2024-05-21T14:43:30.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.341+0000 7fe9f2200640 1 -- 172.21.15.78:0/4019390700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9ec0714c0 msgr2=0x7fe9ec06b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.341+0000 7fe9f2200640 1 --2- 172.21.15.78:0/4019390700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9ec0714c0 0x7fe9ec06b620 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec06c930 tx=0x7fe9d801c460 comp rx=0 tx=0).stop 2024-05-21T14:43:30.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.341+0000 7fe9f2200640 1 -- 172.21.15.78:0/4019390700 shutdown_connections 2024-05-21T14:43:30.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.341+0000 7fe9f2200640 1 --2- 172.21.15.78:0/4019390700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9ec0714c0 0x7fe9ec06b620 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.341+0000 7fe9f2200640 1 --2- 172.21.15.78:0/4019390700 >> v2:172.21.15.84:3300/0 conn(0x7fe9ec073300 0x7fe9ec0c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.341+0000 7fe9f2200640 1 -- 172.21.15.78:0/4019390700 >> 172.21.15.78:0/4019390700 conn(0x7fe9ec0c9380 msgr2=0x7fe9ec0c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:30.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.341+0000 7fe9f2200640 1 -- 172.21.15.78:0/4019390700 shutdown_connections 2024-05-21T14:43:30.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.341+0000 7fe9f2200640 1 -- 172.21.15.78:0/4019390700 wait complete. 2024-05-21T14:43:30.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9f2200640 1 Processor -- start 2024-05-21T14:43:30.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9f2200640 1 -- start start 2024-05-21T14:43:30.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9f2200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9ec0714c0 0x7fe9ec0cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:30.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9f2200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9ec0718d0 0x7fe9ec0c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:30.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9f2200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe9ec073300 0x7fe9ec13fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:30.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9f2200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec06c6b0 con 0x7fe9ec0718d0 2024-05-21T14:43:30.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9f2200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec15c040 con 0x7fe9ec0714c0 2024-05-21T14:43:30.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9f2200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ec0c6ca0 con 0x7fe9ec073300 2024-05-21T14:43:30.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9eaa00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9ec0718d0 0x7fe9ec0c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:30.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9eaa00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9ec0718d0 0x7fe9ec0c4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38594/0 (socket says 172.21.15.78:38594) 2024-05-21T14:43:30.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9eaa00640 1 -- 172.21.15.78:0/3890241766 learned_addr learned my addr 172.21.15.78:0/3890241766 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:30.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9eb400640 1 --2- 172.21.15.78:0/3890241766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9ec0714c0 0x7fe9ec0cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:30.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9ebe00640 1 --2- 172.21.15.78:0/3890241766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe9ec073300 0x7fe9ec13fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:30.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9eaa00640 1 -- 172.21.15.78:0/3890241766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe9ec073300 msgr2=0x7fe9ec13fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9eaa00640 1 --2- 172.21.15.78:0/3890241766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe9ec073300 0x7fe9ec13fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9eaa00640 1 -- 172.21.15.78:0/3890241766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9ec0714c0 msgr2=0x7fe9ec0cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9eaa00640 1 --2- 172.21.15.78:0/3890241766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9ec0714c0 0x7fe9ec0cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9eaa00640 1 -- 172.21.15.78:0/3890241766 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec0cbc10 con 0x7fe9ec0718d0 2024-05-21T14:43:30.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9eb400640 1 --2- 172.21.15.78:0/3890241766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9ec0714c0 0x7fe9ec0cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:30.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.345+0000 7fe9eaa00640 1 --2- 172.21.15.78:0/3890241766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9ec0718d0 0x7fe9ec0c4b70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8019070 tx=0x7fe9d8019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:30.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.349+0000 7fe9e3400640 1 -- 172.21.15.78:0/3890241766 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80abe60 con 0x7fe9ec0718d0 2024-05-21T14:43:30.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.349+0000 7fe9e3400640 1 -- 172.21.15.78:0/3890241766 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d80b4620 con 0x7fe9ec0718d0 2024-05-21T14:43:30.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.349+0000 7fe9e3400640 1 -- 172.21.15.78:0/3890241766 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80b0040 con 0x7fe9ec0718d0 2024-05-21T14:43:30.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.349+0000 7fe9f2200640 1 -- 172.21.15.78:0/3890241766 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ec0c59d0 con 0x7fe9ec0718d0 2024-05-21T14:43:30.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.349+0000 7fe9f2200640 1 -- 172.21.15.78:0/3890241766 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ec144a10 con 0x7fe9ec0718d0 2024-05-21T14:43:30.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.349+0000 7fe9f2200640 1 -- 172.21.15.78:0/3890241766 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ec04f730 con 0x7fe9ec0718d0 2024-05-21T14:43:30.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.349+0000 7fe9e3400640 1 -- 172.21.15.78:0/3890241766 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe9d80ab4c0 con 0x7fe9ec0718d0 2024-05-21T14:43:30.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.349+0000 7fe9e3400640 1 --2- 172.21.15.78:0/3890241766 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9cc0678f0 0x7fe9cc069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:30.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.349+0000 7fe9e3400640 1 -- 172.21.15.78:0/3890241766 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe9d811f7b0 con 0x7fe9ec0718d0 2024-05-21T14:43:30.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.349+0000 7fe9eb400640 1 --2- 172.21.15.78:0/3890241766 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9cc0678f0 0x7fe9cc069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:30.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.353+0000 7fe9eb400640 1 --2- 172.21.15.78:0/3890241766 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9cc0678f0 0x7fe9cc069e00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009b10 tx=0x7fe9dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:30.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.353+0000 7fe9e3400640 1 -- 172.21.15.78:0/3890241766 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fe9d8016110 con 0x7fe9ec0718d0 2024-05-21T14:43:30.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.521+0000 7fe9f2200640 1 -- 172.21.15.78:0/3890241766 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe9ec145340 con 0x7fe9cc0678f0 2024-05-21T14:43:30.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.541+0000 7fe9e3400640 1 -- 172.21.15.78:0/3890241766 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251909 (secure 0 0 0) 0x7fe9ec145340 con 0x7fe9cc0678f0 2024-05-21T14:43:30.550 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:30.551 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-05-21T14:43:30.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.541+0000 7fe9f2200640 1 -- 172.21.15.78:0/3890241766 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9cc0678f0 msgr2=0x7fe9cc069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.541+0000 7fe9f2200640 1 --2- 172.21.15.78:0/3890241766 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9cc0678f0 0x7fe9cc069e00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009b10 tx=0x7fe9dc008040 comp rx=0 tx=0).stop 2024-05-21T14:43:30.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.541+0000 7fe9f2200640 1 -- 172.21.15.78:0/3890241766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9ec0718d0 msgr2=0x7fe9ec0c4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.541+0000 7fe9f2200640 1 --2- 172.21.15.78:0/3890241766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9ec0718d0 0x7fe9ec0c4b70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8019070 tx=0x7fe9d8019200 comp rx=0 tx=0).stop 2024-05-21T14:43:30.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.545+0000 7fe9f2200640 1 -- 172.21.15.78:0/3890241766 shutdown_connections 2024-05-21T14:43:30.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.545+0000 7fe9f2200640 1 --2- 172.21.15.78:0/3890241766 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fe9cc0678f0 0x7fe9cc069e00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.545+0000 7fe9f2200640 1 --2- 172.21.15.78:0/3890241766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe9ec073300 0x7fe9ec13fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.545+0000 7fe9f2200640 1 --2- 172.21.15.78:0/3890241766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9ec0718d0 0x7fe9ec0c4b70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.545+0000 7fe9f2200640 1 --2- 172.21.15.78:0/3890241766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9ec0714c0 0x7fe9ec0cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.545+0000 7fe9f2200640 1 -- 172.21.15.78:0/3890241766 >> 172.21.15.78:0/3890241766 conn(0x7fe9ec0c9380 msgr2=0x7fe9ec14ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:30.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.545+0000 7fe9f2200640 1 -- 172.21.15.78:0/3890241766 shutdown_connections 2024-05-21T14:43:30.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.545+0000 7fe9f2200640 1 -- 172.21.15.78:0/3890241766 wait complete. 2024-05-21T14:43:30.571 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-05-21T14:43:30.490504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218156,"kb_used_data":2016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756564,"statfs":{"total":773094113280,"available":772870721536,"internally_reserved":0,"allocated":2064384,"data_stored":1835436,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.004347"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067056+0000","last_change":"2024-05-21T14:43:19.606707+0000","last_active":"2024-05-21T14:43:21.067056+0000","last_peered":"2024-05-21T14:43:21.067056+0000","last_clean":"2024-05-21T14:43:21.067056+0000","last_became_active":"2024-05-21T14:43:19.606365+0000","last_became_peered":"2024-05-21T14:43:19.606365+0000","last_unstale":"2024-05-21T14:43:21.067056+0000","last_undegraded":"2024-05-21T14:43:21.067056+0000","last_fullsized":"2024-05-21T14:43:21.067056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:26.135357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067577+0000","last_change":"2024-05-21T14:43:19.632879+0000","last_active":"2024-05-21T14:43:21.067577+0000","last_peered":"2024-05-21T14:43:21.067577+0000","last_clean":"2024-05-21T14:43:21.067577+0000","last_became_active":"2024-05-21T14:43:19.632218+0000","last_became_peered":"2024-05-21T14:43:19.632218+0000","last_unstale":"2024-05-21T14:43:21.067577+0000","last_undegraded":"2024-05-21T14:43:21.067577+0000","last_fullsized":"2024-05-21T14:43:21.067577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:35:49.461861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066825+0000","last_change":"2024-05-21T14:43:19.620214+0000","last_active":"2024-05-21T14:43:21.066825+0000","last_peered":"2024-05-21T14:43:21.066825+0000","last_clean":"2024-05-21T14:43:21.066825+0000","last_became_active":"2024-05-21T14:43:19.619012+0000","last_became_peered":"2024-05-21T14:43:19.619012+0000","last_unstale":"2024-05-21T14:43:21.066825+0000","last_undegraded":"2024-05-21T14:43:21.066825+0000","last_fullsized":"2024-05-21T14:43:21.066825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:40:22.415178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066035+0000","last_change":"2024-05-21T14:43:19.602199+0000","last_active":"2024-05-21T14:43:21.066035+0000","last_peered":"2024-05-21T14:43:21.066035+0000","last_clean":"2024-05-21T14:43:21.066035+0000","last_became_active":"2024-05-21T14:43:19.601797+0000","last_became_peered":"2024-05-21T14:43:19.601797+0000","last_unstale":"2024-05-21T14:43:21.066035+0000","last_undegraded":"2024-05-21T14:43:21.066035+0000","last_fullsized":"2024-05-21T14:43:21.066035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:33:00.071681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066510+0000","last_change":"2024-05-21T14:43:19.623449+0000","last_active":"2024-05-21T14:43:21.066510+0000","last_peered":"2024-05-21T14:43:21.066510+0000","last_clean":"2024-05-21T14:43:21.066510+0000","last_became_active":"2024-05-21T14:43:19.623125+0000","last_became_peered":"2024-05-21T14:43:19.623125+0000","last_unstale":"2024-05-21T14:43:21.066510+0000","last_undegraded":"2024-05-21T14:43:21.066510+0000","last_fullsized":"2024-05-21T14:43:21.066510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:42.178156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.065985+0000","last_change":"2024-05-21T14:43:19.591222+0000","last_active":"2024-05-21T14:43:21.065985+0000","last_peered":"2024-05-21T14:43:21.065985+0000","last_clean":"2024-05-21T14:43:21.065985+0000","last_became_active":"2024-05-21T14:43:19.590858+0000","last_became_peered":"2024-05-21T14:43:19.590858+0000","last_unstale":"2024-05-21T14:43:21.065985+0000","last_undegraded":"2024-05-21T14:43:21.065985+0000","last_fullsized":"2024-05-21T14:43:21.065985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:21:15.737192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066173+0000","last_change":"2024-05-21T14:43:19.614716+0000","last_active":"2024-05-21T14:43:21.066173+0000","last_peered":"2024-05-21T14:43:21.066173+0000","last_clean":"2024-05-21T14:43:21.066173+0000","last_became_active":"2024-05-21T14:43:19.614451+0000","last_became_peered":"2024-05-21T14:43:19.614451+0000","last_unstale":"2024-05-21T14:43:21.066173+0000","last_undegraded":"2024-05-21T14:43:21.066173+0000","last_fullsized":"2024-05-21T14:43:21.066173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:07:01.524574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066544+0000","last_change":"2024-05-21T14:43:19.604029+0000","last_active":"2024-05-21T14:43:21.066544+0000","last_peered":"2024-05-21T14:43:21.066544+0000","last_clean":"2024-05-21T14:43:21.066544+0000","last_became_active":"2024-05-21T14:43:19.603164+0000","last_became_peered":"2024-05-21T14:43:19.603164+0000","last_unstale":"2024-05-21T14:43:21.066544+0000","last_undegraded":"2024-05-21T14:43:21.066544+0000","last_fullsized":"2024-05-21T14:43:21.066544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:14:27.286952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578218+0000","last_change":"2024-05-21T14:43:19.613765+0000","last_active":"2024-05-21T14:43:20.578218+0000","last_peered":"2024-05-21T14:43:20.578218+0000","last_clean":"2024-05-21T14:43:20.578218+0000","last_became_active":"2024-05-21T14:43:19.613429+0000","last_became_peered":"2024-05-21T14:43:19.613429+0000","last_unstale":"2024-05-21T14:43:20.578218+0000","last_undegraded":"2024-05-21T14:43:20.578218+0000","last_fullsized":"2024-05-21T14:43:20.578218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:29:16.905434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066956+0000","last_change":"2024-05-21T14:43:19.607400+0000","last_active":"2024-05-21T14:43:21.066956+0000","last_peered":"2024-05-21T14:43:21.066956+0000","last_clean":"2024-05-21T14:43:21.066956+0000","last_became_active":"2024-05-21T14:43:19.607105+0000","last_became_peered":"2024-05-21T14:43:19.607105+0000","last_unstale":"2024-05-21T14:43:21.066956+0000","last_undegraded":"2024-05-21T14:43:21.066956+0000","last_fullsized":"2024-05-21T14:43:21.066956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:26:22.366105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066810+0000","last_change":"2024-05-21T14:43:19.606534+0000","last_active":"2024-05-21T14:43:21.066810+0000","last_peered":"2024-05-21T14:43:21.066810+0000","last_clean":"2024-05-21T14:43:21.066810+0000","last_became_active":"2024-05-21T14:43:19.606029+0000","last_became_peered":"2024-05-21T14:43:19.606029+0000","last_unstale":"2024-05-21T14:43:21.066810+0000","last_undegraded":"2024-05-21T14:43:21.066810+0000","last_fullsized":"2024-05-21T14:43:21.066810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:33:48.849701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066546+0000","last_change":"2024-05-21T14:43:19.609910+0000","last_active":"2024-05-21T14:43:21.066546+0000","last_peered":"2024-05-21T14:43:21.066546+0000","last_clean":"2024-05-21T14:43:21.066546+0000","last_became_active":"2024-05-21T14:43:19.609616+0000","last_became_peered":"2024-05-21T14:43:19.609616+0000","last_unstale":"2024-05-21T14:43:21.066546+0000","last_undegraded":"2024-05-21T14:43:21.066546+0000","last_fullsized":"2024-05-21T14:43:21.066546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:36:16.637620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581855+0000","last_change":"2024-05-21T14:43:19.604001+0000","last_active":"2024-05-21T14:43:20.581855+0000","last_peered":"2024-05-21T14:43:20.581855+0000","last_clean":"2024-05-21T14:43:20.581855+0000","last_became_active":"2024-05-21T14:43:19.596859+0000","last_became_peered":"2024-05-21T14:43:19.596859+0000","last_unstale":"2024-05-21T14:43:20.581855+0000","last_undegraded":"2024-05-21T14:43:20.581855+0000","last_fullsized":"2024-05-21T14:43:20.581855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:45:43.431420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580379+0000","last_change":"2024-05-21T14:43:19.626837+0000","last_active":"2024-05-21T14:43:20.580379+0000","last_peered":"2024-05-21T14:43:20.580379+0000","last_clean":"2024-05-21T14:43:20.580379+0000","last_became_active":"2024-05-21T14:43:19.626213+0000","last_became_peered":"2024-05-21T14:43:19.626213+0000","last_unstale":"2024-05-21T14:43:20.580379+0000","last_undegraded":"2024-05-21T14:43:20.580379+0000","last_fullsized":"2024-05-21T14:43:20.580379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:51.705474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066538+0000","last_change":"2024-05-21T14:43:19.613483+0000","last_active":"2024-05-21T14:43:21.066538+0000","last_peered":"2024-05-21T14:43:21.066538+0000","last_clean":"2024-05-21T14:43:21.066538+0000","last_became_active":"2024-05-21T14:43:19.612581+0000","last_became_peered":"2024-05-21T14:43:19.612581+0000","last_unstale":"2024-05-21T14:43:21.066538+0000","last_undegraded":"2024-05-21T14:43:21.066538+0000","last_fullsized":"2024-05-21T14:43:21.066538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:41:15.797196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797569+0000","last_change":"2024-05-21T14:43:19.609126+0000","last_active":"2024-05-21T14:43:20.797569+0000","last_peered":"2024-05-21T14:43:20.797569+0000","last_clean":"2024-05-21T14:43:20.797569+0000","last_became_active":"2024-05-21T14:43:19.607967+0000","last_became_peered":"2024-05-21T14:43:19.607967+0000","last_unstale":"2024-05-21T14:43:20.797569+0000","last_undegraded":"2024-05-21T14:43:20.797569+0000","last_fullsized":"2024-05-21T14:43:20.797569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:35.881039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798283+0000","last_change":"2024-05-21T14:43:19.613487+0000","last_active":"2024-05-21T14:43:20.798283+0000","last_peered":"2024-05-21T14:43:20.798283+0000","last_clean":"2024-05-21T14:43:20.798283+0000","last_became_active":"2024-05-21T14:43:19.611280+0000","last_became_peered":"2024-05-21T14:43:19.611280+0000","last_unstale":"2024-05-21T14:43:20.798283+0000","last_undegraded":"2024-05-21T14:43:20.798283+0000","last_fullsized":"2024-05-21T14:43:20.798283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:51:21.887715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581838+0000","last_change":"2024-05-21T14:43:19.607601+0000","last_active":"2024-05-21T14:43:20.581838+0000","last_peered":"2024-05-21T14:43:20.581838+0000","last_clean":"2024-05-21T14:43:20.581838+0000","last_became_active":"2024-05-21T14:43:19.606719+0000","last_became_peered":"2024-05-21T14:43:19.606719+0000","last_unstale":"2024-05-21T14:43:20.581838+0000","last_undegraded":"2024-05-21T14:43:20.581838+0000","last_fullsized":"2024-05-21T14:43:20.581838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:04:32.310805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798234+0000","last_change":"2024-05-21T14:43:19.618470+0000","last_active":"2024-05-21T14:43:20.798234+0000","last_peered":"2024-05-21T14:43:20.798234+0000","last_clean":"2024-05-21T14:43:20.798234+0000","last_became_active":"2024-05-21T14:43:19.617408+0000","last_became_peered":"2024-05-21T14:43:19.617408+0000","last_unstale":"2024-05-21T14:43:20.798234+0000","last_undegraded":"2024-05-21T14:43:20.798234+0000","last_fullsized":"2024-05-21T14:43:20.798234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:53:58.877306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066709+0000","last_change":"2024-05-21T14:43:19.609835+0000","last_active":"2024-05-21T14:43:21.066709+0000","last_peered":"2024-05-21T14:43:21.066709+0000","last_clean":"2024-05-21T14:43:21.066709+0000","last_became_active":"2024-05-21T14:43:19.609525+0000","last_became_peered":"2024-05-21T14:43:19.609525+0000","last_unstale":"2024-05-21T14:43:21.066709+0000","last_undegraded":"2024-05-21T14:43:21.066709+0000","last_fullsized":"2024-05-21T14:43:21.066709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:57:04.748898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963454+0000","last_change":"2024-05-21T14:43:19.607732+0000","last_active":"2024-05-21T14:43:20.963454+0000","last_peered":"2024-05-21T14:43:20.963454+0000","last_clean":"2024-05-21T14:43:20.963454+0000","last_became_active":"2024-05-21T14:43:19.606839+0000","last_became_peered":"2024-05-21T14:43:19.606839+0000","last_unstale":"2024-05-21T14:43:20.963454+0000","last_undegraded":"2024-05-21T14:43:20.963454+0000","last_fullsized":"2024-05-21T14:43:20.963454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:43:15.675663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578145+0000","last_change":"2024-05-21T14:43:19.601108+0000","last_active":"2024-05-21T14:43:20.578145+0000","last_peered":"2024-05-21T14:43:20.578145+0000","last_clean":"2024-05-21T14:43:20.578145+0000","last_became_active":"2024-05-21T14:43:19.600780+0000","last_became_peered":"2024-05-21T14:43:19.600780+0000","last_unstale":"2024-05-21T14:43:20.578145+0000","last_undegraded":"2024-05-21T14:43:20.578145+0000","last_fullsized":"2024-05-21T14:43:20.578145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:47:19.062733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067184+0000","last_change":"2024-05-21T14:43:19.620463+0000","last_active":"2024-05-21T14:43:21.067184+0000","last_peered":"2024-05-21T14:43:21.067184+0000","last_clean":"2024-05-21T14:43:21.067184+0000","last_became_active":"2024-05-21T14:43:19.614489+0000","last_became_peered":"2024-05-21T14:43:19.614489+0000","last_unstale":"2024-05-21T14:43:21.067184+0000","last_undegraded":"2024-05-21T14:43:21.067184+0000","last_fullsized":"2024-05-21T14:43:21.067184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:51:07.953352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797590+0000","last_change":"2024-05-21T14:43:19.624683+0000","last_active":"2024-05-21T14:43:20.797590+0000","last_peered":"2024-05-21T14:43:20.797590+0000","last_clean":"2024-05-21T14:43:20.797590+0000","last_became_active":"2024-05-21T14:43:19.624304+0000","last_became_peered":"2024-05-21T14:43:19.624304+0000","last_unstale":"2024-05-21T14:43:20.797590+0000","last_undegraded":"2024-05-21T14:43:20.797590+0000","last_fullsized":"2024-05-21T14:43:20.797590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:53.874968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067763+0000","last_change":"2024-05-21T14:43:19.621030+0000","last_active":"2024-05-21T14:43:21.067763+0000","last_peered":"2024-05-21T14:43:21.067763+0000","last_clean":"2024-05-21T14:43:21.067763+0000","last_became_active":"2024-05-21T14:43:19.619072+0000","last_became_peered":"2024-05-21T14:43:19.619072+0000","last_unstale":"2024-05-21T14:43:21.067763+0000","last_undegraded":"2024-05-21T14:43:21.067763+0000","last_fullsized":"2024-05-21T14:43:21.067763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:22:09.423661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066417+0000","last_change":"2024-05-21T14:43:19.602880+0000","last_active":"2024-05-21T14:43:21.066417+0000","last_peered":"2024-05-21T14:43:21.066417+0000","last_clean":"2024-05-21T14:43:21.066417+0000","last_became_active":"2024-05-21T14:43:19.602577+0000","last_became_peered":"2024-05-21T14:43:19.602577+0000","last_unstale":"2024-05-21T14:43:21.066417+0000","last_undegraded":"2024-05-21T14:43:21.066417+0000","last_fullsized":"2024-05-21T14:43:21.066417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:04:10.094373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582914+0000","last_change":"2024-05-21T14:43:19.632328+0000","last_active":"2024-05-21T14:43:20.582914+0000","last_peered":"2024-05-21T14:43:20.582914+0000","last_clean":"2024-05-21T14:43:20.582914+0000","last_became_active":"2024-05-21T14:43:19.631351+0000","last_became_peered":"2024-05-21T14:43:19.631351+0000","last_unstale":"2024-05-21T14:43:20.582914+0000","last_undegraded":"2024-05-21T14:43:20.582914+0000","last_fullsized":"2024-05-21T14:43:20.582914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:36:18.467070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582481+0000","last_change":"2024-05-21T14:43:19.632282+0000","last_active":"2024-05-21T14:43:20.582481+0000","last_peered":"2024-05-21T14:43:20.582481+0000","last_clean":"2024-05-21T14:43:20.582481+0000","last_became_active":"2024-05-21T14:43:19.631522+0000","last_became_peered":"2024-05-21T14:43:19.631522+0000","last_unstale":"2024-05-21T14:43:20.582481+0000","last_undegraded":"2024-05-21T14:43:20.582481+0000","last_fullsized":"2024-05-21T14:43:20.582481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:23:32.646087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067227+0000","last_change":"2024-05-21T14:43:19.620046+0000","last_active":"2024-05-21T14:43:21.067227+0000","last_peered":"2024-05-21T14:43:21.067227+0000","last_clean":"2024-05-21T14:43:21.067227+0000","last_became_active":"2024-05-21T14:43:19.612428+0000","last_became_peered":"2024-05-21T14:43:19.612428+0000","last_unstale":"2024-05-21T14:43:21.067227+0000","last_undegraded":"2024-05-21T14:43:21.067227+0000","last_fullsized":"2024-05-21T14:43:21.067227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:08:33.785399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797667+0000","last_change":"2024-05-21T14:43:19.618198+0000","last_active":"2024-05-21T14:43:20.797667+0000","last_peered":"2024-05-21T14:43:20.797667+0000","last_clean":"2024-05-21T14:43:20.797667+0000","last_became_active":"2024-05-21T14:43:19.617903+0000","last_became_peered":"2024-05-21T14:43:19.617903+0000","last_unstale":"2024-05-21T14:43:20.797667+0000","last_undegraded":"2024-05-21T14:43:20.797667+0000","last_fullsized":"2024-05-21T14:43:20.797667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:59.606862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580507+0000","last_change":"2024-05-21T14:43:19.613942+0000","last_active":"2024-05-21T14:43:20.580507+0000","last_peered":"2024-05-21T14:43:20.580507+0000","last_clean":"2024-05-21T14:43:20.580507+0000","last_became_active":"2024-05-21T14:43:19.613035+0000","last_became_peered":"2024-05-21T14:43:19.613035+0000","last_unstale":"2024-05-21T14:43:20.580507+0000","last_undegraded":"2024-05-21T14:43:20.580507+0000","last_fullsized":"2024-05-21T14:43:20.580507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:47:46.462547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.065907+0000","last_change":"2024-05-21T14:43:19.626414+0000","last_active":"2024-05-21T14:43:21.065907+0000","last_peered":"2024-05-21T14:43:21.065907+0000","last_clean":"2024-05-21T14:43:21.065907+0000","last_became_active":"2024-05-21T14:43:19.626080+0000","last_became_peered":"2024-05-21T14:43:19.626080+0000","last_unstale":"2024-05-21T14:43:21.065907+0000","last_undegraded":"2024-05-21T14:43:21.065907+0000","last_fullsized":"2024-05-21T14:43:21.065907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:37:38.449284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578382+0000","last_change":"2024-05-21T14:43:19.620806+0000","last_active":"2024-05-21T14:43:20.578382+0000","last_peered":"2024-05-21T14:43:20.578382+0000","last_clean":"2024-05-21T14:43:20.578382+0000","last_became_active":"2024-05-21T14:43:19.620449+0000","last_became_peered":"2024-05-21T14:43:19.620449+0000","last_unstale":"2024-05-21T14:43:20.578382+0000","last_undegraded":"2024-05-21T14:43:20.578382+0000","last_fullsized":"2024-05-21T14:43:20.578382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:43:52.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067339+0000","last_change":"2024-05-21T14:43:18.603028+0000","last_active":"2024-05-21T14:43:21.067339+0000","last_peered":"2024-05-21T14:43:21.067339+0000","last_clean":"2024-05-21T14:43:21.067339+0000","last_became_active":"2024-05-21T14:43:18.602036+0000","last_became_peered":"2024-05-21T14:43:18.602036+0000","last_unstale":"2024-05-21T14:43:21.067339+0000","last_undegraded":"2024-05-21T14:43:21.067339+0000","last_fullsized":"2024-05-21T14:43:21.067339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:15:25.384197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963922+0000","last_change":"2024-05-21T14:43:19.599725+0000","last_active":"2024-05-21T14:43:20.963922+0000","last_peered":"2024-05-21T14:43:20.963922+0000","last_clean":"2024-05-21T14:43:20.963922+0000","last_became_active":"2024-05-21T14:43:19.598972+0000","last_became_peered":"2024-05-21T14:43:19.598972+0000","last_unstale":"2024-05-21T14:43:20.963922+0000","last_undegraded":"2024-05-21T14:43:20.963922+0000","last_fullsized":"2024-05-21T14:43:20.963922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:54:00.871046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.956824+0000","last_change":"2024-05-21T14:43:18.615934+0000","last_active":"2024-05-21T14:43:20.956824+0000","last_peered":"2024-05-21T14:43:20.956824+0000","last_clean":"2024-05-21T14:43:20.956824+0000","last_became_active":"2024-05-21T14:43:18.615568+0000","last_became_peered":"2024-05-21T14:43:18.615568+0000","last_unstale":"2024-05-21T14:43:20.956824+0000","last_undegraded":"2024-05-21T14:43:20.956824+0000","last_fullsized":"2024-05-21T14:43:20.956824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:28:54.494319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580346+0000","last_change":"2024-05-21T14:43:18.615154+0000","last_active":"2024-05-21T14:43:20.580346+0000","last_peered":"2024-05-21T14:43:20.580346+0000","last_clean":"2024-05-21T14:43:20.580346+0000","last_became_active":"2024-05-21T14:43:18.613838+0000","last_became_peered":"2024-05-21T14:43:18.613838+0000","last_unstale":"2024-05-21T14:43:20.580346+0000","last_undegraded":"2024-05-21T14:43:20.580346+0000","last_fullsized":"2024-05-21T14:43:20.580346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:32:09.174124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067194+0000","last_change":"2024-05-21T14:43:19.633585+0000","last_active":"2024-05-21T14:43:21.067194+0000","last_peered":"2024-05-21T14:43:21.067194+0000","last_clean":"2024-05-21T14:43:21.067194+0000","last_became_active":"2024-05-21T14:43:19.632476+0000","last_became_peered":"2024-05-21T14:43:19.632476+0000","last_unstale":"2024-05-21T14:43:21.067194+0000","last_undegraded":"2024-05-21T14:43:21.067194+0000","last_fullsized":"2024-05-21T14:43:21.067194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:53.023931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797713+0000","last_change":"2024-05-21T14:43:18.585548+0000","last_active":"2024-05-21T14:43:20.797713+0000","last_peered":"2024-05-21T14:43:20.797713+0000","last_clean":"2024-05-21T14:43:20.797713+0000","last_became_active":"2024-05-21T14:43:18.585099+0000","last_became_peered":"2024-05-21T14:43:18.585099+0000","last_unstale":"2024-05-21T14:43:20.797713+0000","last_undegraded":"2024-05-21T14:43:20.797713+0000","last_fullsized":"2024-05-21T14:43:20.797713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:20:16.856225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963459+0000","last_change":"2024-05-21T14:43:19.614884+0000","last_active":"2024-05-21T14:43:20.963459+0000","last_peered":"2024-05-21T14:43:20.963459+0000","last_clean":"2024-05-21T14:43:20.963459+0000","last_became_active":"2024-05-21T14:43:19.614064+0000","last_became_peered":"2024-05-21T14:43:19.614064+0000","last_unstale":"2024-05-21T14:43:20.963459+0000","last_undegraded":"2024-05-21T14:43:20.963459+0000","last_fullsized":"2024-05-21T14:43:20.963459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:42:17.091043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578207+0000","last_change":"2024-05-21T14:43:18.602794+0000","last_active":"2024-05-21T14:43:20.578207+0000","last_peered":"2024-05-21T14:43:20.578207+0000","last_clean":"2024-05-21T14:43:20.578207+0000","last_became_active":"2024-05-21T14:43:18.602429+0000","last_became_peered":"2024-05-21T14:43:18.602429+0000","last_unstale":"2024-05-21T14:43:20.578207+0000","last_undegraded":"2024-05-21T14:43:20.578207+0000","last_fullsized":"2024-05-21T14:43:20.578207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:50:14.465202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066483+0000","last_change":"2024-05-21T14:43:19.602663+0000","last_active":"2024-05-21T14:43:21.066483+0000","last_peered":"2024-05-21T14:43:21.066483+0000","last_clean":"2024-05-21T14:43:21.066483+0000","last_became_active":"2024-05-21T14:43:19.602294+0000","last_became_peered":"2024-05-21T14:43:19.602294+0000","last_unstale":"2024-05-21T14:43:21.066483+0000","last_undegraded":"2024-05-21T14:43:21.066483+0000","last_fullsized":"2024-05-21T14:43:21.066483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:48:56.271741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066944+0000","last_change":"2024-05-21T14:43:18.604601+0000","last_active":"2024-05-21T14:43:21.066944+0000","last_peered":"2024-05-21T14:43:21.066944+0000","last_clean":"2024-05-21T14:43:21.066944+0000","last_became_active":"2024-05-21T14:43:18.604262+0000","last_became_peered":"2024-05-21T14:43:18.604262+0000","last_unstale":"2024-05-21T14:43:21.066944+0000","last_undegraded":"2024-05-21T14:43:21.066944+0000","last_fullsized":"2024-05-21T14:43:21.066944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:15.490579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.068019+0000","last_change":"2024-05-21T14:43:19.613952+0000","last_active":"2024-05-21T14:43:21.068019+0000","last_peered":"2024-05-21T14:43:21.068019+0000","last_clean":"2024-05-21T14:43:21.068019+0000","last_became_active":"2024-05-21T14:43:19.613093+0000","last_became_peered":"2024-05-21T14:43:19.613093+0000","last_unstale":"2024-05-21T14:43:21.068019+0000","last_undegraded":"2024-05-21T14:43:21.068019+0000","last_fullsized":"2024-05-21T14:43:21.068019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:03:44.925212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.595969+0000","last_change":"2024-05-21T14:43:18.602343+0000","last_active":"2024-05-21T14:43:24.595969+0000","last_peered":"2024-05-21T14:43:24.595969+0000","last_clean":"2024-05-21T14:43:24.595969+0000","last_became_active":"2024-05-21T14:43:18.601500+0000","last_became_peered":"2024-05-21T14:43:18.601500+0000","last_unstale":"2024-05-21T14:43:24.595969+0000","last_undegraded":"2024-05-21T14:43:24.595969+0000","last_fullsized":"2024-05-21T14:43:24.595969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:54:21.960430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798025+0000","last_change":"2024-05-21T14:43:19.608580+0000","last_active":"2024-05-21T14:43:20.798025+0000","last_peered":"2024-05-21T14:43:20.798025+0000","last_clean":"2024-05-21T14:43:20.798025+0000","last_became_active":"2024-05-21T14:43:19.608038+0000","last_became_peered":"2024-05-21T14:43:19.608038+0000","last_unstale":"2024-05-21T14:43:20.798025+0000","last_undegraded":"2024-05-21T14:43:20.798025+0000","last_fullsized":"2024-05-21T14:43:20.798025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:19.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.596610+0000","last_change":"2024-05-21T14:43:18.606824+0000","last_active":"2024-05-21T14:43:24.596610+0000","last_peered":"2024-05-21T14:43:24.596610+0000","last_clean":"2024-05-21T14:43:24.596610+0000","last_became_active":"2024-05-21T14:43:18.606449+0000","last_became_peered":"2024-05-21T14:43:18.606449+0000","last_unstale":"2024-05-21T14:43:24.596610+0000","last_undegraded":"2024-05-21T14:43:24.596610+0000","last_fullsized":"2024-05-21T14:43:24.596610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:43:41.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066889+0000","last_change":"2024-05-21T14:43:19.634014+0000","last_active":"2024-05-21T14:43:21.066889+0000","last_peered":"2024-05-21T14:43:21.066889+0000","last_clean":"2024-05-21T14:43:21.066889+0000","last_became_active":"2024-05-21T14:43:19.633664+0000","last_became_peered":"2024-05-21T14:43:19.633664+0000","last_unstale":"2024-05-21T14:43:21.066889+0000","last_undegraded":"2024-05-21T14:43:21.066889+0000","last_fullsized":"2024-05-21T14:43:21.066889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:36:07.708164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.592042+0000","last_change":"2024-05-21T14:43:18.614764+0000","last_active":"2024-05-21T14:43:24.592042+0000","last_peered":"2024-05-21T14:43:24.592042+0000","last_clean":"2024-05-21T14:43:24.592042+0000","last_became_active":"2024-05-21T14:43:18.614214+0000","last_became_peered":"2024-05-21T14:43:18.614214+0000","last_unstale":"2024-05-21T14:43:24.592042+0000","last_undegraded":"2024-05-21T14:43:24.592042+0000","last_fullsized":"2024-05-21T14:43:24.592042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:34:40.294756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580771+0000","last_change":"2024-05-21T14:43:19.625313+0000","last_active":"2024-05-21T14:43:20.580771+0000","last_peered":"2024-05-21T14:43:20.580771+0000","last_clean":"2024-05-21T14:43:20.580771+0000","last_became_active":"2024-05-21T14:43:19.624474+0000","last_became_peered":"2024-05-21T14:43:19.624474+0000","last_unstale":"2024-05-21T14:43:20.580771+0000","last_undegraded":"2024-05-21T14:43:20.580771+0000","last_fullsized":"2024-05-21T14:43:20.580771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:28.280456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797927+0000","last_change":"2024-05-21T14:43:18.600736+0000","last_active":"2024-05-21T14:43:20.797927+0000","last_peered":"2024-05-21T14:43:20.797927+0000","last_clean":"2024-05-21T14:43:20.797927+0000","last_became_active":"2024-05-21T14:43:18.600415+0000","last_became_peered":"2024-05-21T14:43:18.600415+0000","last_unstale":"2024-05-21T14:43:20.797927+0000","last_undegraded":"2024-05-21T14:43:20.797927+0000","last_fullsized":"2024-05-21T14:43:20.797927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:03:57.207603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797724+0000","last_change":"2024-05-21T14:43:19.599637+0000","last_active":"2024-05-21T14:43:20.797724+0000","last_peered":"2024-05-21T14:43:20.797724+0000","last_clean":"2024-05-21T14:43:20.797724+0000","last_became_active":"2024-05-21T14:43:19.599195+0000","last_became_peered":"2024-05-21T14:43:19.599195+0000","last_unstale":"2024-05-21T14:43:20.797724+0000","last_undegraded":"2024-05-21T14:43:20.797724+0000","last_fullsized":"2024-05-21T14:43:20.797724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:17.350821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066280+0000","last_change":"2024-05-21T14:43:18.603064+0000","last_active":"2024-05-21T14:43:21.066280+0000","last_peered":"2024-05-21T14:43:21.066280+0000","last_clean":"2024-05-21T14:43:21.066280+0000","last_became_active":"2024-05-21T14:43:18.602658+0000","last_became_peered":"2024-05-21T14:43:18.602658+0000","last_unstale":"2024-05-21T14:43:21.066280+0000","last_undegraded":"2024-05-21T14:43:21.066280+0000","last_fullsized":"2024-05-21T14:43:21.066280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:09:28.623131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.577809+0000","last_change":"2024-05-21T14:43:19.620760+0000","last_active":"2024-05-21T14:43:20.577809+0000","last_peered":"2024-05-21T14:43:20.577809+0000","last_clean":"2024-05-21T14:43:20.577809+0000","last_became_active":"2024-05-21T14:43:19.620409+0000","last_became_peered":"2024-05-21T14:43:19.620409+0000","last_unstale":"2024-05-21T14:43:20.577809+0000","last_undegraded":"2024-05-21T14:43:20.577809+0000","last_fullsized":"2024-05-21T14:43:20.577809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:49:59.051131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.596990+0000","last_change":"2024-05-21T14:43:18.594225+0000","last_active":"2024-05-21T14:43:24.596990+0000","last_peered":"2024-05-21T14:43:24.596990+0000","last_clean":"2024-05-21T14:43:24.596990+0000","last_became_active":"2024-05-21T14:43:18.592335+0000","last_became_peered":"2024-05-21T14:43:18.592335+0000","last_unstale":"2024-05-21T14:43:24.596990+0000","last_undegraded":"2024-05-21T14:43:24.596990+0000","last_fullsized":"2024-05-21T14:43:24.596990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:00:58.772091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797667+0000","last_change":"2024-05-21T14:43:19.612442+0000","last_active":"2024-05-21T14:43:20.797667+0000","last_peered":"2024-05-21T14:43:20.797667+0000","last_clean":"2024-05-21T14:43:20.797667+0000","last_became_active":"2024-05-21T14:43:19.612110+0000","last_became_peered":"2024-05-21T14:43:19.612110+0000","last_unstale":"2024-05-21T14:43:20.797667+0000","last_undegraded":"2024-05-21T14:43:20.797667+0000","last_fullsized":"2024-05-21T14:43:20.797667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:53.451513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067149+0000","last_change":"2024-05-21T14:43:18.613433+0000","last_active":"2024-05-21T14:43:21.067149+0000","last_peered":"2024-05-21T14:43:21.067149+0000","last_clean":"2024-05-21T14:43:21.067149+0000","last_became_active":"2024-05-21T14:43:18.613048+0000","last_became_peered":"2024-05-21T14:43:18.613048+0000","last_unstale":"2024-05-21T14:43:21.067149+0000","last_undegraded":"2024-05-21T14:43:21.067149+0000","last_fullsized":"2024-05-21T14:43:21.067149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:00:16.454574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066572+0000","last_change":"2024-05-21T14:43:19.597079+0000","last_active":"2024-05-21T14:43:21.066572+0000","last_peered":"2024-05-21T14:43:21.066572+0000","last_clean":"2024-05-21T14:43:21.066572+0000","last_became_active":"2024-05-21T14:43:19.596736+0000","last_became_peered":"2024-05-21T14:43:19.596736+0000","last_unstale":"2024-05-21T14:43:21.066572+0000","last_undegraded":"2024-05-21T14:43:21.066572+0000","last_fullsized":"2024-05-21T14:43:21.066572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:09:03.687971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.594003+0000","last_change":"2024-05-21T14:43:18.620603+0000","last_active":"2024-05-21T14:43:24.594003+0000","last_peered":"2024-05-21T14:43:24.594003+0000","last_clean":"2024-05-21T14:43:24.594003+0000","last_became_active":"2024-05-21T14:43:18.619762+0000","last_became_peered":"2024-05-21T14:43:18.619762+0000","last_unstale":"2024-05-21T14:43:24.594003+0000","last_undegraded":"2024-05-21T14:43:24.594003+0000","last_fullsized":"2024-05-21T14:43:24.594003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:31:49.257435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067100+0000","last_change":"2024-05-21T14:43:19.611608+0000","last_active":"2024-05-21T14:43:21.067100+0000","last_peered":"2024-05-21T14:43:21.067100+0000","last_clean":"2024-05-21T14:43:21.067100+0000","last_became_active":"2024-05-21T14:43:19.610774+0000","last_became_peered":"2024-05-21T14:43:19.610774+0000","last_unstale":"2024-05-21T14:43:21.067100+0000","last_undegraded":"2024-05-21T14:43:21.067100+0000","last_fullsized":"2024-05-21T14:43:21.067100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:19:00.383286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067293+0000","last_change":"2024-05-21T14:43:18.610121+0000","last_active":"2024-05-21T14:43:21.067293+0000","last_peered":"2024-05-21T14:43:21.067293+0000","last_clean":"2024-05-21T14:43:21.067293+0000","last_became_active":"2024-05-21T14:43:18.609349+0000","last_became_peered":"2024-05-21T14:43:18.609349+0000","last_unstale":"2024-05-21T14:43:21.067293+0000","last_undegraded":"2024-05-21T14:43:21.067293+0000","last_fullsized":"2024-05-21T14:43:21.067293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:48.330067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066734+0000","last_change":"2024-05-21T14:43:19.605193+0000","last_active":"2024-05-21T14:43:21.066734+0000","last_peered":"2024-05-21T14:43:21.066734+0000","last_clean":"2024-05-21T14:43:21.066734+0000","last_became_active":"2024-05-21T14:43:19.604869+0000","last_became_peered":"2024-05-21T14:43:19.604869+0000","last_unstale":"2024-05-21T14:43:21.066734+0000","last_undegraded":"2024-05-21T14:43:21.066734+0000","last_fullsized":"2024-05-21T14:43:21.066734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:58:05.078363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582847+0000","last_change":"2024-05-21T14:43:18.616535+0000","last_active":"2024-05-21T14:43:20.582847+0000","last_peered":"2024-05-21T14:43:20.582847+0000","last_clean":"2024-05-21T14:43:20.582847+0000","last_became_active":"2024-05-21T14:43:18.615734+0000","last_became_peered":"2024-05-21T14:43:18.615734+0000","last_unstale":"2024-05-21T14:43:20.582847+0000","last_undegraded":"2024-05-21T14:43:20.582847+0000","last_fullsized":"2024-05-21T14:43:20.582847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:10:27.821535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798116+0000","last_change":"2024-05-21T14:43:19.615424+0000","last_active":"2024-05-21T14:43:20.798116+0000","last_peered":"2024-05-21T14:43:20.798116+0000","last_clean":"2024-05-21T14:43:20.798116+0000","last_became_active":"2024-05-21T14:43:19.614915+0000","last_became_peered":"2024-05-21T14:43:19.614915+0000","last_unstale":"2024-05-21T14:43:20.798116+0000","last_undegraded":"2024-05-21T14:43:20.798116+0000","last_fullsized":"2024-05-21T14:43:20.798116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:25:09.153430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.577738+0000","last_change":"2024-05-21T14:43:08.080234+0000","last_active":"2024-05-21T14:43:20.577738+0000","last_peered":"2024-05-21T14:43:20.577738+0000","last_clean":"2024-05-21T14:43:20.577738+0000","last_became_active":"2024-05-21T14:43:08.079934+0000","last_became_peered":"2024-05-21T14:43:08.079934+0000","last_unstale":"2024-05-21T14:43:20.577738+0000","last_undegraded":"2024-05-21T14:43:20.577738+0000","last_fullsized":"2024-05-21T14:43:20.577738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_clean_scrub_stamp":"2024-05-21T14:43:07.046978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:54:57.347768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797966+0000","last_change":"2024-05-21T14:43:18.599850+0000","last_active":"2024-05-21T14:43:20.797966+0000","last_peered":"2024-05-21T14:43:20.797966+0000","last_clean":"2024-05-21T14:43:20.797966+0000","last_became_active":"2024-05-21T14:43:18.599347+0000","last_became_peered":"2024-05-21T14:43:18.599347+0000","last_unstale":"2024-05-21T14:43:20.797966+0000","last_undegraded":"2024-05-21T14:43:20.797966+0000","last_fullsized":"2024-05-21T14:43:20.797966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:01:06.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963423+0000","last_change":"2024-05-21T14:43:19.613056+0000","last_active":"2024-05-21T14:43:20.963423+0000","last_peered":"2024-05-21T14:43:20.963423+0000","last_clean":"2024-05-21T14:43:20.963423+0000","last_became_active":"2024-05-21T14:43:19.611889+0000","last_became_peered":"2024-05-21T14:43:19.611889+0000","last_unstale":"2024-05-21T14:43:20.963423+0000","last_undegraded":"2024-05-21T14:43:20.963423+0000","last_fullsized":"2024-05-21T14:43:20.963423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:46:20.105282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797781+0000","last_change":"2024-05-21T14:43:18.621482+0000","last_active":"2024-05-21T14:43:20.797781+0000","last_peered":"2024-05-21T14:43:20.797781+0000","last_clean":"2024-05-21T14:43:20.797781+0000","last_became_active":"2024-05-21T14:43:18.621229+0000","last_became_peered":"2024-05-21T14:43:18.621229+0000","last_unstale":"2024-05-21T14:43:20.797781+0000","last_undegraded":"2024-05-21T14:43:20.797781+0000","last_fullsized":"2024-05-21T14:43:20.797781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:30:04.326588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580381+0000","last_change":"2024-05-21T14:43:19.625038+0000","last_active":"2024-05-21T14:43:20.580381+0000","last_peered":"2024-05-21T14:43:20.580381+0000","last_clean":"2024-05-21T14:43:20.580381+0000","last_became_active":"2024-05-21T14:43:19.624114+0000","last_became_peered":"2024-05-21T14:43:19.624114+0000","last_unstale":"2024-05-21T14:43:20.580381+0000","last_undegraded":"2024-05-21T14:43:20.580381+0000","last_fullsized":"2024-05-21T14:43:20.580381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:11.854243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580843+0000","last_change":"2024-05-21T14:43:18.618518+0000","last_active":"2024-05-21T14:43:20.580843+0000","last_peered":"2024-05-21T14:43:20.580843+0000","last_clean":"2024-05-21T14:43:20.580843+0000","last_became_active":"2024-05-21T14:43:18.617756+0000","last_became_peered":"2024-05-21T14:43:18.617756+0000","last_unstale":"2024-05-21T14:43:20.580843+0000","last_undegraded":"2024-05-21T14:43:20.580843+0000","last_fullsized":"2024-05-21T14:43:20.580843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:52:12.999877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066783+0000","last_change":"2024-05-21T14:43:19.613595+0000","last_active":"2024-05-21T14:43:21.066783+0000","last_peered":"2024-05-21T14:43:21.066783+0000","last_clean":"2024-05-21T14:43:21.066783+0000","last_became_active":"2024-05-21T14:43:19.612730+0000","last_became_peered":"2024-05-21T14:43:19.612730+0000","last_unstale":"2024-05-21T14:43:21.066783+0000","last_undegraded":"2024-05-21T14:43:21.066783+0000","last_fullsized":"2024-05-21T14:43:21.066783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:01:02.847071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797922+0000","last_change":"2024-05-21T14:43:18.608596+0000","last_active":"2024-05-21T14:43:20.797922+0000","last_peered":"2024-05-21T14:43:20.797922+0000","last_clean":"2024-05-21T14:43:20.797922+0000","last_became_active":"2024-05-21T14:43:18.608262+0000","last_became_peered":"2024-05-21T14:43:18.608262+0000","last_unstale":"2024-05-21T14:43:20.797922+0000","last_undegraded":"2024-05-21T14:43:20.797922+0000","last_fullsized":"2024-05-21T14:43:20.797922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:14.962554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066581+0000","last_change":"2024-05-21T14:43:19.607815+0000","last_active":"2024-05-21T14:43:21.066581+0000","last_peered":"2024-05-21T14:43:21.066581+0000","last_clean":"2024-05-21T14:43:21.066581+0000","last_became_active":"2024-05-21T14:43:19.607513+0000","last_became_peered":"2024-05-21T14:43:19.607513+0000","last_unstale":"2024-05-21T14:43:21.066581+0000","last_undegraded":"2024-05-21T14:43:21.066581+0000","last_fullsized":"2024-05-21T14:43:21.066581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:01:35.332981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066787+0000","last_change":"2024-05-21T14:43:18.603626+0000","last_active":"2024-05-21T14:43:21.066787+0000","last_peered":"2024-05-21T14:43:21.066787+0000","last_clean":"2024-05-21T14:43:21.066787+0000","last_became_active":"2024-05-21T14:43:18.602704+0000","last_became_peered":"2024-05-21T14:43:18.602704+0000","last_unstale":"2024-05-21T14:43:21.066787+0000","last_undegraded":"2024-05-21T14:43:21.066787+0000","last_fullsized":"2024-05-21T14:43:21.066787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:03.976820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066240+0000","last_change":"2024-05-21T14:43:19.634449+0000","last_active":"2024-05-21T14:43:21.066240+0000","last_peered":"2024-05-21T14:43:21.066240+0000","last_clean":"2024-05-21T14:43:21.066240+0000","last_became_active":"2024-05-21T14:43:19.633751+0000","last_became_peered":"2024-05-21T14:43:19.633751+0000","last_unstale":"2024-05-21T14:43:21.066240+0000","last_undegraded":"2024-05-21T14:43:21.066240+0000","last_fullsized":"2024-05-21T14:43:21.066240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:04:51.415303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798236+0000","last_change":"2024-05-21T14:43:18.608335+0000","last_active":"2024-05-21T14:43:20.798236+0000","last_peered":"2024-05-21T14:43:20.798236+0000","last_clean":"2024-05-21T14:43:20.798236+0000","last_became_active":"2024-05-21T14:43:18.607999+0000","last_became_peered":"2024-05-21T14:43:18.607999+0000","last_unstale":"2024-05-21T14:43:20.798236+0000","last_undegraded":"2024-05-21T14:43:20.798236+0000","last_fullsized":"2024-05-21T14:43:20.798236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:21.325953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582549+0000","last_change":"2024-05-21T14:43:19.626742+0000","last_active":"2024-05-21T14:43:20.582549+0000","last_peered":"2024-05-21T14:43:20.582549+0000","last_clean":"2024-05-21T14:43:20.582549+0000","last_became_active":"2024-05-21T14:43:19.626024+0000","last_became_peered":"2024-05-21T14:43:19.626024+0000","last_unstale":"2024-05-21T14:43:20.582549+0000","last_undegraded":"2024-05-21T14:43:20.582549+0000","last_fullsized":"2024-05-21T14:43:20.582549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:48:15.426224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.964590+0000","last_change":"2024-05-21T14:43:18.616913+0000","last_active":"2024-05-21T14:43:20.964590+0000","last_peered":"2024-05-21T14:43:20.964590+0000","last_clean":"2024-05-21T14:43:20.964590+0000","last_became_active":"2024-05-21T14:43:18.616214+0000","last_became_peered":"2024-05-21T14:43:18.616214+0000","last_unstale":"2024-05-21T14:43:20.964590+0000","last_undegraded":"2024-05-21T14:43:20.964590+0000","last_fullsized":"2024-05-21T14:43:20.964590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:22.112018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963796+0000","last_change":"2024-05-21T14:43:19.607521+0000","last_active":"2024-05-21T14:43:20.963796+0000","last_peered":"2024-05-21T14:43:20.963796+0000","last_clean":"2024-05-21T14:43:20.963796+0000","last_became_active":"2024-05-21T14:43:19.606673+0000","last_became_peered":"2024-05-21T14:43:19.606673+0000","last_unstale":"2024-05-21T14:43:20.963796+0000","last_undegraded":"2024-05-21T14:43:20.963796+0000","last_fullsized":"2024-05-21T14:43:20.963796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:50:50.373410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.586589+0000","last_change":"2024-05-21T14:43:18.615846+0000","last_active":"2024-05-21T14:43:24.586589+0000","last_peered":"2024-05-21T14:43:24.586589+0000","last_clean":"2024-05-21T14:43:24.586589+0000","last_became_active":"2024-05-21T14:43:18.615506+0000","last_became_peered":"2024-05-21T14:43:18.615506+0000","last_unstale":"2024-05-21T14:43:24.586589+0000","last_undegraded":"2024-05-21T14:43:24.586589+0000","last_fullsized":"2024-05-21T14:43:24.586589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:07:17.030757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.964252+0000","last_change":"2024-05-21T14:43:19.611473+0000","last_active":"2024-05-21T14:43:20.964252+0000","last_peered":"2024-05-21T14:43:20.964252+0000","last_clean":"2024-05-21T14:43:20.964252+0000","last_became_active":"2024-05-21T14:43:19.610600+0000","last_became_peered":"2024-05-21T14:43:19.610600+0000","last_unstale":"2024-05-21T14:43:20.964252+0000","last_undegraded":"2024-05-21T14:43:20.964252+0000","last_fullsized":"2024-05-21T14:43:20.964252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:48:07.659795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.065773+0000","last_change":"2024-05-21T14:43:18.604951+0000","last_active":"2024-05-21T14:43:21.065773+0000","last_peered":"2024-05-21T14:43:21.065773+0000","last_clean":"2024-05-21T14:43:21.065773+0000","last_became_active":"2024-05-21T14:43:18.602186+0000","last_became_peered":"2024-05-21T14:43:18.602186+0000","last_unstale":"2024-05-21T14:43:21.065773+0000","last_undegraded":"2024-05-21T14:43:21.065773+0000","last_fullsized":"2024-05-21T14:43:21.065773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:34:10.395484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797647+0000","last_change":"2024-05-21T14:43:19.600827+0000","last_active":"2024-05-21T14:43:20.797647+0000","last_peered":"2024-05-21T14:43:20.797647+0000","last_clean":"2024-05-21T14:43:20.797647+0000","last_became_active":"2024-05-21T14:43:19.600499+0000","last_became_peered":"2024-05-21T14:43:19.600499+0000","last_unstale":"2024-05-21T14:43:20.797647+0000","last_undegraded":"2024-05-21T14:43:20.797647+0000","last_fullsized":"2024-05-21T14:43:20.797647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:55:36.231321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963274+0000","last_change":"2024-05-21T14:43:18.615190+0000","last_active":"2024-05-21T14:43:20.963274+0000","last_peered":"2024-05-21T14:43:20.963274+0000","last_clean":"2024-05-21T14:43:20.963274+0000","last_became_active":"2024-05-21T14:43:18.614306+0000","last_became_peered":"2024-05-21T14:43:18.614306+0000","last_unstale":"2024-05-21T14:43:20.963274+0000","last_undegraded":"2024-05-21T14:43:20.963274+0000","last_fullsized":"2024-05-21T14:43:20.963274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:53.472559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.962948+0000","last_change":"2024-05-21T14:43:19.610903+0000","last_active":"2024-05-21T14:43:20.962948+0000","last_peered":"2024-05-21T14:43:20.962948+0000","last_clean":"2024-05-21T14:43:20.962948+0000","last_became_active":"2024-05-21T14:43:19.610101+0000","last_became_peered":"2024-05-21T14:43:19.610101+0000","last_unstale":"2024-05-21T14:43:20.962948+0000","last_undegraded":"2024-05-21T14:43:20.962948+0000","last_fullsized":"2024-05-21T14:43:20.962948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:16:24.580581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581222+0000","last_change":"2024-05-21T14:43:18.617785+0000","last_active":"2024-05-21T14:43:20.581222+0000","last_peered":"2024-05-21T14:43:20.581222+0000","last_clean":"2024-05-21T14:43:20.581222+0000","last_became_active":"2024-05-21T14:43:18.617041+0000","last_became_peered":"2024-05-21T14:43:18.617041+0000","last_unstale":"2024-05-21T14:43:20.581222+0000","last_undegraded":"2024-05-21T14:43:20.581222+0000","last_fullsized":"2024-05-21T14:43:20.581222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:02:50.837158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581606+0000","last_change":"2024-05-21T14:43:19.627096+0000","last_active":"2024-05-21T14:43:20.581606+0000","last_peered":"2024-05-21T14:43:20.581606+0000","last_clean":"2024-05-21T14:43:20.581606+0000","last_became_active":"2024-05-21T14:43:19.626265+0000","last_became_peered":"2024-05-21T14:43:19.626265+0000","last_unstale":"2024-05-21T14:43:20.581606+0000","last_undegraded":"2024-05-21T14:43:20.581606+0000","last_fullsized":"2024-05-21T14:43:20.581606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:23:47.818120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.586633+0000","last_change":"2024-05-21T14:43:18.599635+0000","last_active":"2024-05-21T14:43:24.586633+0000","last_peered":"2024-05-21T14:43:24.586633+0000","last_clean":"2024-05-21T14:43:24.586633+0000","last_became_active":"2024-05-21T14:43:18.598996+0000","last_became_peered":"2024-05-21T14:43:18.598996+0000","last_unstale":"2024-05-21T14:43:24.586633+0000","last_undegraded":"2024-05-21T14:43:24.586633+0000","last_fullsized":"2024-05-21T14:43:24.586633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:17:09.383291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797767+0000","last_change":"2024-05-21T14:43:19.617686+0000","last_active":"2024-05-21T14:43:20.797767+0000","last_peered":"2024-05-21T14:43:20.797767+0000","last_clean":"2024-05-21T14:43:20.797767+0000","last_became_active":"2024-05-21T14:43:19.617398+0000","last_became_peered":"2024-05-21T14:43:19.617398+0000","last_unstale":"2024-05-21T14:43:20.797767+0000","last_undegraded":"2024-05-21T14:43:20.797767+0000","last_fullsized":"2024-05-21T14:43:20.797767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:21:06.527871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798047+0000","last_change":"2024-05-21T14:43:19.601673+0000","last_active":"2024-05-21T14:43:20.798047+0000","last_peered":"2024-05-21T14:43:20.798047+0000","last_clean":"2024-05-21T14:43:20.798047+0000","last_became_active":"2024-05-21T14:43:19.601286+0000","last_became_peered":"2024-05-21T14:43:19.601286+0000","last_unstale":"2024-05-21T14:43:20.798047+0000","last_undegraded":"2024-05-21T14:43:20.798047+0000","last_fullsized":"2024-05-21T14:43:20.798047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:21:22.955055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.587618+0000","last_change":"2024-05-21T14:43:18.613555+0000","last_active":"2024-05-21T14:43:24.587618+0000","last_peered":"2024-05-21T14:43:24.587618+0000","last_clean":"2024-05-21T14:43:24.587618+0000","last_became_active":"2024-05-21T14:43:18.613117+0000","last_became_peered":"2024-05-21T14:43:18.613117+0000","last_unstale":"2024-05-21T14:43:24.587618+0000","last_undegraded":"2024-05-21T14:43:24.587618+0000","last_fullsized":"2024-05-21T14:43:24.587618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:38.151165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578450+0000","last_change":"2024-05-21T14:43:19.596736+0000","last_active":"2024-05-21T14:43:20.578450+0000","last_peered":"2024-05-21T14:43:20.578450+0000","last_clean":"2024-05-21T14:43:20.578450+0000","last_became_active":"2024-05-21T14:43:19.596157+0000","last_became_peered":"2024-05-21T14:43:19.596157+0000","last_unstale":"2024-05-21T14:43:20.578450+0000","last_undegraded":"2024-05-21T14:43:20.578450+0000","last_fullsized":"2024-05-21T14:43:20.578450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:22:14.002930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.587574+0000","last_change":"2024-05-21T14:43:18.614044+0000","last_active":"2024-05-21T14:43:24.587574+0000","last_peered":"2024-05-21T14:43:24.587574+0000","last_clean":"2024-05-21T14:43:24.587574+0000","last_became_active":"2024-05-21T14:43:18.613730+0000","last_became_peered":"2024-05-21T14:43:18.613730+0000","last_unstale":"2024-05-21T14:43:24.587574+0000","last_undegraded":"2024-05-21T14:43:24.587574+0000","last_fullsized":"2024-05-21T14:43:24.587574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:41:34.787779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067780+0000","last_change":"2024-05-21T14:43:19.621999+0000","last_active":"2024-05-21T14:43:21.067780+0000","last_peered":"2024-05-21T14:43:21.067780+0000","last_clean":"2024-05-21T14:43:21.067780+0000","last_became_active":"2024-05-21T14:43:19.614744+0000","last_became_peered":"2024-05-21T14:43:19.614744+0000","last_unstale":"2024-05-21T14:43:21.067780+0000","last_undegraded":"2024-05-21T14:43:21.067780+0000","last_fullsized":"2024-05-21T14:43:21.067780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:32:37.316833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067863+0000","last_change":"2024-05-21T14:43:18.614193+0000","last_active":"2024-05-21T14:43:21.067863+0000","last_peered":"2024-05-21T14:43:21.067863+0000","last_clean":"2024-05-21T14:43:21.067863+0000","last_became_active":"2024-05-21T14:43:18.609797+0000","last_became_peered":"2024-05-21T14:43:18.609797+0000","last_unstale":"2024-05-21T14:43:21.067863+0000","last_undegraded":"2024-05-21T14:43:21.067863+0000","last_fullsized":"2024-05-21T14:43:21.067863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:39:55.623816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067766+0000","last_change":"2024-05-21T14:43:19.610578+0000","last_active":"2024-05-21T14:43:21.067766+0000","last_peered":"2024-05-21T14:43:21.067766+0000","last_clean":"2024-05-21T14:43:21.067766+0000","last_became_active":"2024-05-21T14:43:19.606575+0000","last_became_peered":"2024-05-21T14:43:19.606575+0000","last_unstale":"2024-05-21T14:43:21.067766+0000","last_undegraded":"2024-05-21T14:43:21.067766+0000","last_fullsized":"2024-05-21T14:43:21.067766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:50:06.088520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.594513+0000","last_change":"2024-05-21T14:43:18.601862+0000","last_active":"2024-05-21T14:43:24.594513+0000","last_peered":"2024-05-21T14:43:24.594513+0000","last_clean":"2024-05-21T14:43:24.594513+0000","last_became_active":"2024-05-21T14:43:18.601311+0000","last_became_peered":"2024-05-21T14:43:18.601311+0000","last_unstale":"2024-05-21T14:43:24.594513+0000","last_undegraded":"2024-05-21T14:43:24.594513+0000","last_fullsized":"2024-05-21T14:43:24.594513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:02.736061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":671695,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":671673,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T14:43:30.575 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T14:43:30.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.757+0000 7f87c8a00640 1 Processor -- start 2024-05-21T14:43:30.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.761+0000 7f87c8a00640 1 -- start start 2024-05-21T14:43:30.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.761+0000 7f87c8a00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f87c4153870 0x7f87c40c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:30.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.761+0000 7f87c8a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f87c4161e40 0x7f87c4164260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:30.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.761+0000 7f87c8a00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87c40c9060 con 0x7f87c4159ec0 2024-05-21T14:43:30.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.761+0000 7f87c8a00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f87c415cef0 con 0x7f87c4153870 2024-05-21T14:43:30.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.761+0000 7f87c8a00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f87c415d140 con 0x7f87c4161e40 2024-05-21T14:43:30.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.761+0000 7f87c3400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f87c4153870 0x7f87c40c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:30.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.761+0000 7f87c3400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f87c4153870 0x7f87c40c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38610/0 (socket says 172.21.15.78:38610) 2024-05-21T14:43:30.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.761+0000 7f87c3400640 1 -- 172.21.15.78:0/221702271 learned_addr learned my addr 172.21.15.78:0/221702271 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:30.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.761+0000 7f87c3e00640 1 --2- 172.21.15.78:0/221702271 >> v2:172.21.15.84:3300/0 conn(0x7f87c4161e40 0x7f87c4164260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:30.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.761+0000 7f87c3400640 1 -- 172.21.15.78:0/221702271 >> v2:172.21.15.84:3300/0 conn(0x7f87c4161e40 msgr2=0x7f87c4164260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:30.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.761+0000 7f87c3400640 1 --2- 172.21.15.78:0/221702271 >> v2:172.21.15.84:3300/0 conn(0x7f87c4161e40 0x7f87c4164260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.761+0000 7f87c3400640 1 -- 172.21.15.78:0/221702271 >> v1:172.21.15.84:6789/0 conn(0x7f87c4159ec0 legacy=0x7f87c406f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.761+0000 7f87c3400640 1 -- 172.21.15.78:0/221702271 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c415d9c0 con 0x7f87c4153870 2024-05-21T14:43:30.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.765+0000 7f87c3400640 1 --2- 172.21.15.78:0/221702271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87c4153870 0x7f87c40c8b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f87c406c950 tx=0x7f87b401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f857744409ca3887 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:30.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.765+0000 7f87c2000640 1 -- 172.21.15.78:0/221702271 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b40b5070 con 0x7f87c4153870 2024-05-21T14:43:30.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.765+0000 7f87c2000640 1 -- 172.21.15.78:0/221702271 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b40a8a10 con 0x7f87c4153870 2024-05-21T14:43:30.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.765+0000 7f87c2000640 1 -- 172.21.15.78:0/221702271 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b40a8de0 con 0x7f87c4153870 2024-05-21T14:43:30.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.765+0000 7f87c8a00640 1 -- 172.21.15.78:0/221702271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87c4153870 msgr2=0x7f87c40c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.765+0000 7f87c8a00640 1 --2- 172.21.15.78:0/221702271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87c4153870 0x7f87c40c8b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f87c406c950 tx=0x7f87b401ed10 comp rx=0 tx=0).stop 2024-05-21T14:43:30.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.765+0000 7f87c8a00640 1 -- 172.21.15.78:0/221702271 shutdown_connections 2024-05-21T14:43:30.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.765+0000 7f87c8a00640 1 --2- 172.21.15.78:0/221702271 >> v2:172.21.15.84:3300/0 conn(0x7f87c4161e40 0x7f87c4164260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.765+0000 7f87c8a00640 1 --2- 172.21.15.78:0/221702271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87c4153870 0x7f87c40c8b20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.765+0000 7f87c8a00640 1 -- 172.21.15.78:0/221702271 >> 172.21.15.78:0/221702271 conn(0x7f87c406b7f0 msgr2=0x7f87c406bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:30.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.769+0000 7f87c8a00640 1 -- 172.21.15.78:0/221702271 shutdown_connections 2024-05-21T14:43:30.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.769+0000 7f87c8a00640 1 -- 172.21.15.78:0/221702271 wait complete. 2024-05-21T14:43:30.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.769+0000 7f87c8a00640 1 Processor -- start 2024-05-21T14:43:30.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.769+0000 7f87c8a00640 1 -- start start 2024-05-21T14:43:30.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.769+0000 7f87c8a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87c4153870 0x7f87c4156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:30.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.769+0000 7f87c8a00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f87c4159ec0 0x7f87c40c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:30.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.769+0000 7f87c8a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87c4161e40 0x7f87c414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:30.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.769+0000 7f87c8a00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f87c41596c0 con 0x7f87c4161e40 2024-05-21T14:43:30.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.769+0000 7f87c8a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f87c415d6e0 con 0x7f87c4153870 2024-05-21T14:43:30.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.769+0000 7f87c8a00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f87c41599a0 con 0x7f87c4159ec0 2024-05-21T14:43:30.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.769+0000 7f87c3e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87c4161e40 0x7f87c414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:30.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87c3e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87c4161e40 0x7f87c414e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38616/0 (socket says 172.21.15.78:38616) 2024-05-21T14:43:30.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87c3e00640 1 -- 172.21.15.78:0/187811154 learned_addr learned my addr 172.21.15.78:0/187811154 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:30.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87c3400640 1 --2- 172.21.15.78:0/187811154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87c4153870 0x7f87c4156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:30.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87c2a00640 1 --2- 172.21.15.78:0/187811154 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f87c4159ec0 0x7f87c40c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:30.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87c3e00640 1 -- 172.21.15.78:0/187811154 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f87c4159ec0 msgr2=0x7f87c40c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87c3e00640 1 --2- 172.21.15.78:0/187811154 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f87c4159ec0 0x7f87c40c4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87c3e00640 1 -- 172.21.15.78:0/187811154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87c4153870 msgr2=0x7f87c4156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87c3e00640 1 --2- 172.21.15.78:0/187811154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87c4153870 0x7f87c4156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87c3e00640 1 -- 172.21.15.78:0/187811154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c41f10d0 con 0x7f87c4161e40 2024-05-21T14:43:30.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87c2a00640 1 --2- 172.21.15.78:0/187811154 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f87c4159ec0 0x7f87c40c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:30.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87c3e00640 1 --2- 172.21.15.78:0/187811154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87c4161e40 0x7f87c414e4b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00efc0 tx=0x7f87bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:30.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87bb400640 1 -- 172.21.15.78:0/187811154 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc018020 con 0x7f87c4161e40 2024-05-21T14:43:30.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87bb400640 1 -- 172.21.15.78:0/187811154 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87bc014480 con 0x7f87c4161e40 2024-05-21T14:43:30.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87bb400640 1 -- 172.21.15.78:0/187811154 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc009e60 con 0x7f87c4161e40 2024-05-21T14:43:30.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87c8a00640 1 -- 172.21.15.78:0/187811154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c40c5530 con 0x7f87c4161e40 2024-05-21T14:43:30.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87c8a00640 1 -- 172.21.15.78:0/187811154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c41f0df0 con 0x7f87c4161e40 2024-05-21T14:43:30.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87c8a00640 1 -- 172.21.15.78:0/187811154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c4069f30 con 0x7f87c4161e40 2024-05-21T14:43:30.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.773+0000 7f87bb400640 1 -- 172.21.15.78:0/187811154 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f87bc01b020 con 0x7f87c4161e40 2024-05-21T14:43:30.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.777+0000 7f87bb400640 1 --2- 172.21.15.78:0/187811154 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f87a40678c0 0x7f87a4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:30.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.777+0000 7f87bb400640 1 -- 172.21.15.78:0/187811154 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f87bc0869b0 con 0x7f87c4161e40 2024-05-21T14:43:30.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.777+0000 7f87c3400640 1 --2- 172.21.15.78:0/187811154 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f87a40678c0 0x7f87a4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:30.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.777+0000 7f87c3400640 1 --2- 172.21.15.78:0/187811154 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f87a40678c0 0x7f87a4069dd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f87b40b2000 tx=0x7f87b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:30.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.781+0000 7f87bb400640 1 -- 172.21.15.78:0/187811154 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f87bc022030 con 0x7f87c4161e40 2024-05-21T14:43:30.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.949+0000 7f87c8a00640 1 -- 172.21.15.78:0/187811154 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87c41585d0 con 0x7f87a40678c0 2024-05-21T14:43:30.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.969+0000 7f87bb400640 1 -- 172.21.15.78:0/187811154 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251909 (secure 0 0 0) 0x7f87c41585d0 con 0x7f87a40678c0 2024-05-21T14:43:30.978 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:30.980 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-05-21T14:43:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.973+0000 7f87c8a00640 1 -- 172.21.15.78:0/187811154 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f87a40678c0 msgr2=0x7f87a4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.973+0000 7f87c8a00640 1 --2- 172.21.15.78:0/187811154 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f87a40678c0 0x7f87a4069dd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f87b40b2000 tx=0x7f87b4009040 comp rx=0 tx=0).stop 2024-05-21T14:43:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.973+0000 7f87c8a00640 1 -- 172.21.15.78:0/187811154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87c4161e40 msgr2=0x7f87c414e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.973+0000 7f87c8a00640 1 --2- 172.21.15.78:0/187811154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87c4161e40 0x7f87c414e4b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00efc0 tx=0x7f87bc00c490 comp rx=0 tx=0).stop 2024-05-21T14:43:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.973+0000 7f87c8a00640 1 -- 172.21.15.78:0/187811154 shutdown_connections 2024-05-21T14:43:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.973+0000 7f87c8a00640 1 --2- 172.21.15.78:0/187811154 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f87a40678c0 0x7f87a4069dd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.973+0000 7f87c8a00640 1 --2- 172.21.15.78:0/187811154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87c4161e40 0x7f87c414e4b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.973+0000 7f87c8a00640 1 --2- 172.21.15.78:0/187811154 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f87c4159ec0 0x7f87c40c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.973+0000 7f87c8a00640 1 --2- 172.21.15.78:0/187811154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87c4153870 0x7f87c4156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.973+0000 7f87c8a00640 1 -- 172.21.15.78:0/187811154 >> 172.21.15.78:0/187811154 conn(0x7f87c406b7f0 msgr2=0x7f87c4152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.973+0000 7f87c8a00640 1 -- 172.21.15.78:0/187811154 shutdown_connections 2024-05-21T14:43:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:30.973+0000 7f87c8a00640 1 -- 172.21.15.78:0/187811154 wait complete. 2024-05-21T14:43:30.999 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-05-21T14:43:30.490504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218156,"kb_used_data":2016,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756564,"statfs":{"total":773094113280,"available":772870721536,"internally_reserved":0,"allocated":2064384,"data_stored":1835436,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.004347"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067056+0000","last_change":"2024-05-21T14:43:19.606707+0000","last_active":"2024-05-21T14:43:21.067056+0000","last_peered":"2024-05-21T14:43:21.067056+0000","last_clean":"2024-05-21T14:43:21.067056+0000","last_became_active":"2024-05-21T14:43:19.606365+0000","last_became_peered":"2024-05-21T14:43:19.606365+0000","last_unstale":"2024-05-21T14:43:21.067056+0000","last_undegraded":"2024-05-21T14:43:21.067056+0000","last_fullsized":"2024-05-21T14:43:21.067056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:26.135357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067577+0000","last_change":"2024-05-21T14:43:19.632879+0000","last_active":"2024-05-21T14:43:21.067577+0000","last_peered":"2024-05-21T14:43:21.067577+0000","last_clean":"2024-05-21T14:43:21.067577+0000","last_became_active":"2024-05-21T14:43:19.632218+0000","last_became_peered":"2024-05-21T14:43:19.632218+0000","last_unstale":"2024-05-21T14:43:21.067577+0000","last_undegraded":"2024-05-21T14:43:21.067577+0000","last_fullsized":"2024-05-21T14:43:21.067577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:35:49.461861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066825+0000","last_change":"2024-05-21T14:43:19.620214+0000","last_active":"2024-05-21T14:43:21.066825+0000","last_peered":"2024-05-21T14:43:21.066825+0000","last_clean":"2024-05-21T14:43:21.066825+0000","last_became_active":"2024-05-21T14:43:19.619012+0000","last_became_peered":"2024-05-21T14:43:19.619012+0000","last_unstale":"2024-05-21T14:43:21.066825+0000","last_undegraded":"2024-05-21T14:43:21.066825+0000","last_fullsized":"2024-05-21T14:43:21.066825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:40:22.415178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066035+0000","last_change":"2024-05-21T14:43:19.602199+0000","last_active":"2024-05-21T14:43:21.066035+0000","last_peered":"2024-05-21T14:43:21.066035+0000","last_clean":"2024-05-21T14:43:21.066035+0000","last_became_active":"2024-05-21T14:43:19.601797+0000","last_became_peered":"2024-05-21T14:43:19.601797+0000","last_unstale":"2024-05-21T14:43:21.066035+0000","last_undegraded":"2024-05-21T14:43:21.066035+0000","last_fullsized":"2024-05-21T14:43:21.066035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:33:00.071681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066510+0000","last_change":"2024-05-21T14:43:19.623449+0000","last_active":"2024-05-21T14:43:21.066510+0000","last_peered":"2024-05-21T14:43:21.066510+0000","last_clean":"2024-05-21T14:43:21.066510+0000","last_became_active":"2024-05-21T14:43:19.623125+0000","last_became_peered":"2024-05-21T14:43:19.623125+0000","last_unstale":"2024-05-21T14:43:21.066510+0000","last_undegraded":"2024-05-21T14:43:21.066510+0000","last_fullsized":"2024-05-21T14:43:21.066510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:42.178156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.065985+0000","last_change":"2024-05-21T14:43:19.591222+0000","last_active":"2024-05-21T14:43:21.065985+0000","last_peered":"2024-05-21T14:43:21.065985+0000","last_clean":"2024-05-21T14:43:21.065985+0000","last_became_active":"2024-05-21T14:43:19.590858+0000","last_became_peered":"2024-05-21T14:43:19.590858+0000","last_unstale":"2024-05-21T14:43:21.065985+0000","last_undegraded":"2024-05-21T14:43:21.065985+0000","last_fullsized":"2024-05-21T14:43:21.065985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:21:15.737192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066173+0000","last_change":"2024-05-21T14:43:19.614716+0000","last_active":"2024-05-21T14:43:21.066173+0000","last_peered":"2024-05-21T14:43:21.066173+0000","last_clean":"2024-05-21T14:43:21.066173+0000","last_became_active":"2024-05-21T14:43:19.614451+0000","last_became_peered":"2024-05-21T14:43:19.614451+0000","last_unstale":"2024-05-21T14:43:21.066173+0000","last_undegraded":"2024-05-21T14:43:21.066173+0000","last_fullsized":"2024-05-21T14:43:21.066173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:07:01.524574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066544+0000","last_change":"2024-05-21T14:43:19.604029+0000","last_active":"2024-05-21T14:43:21.066544+0000","last_peered":"2024-05-21T14:43:21.066544+0000","last_clean":"2024-05-21T14:43:21.066544+0000","last_became_active":"2024-05-21T14:43:19.603164+0000","last_became_peered":"2024-05-21T14:43:19.603164+0000","last_unstale":"2024-05-21T14:43:21.066544+0000","last_undegraded":"2024-05-21T14:43:21.066544+0000","last_fullsized":"2024-05-21T14:43:21.066544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:14:27.286952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578218+0000","last_change":"2024-05-21T14:43:19.613765+0000","last_active":"2024-05-21T14:43:20.578218+0000","last_peered":"2024-05-21T14:43:20.578218+0000","last_clean":"2024-05-21T14:43:20.578218+0000","last_became_active":"2024-05-21T14:43:19.613429+0000","last_became_peered":"2024-05-21T14:43:19.613429+0000","last_unstale":"2024-05-21T14:43:20.578218+0000","last_undegraded":"2024-05-21T14:43:20.578218+0000","last_fullsized":"2024-05-21T14:43:20.578218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:29:16.905434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066956+0000","last_change":"2024-05-21T14:43:19.607400+0000","last_active":"2024-05-21T14:43:21.066956+0000","last_peered":"2024-05-21T14:43:21.066956+0000","last_clean":"2024-05-21T14:43:21.066956+0000","last_became_active":"2024-05-21T14:43:19.607105+0000","last_became_peered":"2024-05-21T14:43:19.607105+0000","last_unstale":"2024-05-21T14:43:21.066956+0000","last_undegraded":"2024-05-21T14:43:21.066956+0000","last_fullsized":"2024-05-21T14:43:21.066956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:26:22.366105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066810+0000","last_change":"2024-05-21T14:43:19.606534+0000","last_active":"2024-05-21T14:43:21.066810+0000","last_peered":"2024-05-21T14:43:21.066810+0000","last_clean":"2024-05-21T14:43:21.066810+0000","last_became_active":"2024-05-21T14:43:19.606029+0000","last_became_peered":"2024-05-21T14:43:19.606029+0000","last_unstale":"2024-05-21T14:43:21.066810+0000","last_undegraded":"2024-05-21T14:43:21.066810+0000","last_fullsized":"2024-05-21T14:43:21.066810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:33:48.849701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066546+0000","last_change":"2024-05-21T14:43:19.609910+0000","last_active":"2024-05-21T14:43:21.066546+0000","last_peered":"2024-05-21T14:43:21.066546+0000","last_clean":"2024-05-21T14:43:21.066546+0000","last_became_active":"2024-05-21T14:43:19.609616+0000","last_became_peered":"2024-05-21T14:43:19.609616+0000","last_unstale":"2024-05-21T14:43:21.066546+0000","last_undegraded":"2024-05-21T14:43:21.066546+0000","last_fullsized":"2024-05-21T14:43:21.066546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:36:16.637620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581855+0000","last_change":"2024-05-21T14:43:19.604001+0000","last_active":"2024-05-21T14:43:20.581855+0000","last_peered":"2024-05-21T14:43:20.581855+0000","last_clean":"2024-05-21T14:43:20.581855+0000","last_became_active":"2024-05-21T14:43:19.596859+0000","last_became_peered":"2024-05-21T14:43:19.596859+0000","last_unstale":"2024-05-21T14:43:20.581855+0000","last_undegraded":"2024-05-21T14:43:20.581855+0000","last_fullsized":"2024-05-21T14:43:20.581855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:45:43.431420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580379+0000","last_change":"2024-05-21T14:43:19.626837+0000","last_active":"2024-05-21T14:43:20.580379+0000","last_peered":"2024-05-21T14:43:20.580379+0000","last_clean":"2024-05-21T14:43:20.580379+0000","last_became_active":"2024-05-21T14:43:19.626213+0000","last_became_peered":"2024-05-21T14:43:19.626213+0000","last_unstale":"2024-05-21T14:43:20.580379+0000","last_undegraded":"2024-05-21T14:43:20.580379+0000","last_fullsized":"2024-05-21T14:43:20.580379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:51.705474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066538+0000","last_change":"2024-05-21T14:43:19.613483+0000","last_active":"2024-05-21T14:43:21.066538+0000","last_peered":"2024-05-21T14:43:21.066538+0000","last_clean":"2024-05-21T14:43:21.066538+0000","last_became_active":"2024-05-21T14:43:19.612581+0000","last_became_peered":"2024-05-21T14:43:19.612581+0000","last_unstale":"2024-05-21T14:43:21.066538+0000","last_undegraded":"2024-05-21T14:43:21.066538+0000","last_fullsized":"2024-05-21T14:43:21.066538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:41:15.797196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797569+0000","last_change":"2024-05-21T14:43:19.609126+0000","last_active":"2024-05-21T14:43:20.797569+0000","last_peered":"2024-05-21T14:43:20.797569+0000","last_clean":"2024-05-21T14:43:20.797569+0000","last_became_active":"2024-05-21T14:43:19.607967+0000","last_became_peered":"2024-05-21T14:43:19.607967+0000","last_unstale":"2024-05-21T14:43:20.797569+0000","last_undegraded":"2024-05-21T14:43:20.797569+0000","last_fullsized":"2024-05-21T14:43:20.797569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:35.881039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798283+0000","last_change":"2024-05-21T14:43:19.613487+0000","last_active":"2024-05-21T14:43:20.798283+0000","last_peered":"2024-05-21T14:43:20.798283+0000","last_clean":"2024-05-21T14:43:20.798283+0000","last_became_active":"2024-05-21T14:43:19.611280+0000","last_became_peered":"2024-05-21T14:43:19.611280+0000","last_unstale":"2024-05-21T14:43:20.798283+0000","last_undegraded":"2024-05-21T14:43:20.798283+0000","last_fullsized":"2024-05-21T14:43:20.798283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:51:21.887715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581838+0000","last_change":"2024-05-21T14:43:19.607601+0000","last_active":"2024-05-21T14:43:20.581838+0000","last_peered":"2024-05-21T14:43:20.581838+0000","last_clean":"2024-05-21T14:43:20.581838+0000","last_became_active":"2024-05-21T14:43:19.606719+0000","last_became_peered":"2024-05-21T14:43:19.606719+0000","last_unstale":"2024-05-21T14:43:20.581838+0000","last_undegraded":"2024-05-21T14:43:20.581838+0000","last_fullsized":"2024-05-21T14:43:20.581838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:04:32.310805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798234+0000","last_change":"2024-05-21T14:43:19.618470+0000","last_active":"2024-05-21T14:43:20.798234+0000","last_peered":"2024-05-21T14:43:20.798234+0000","last_clean":"2024-05-21T14:43:20.798234+0000","last_became_active":"2024-05-21T14:43:19.617408+0000","last_became_peered":"2024-05-21T14:43:19.617408+0000","last_unstale":"2024-05-21T14:43:20.798234+0000","last_undegraded":"2024-05-21T14:43:20.798234+0000","last_fullsized":"2024-05-21T14:43:20.798234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:53:58.877306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066709+0000","last_change":"2024-05-21T14:43:19.609835+0000","last_active":"2024-05-21T14:43:21.066709+0000","last_peered":"2024-05-21T14:43:21.066709+0000","last_clean":"2024-05-21T14:43:21.066709+0000","last_became_active":"2024-05-21T14:43:19.609525+0000","last_became_peered":"2024-05-21T14:43:19.609525+0000","last_unstale":"2024-05-21T14:43:21.066709+0000","last_undegraded":"2024-05-21T14:43:21.066709+0000","last_fullsized":"2024-05-21T14:43:21.066709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:57:04.748898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963454+0000","last_change":"2024-05-21T14:43:19.607732+0000","last_active":"2024-05-21T14:43:20.963454+0000","last_peered":"2024-05-21T14:43:20.963454+0000","last_clean":"2024-05-21T14:43:20.963454+0000","last_became_active":"2024-05-21T14:43:19.606839+0000","last_became_peered":"2024-05-21T14:43:19.606839+0000","last_unstale":"2024-05-21T14:43:20.963454+0000","last_undegraded":"2024-05-21T14:43:20.963454+0000","last_fullsized":"2024-05-21T14:43:20.963454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:43:15.675663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578145+0000","last_change":"2024-05-21T14:43:19.601108+0000","last_active":"2024-05-21T14:43:20.578145+0000","last_peered":"2024-05-21T14:43:20.578145+0000","last_clean":"2024-05-21T14:43:20.578145+0000","last_became_active":"2024-05-21T14:43:19.600780+0000","last_became_peered":"2024-05-21T14:43:19.600780+0000","last_unstale":"2024-05-21T14:43:20.578145+0000","last_undegraded":"2024-05-21T14:43:20.578145+0000","last_fullsized":"2024-05-21T14:43:20.578145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:47:19.062733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067184+0000","last_change":"2024-05-21T14:43:19.620463+0000","last_active":"2024-05-21T14:43:21.067184+0000","last_peered":"2024-05-21T14:43:21.067184+0000","last_clean":"2024-05-21T14:43:21.067184+0000","last_became_active":"2024-05-21T14:43:19.614489+0000","last_became_peered":"2024-05-21T14:43:19.614489+0000","last_unstale":"2024-05-21T14:43:21.067184+0000","last_undegraded":"2024-05-21T14:43:21.067184+0000","last_fullsized":"2024-05-21T14:43:21.067184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:51:07.953352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797590+0000","last_change":"2024-05-21T14:43:19.624683+0000","last_active":"2024-05-21T14:43:20.797590+0000","last_peered":"2024-05-21T14:43:20.797590+0000","last_clean":"2024-05-21T14:43:20.797590+0000","last_became_active":"2024-05-21T14:43:19.624304+0000","last_became_peered":"2024-05-21T14:43:19.624304+0000","last_unstale":"2024-05-21T14:43:20.797590+0000","last_undegraded":"2024-05-21T14:43:20.797590+0000","last_fullsized":"2024-05-21T14:43:20.797590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:53.874968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067763+0000","last_change":"2024-05-21T14:43:19.621030+0000","last_active":"2024-05-21T14:43:21.067763+0000","last_peered":"2024-05-21T14:43:21.067763+0000","last_clean":"2024-05-21T14:43:21.067763+0000","last_became_active":"2024-05-21T14:43:19.619072+0000","last_became_peered":"2024-05-21T14:43:19.619072+0000","last_unstale":"2024-05-21T14:43:21.067763+0000","last_undegraded":"2024-05-21T14:43:21.067763+0000","last_fullsized":"2024-05-21T14:43:21.067763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:22:09.423661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066417+0000","last_change":"2024-05-21T14:43:19.602880+0000","last_active":"2024-05-21T14:43:21.066417+0000","last_peered":"2024-05-21T14:43:21.066417+0000","last_clean":"2024-05-21T14:43:21.066417+0000","last_became_active":"2024-05-21T14:43:19.602577+0000","last_became_peered":"2024-05-21T14:43:19.602577+0000","last_unstale":"2024-05-21T14:43:21.066417+0000","last_undegraded":"2024-05-21T14:43:21.066417+0000","last_fullsized":"2024-05-21T14:43:21.066417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:04:10.094373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582914+0000","last_change":"2024-05-21T14:43:19.632328+0000","last_active":"2024-05-21T14:43:20.582914+0000","last_peered":"2024-05-21T14:43:20.582914+0000","last_clean":"2024-05-21T14:43:20.582914+0000","last_became_active":"2024-05-21T14:43:19.631351+0000","last_became_peered":"2024-05-21T14:43:19.631351+0000","last_unstale":"2024-05-21T14:43:20.582914+0000","last_undegraded":"2024-05-21T14:43:20.582914+0000","last_fullsized":"2024-05-21T14:43:20.582914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:36:18.467070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582481+0000","last_change":"2024-05-21T14:43:19.632282+0000","last_active":"2024-05-21T14:43:20.582481+0000","last_peered":"2024-05-21T14:43:20.582481+0000","last_clean":"2024-05-21T14:43:20.582481+0000","last_became_active":"2024-05-21T14:43:19.631522+0000","last_became_peered":"2024-05-21T14:43:19.631522+0000","last_unstale":"2024-05-21T14:43:20.582481+0000","last_undegraded":"2024-05-21T14:43:20.582481+0000","last_fullsized":"2024-05-21T14:43:20.582481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:23:32.646087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067227+0000","last_change":"2024-05-21T14:43:19.620046+0000","last_active":"2024-05-21T14:43:21.067227+0000","last_peered":"2024-05-21T14:43:21.067227+0000","last_clean":"2024-05-21T14:43:21.067227+0000","last_became_active":"2024-05-21T14:43:19.612428+0000","last_became_peered":"2024-05-21T14:43:19.612428+0000","last_unstale":"2024-05-21T14:43:21.067227+0000","last_undegraded":"2024-05-21T14:43:21.067227+0000","last_fullsized":"2024-05-21T14:43:21.067227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:08:33.785399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797667+0000","last_change":"2024-05-21T14:43:19.618198+0000","last_active":"2024-05-21T14:43:20.797667+0000","last_peered":"2024-05-21T14:43:20.797667+0000","last_clean":"2024-05-21T14:43:20.797667+0000","last_became_active":"2024-05-21T14:43:19.617903+0000","last_became_peered":"2024-05-21T14:43:19.617903+0000","last_unstale":"2024-05-21T14:43:20.797667+0000","last_undegraded":"2024-05-21T14:43:20.797667+0000","last_fullsized":"2024-05-21T14:43:20.797667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:59.606862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580507+0000","last_change":"2024-05-21T14:43:19.613942+0000","last_active":"2024-05-21T14:43:20.580507+0000","last_peered":"2024-05-21T14:43:20.580507+0000","last_clean":"2024-05-21T14:43:20.580507+0000","last_became_active":"2024-05-21T14:43:19.613035+0000","last_became_peered":"2024-05-21T14:43:19.613035+0000","last_unstale":"2024-05-21T14:43:20.580507+0000","last_undegraded":"2024-05-21T14:43:20.580507+0000","last_fullsized":"2024-05-21T14:43:20.580507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:47:46.462547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.065907+0000","last_change":"2024-05-21T14:43:19.626414+0000","last_active":"2024-05-21T14:43:21.065907+0000","last_peered":"2024-05-21T14:43:21.065907+0000","last_clean":"2024-05-21T14:43:21.065907+0000","last_became_active":"2024-05-21T14:43:19.626080+0000","last_became_peered":"2024-05-21T14:43:19.626080+0000","last_unstale":"2024-05-21T14:43:21.065907+0000","last_undegraded":"2024-05-21T14:43:21.065907+0000","last_fullsized":"2024-05-21T14:43:21.065907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:37:38.449284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578382+0000","last_change":"2024-05-21T14:43:19.620806+0000","last_active":"2024-05-21T14:43:20.578382+0000","last_peered":"2024-05-21T14:43:20.578382+0000","last_clean":"2024-05-21T14:43:20.578382+0000","last_became_active":"2024-05-21T14:43:19.620449+0000","last_became_peered":"2024-05-21T14:43:19.620449+0000","last_unstale":"2024-05-21T14:43:20.578382+0000","last_undegraded":"2024-05-21T14:43:20.578382+0000","last_fullsized":"2024-05-21T14:43:20.578382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:43:52.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067339+0000","last_change":"2024-05-21T14:43:18.603028+0000","last_active":"2024-05-21T14:43:21.067339+0000","last_peered":"2024-05-21T14:43:21.067339+0000","last_clean":"2024-05-21T14:43:21.067339+0000","last_became_active":"2024-05-21T14:43:18.602036+0000","last_became_peered":"2024-05-21T14:43:18.602036+0000","last_unstale":"2024-05-21T14:43:21.067339+0000","last_undegraded":"2024-05-21T14:43:21.067339+0000","last_fullsized":"2024-05-21T14:43:21.067339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:15:25.384197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963922+0000","last_change":"2024-05-21T14:43:19.599725+0000","last_active":"2024-05-21T14:43:20.963922+0000","last_peered":"2024-05-21T14:43:20.963922+0000","last_clean":"2024-05-21T14:43:20.963922+0000","last_became_active":"2024-05-21T14:43:19.598972+0000","last_became_peered":"2024-05-21T14:43:19.598972+0000","last_unstale":"2024-05-21T14:43:20.963922+0000","last_undegraded":"2024-05-21T14:43:20.963922+0000","last_fullsized":"2024-05-21T14:43:20.963922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:54:00.871046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.956824+0000","last_change":"2024-05-21T14:43:18.615934+0000","last_active":"2024-05-21T14:43:20.956824+0000","last_peered":"2024-05-21T14:43:20.956824+0000","last_clean":"2024-05-21T14:43:20.956824+0000","last_became_active":"2024-05-21T14:43:18.615568+0000","last_became_peered":"2024-05-21T14:43:18.615568+0000","last_unstale":"2024-05-21T14:43:20.956824+0000","last_undegraded":"2024-05-21T14:43:20.956824+0000","last_fullsized":"2024-05-21T14:43:20.956824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:28:54.494319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580346+0000","last_change":"2024-05-21T14:43:18.615154+0000","last_active":"2024-05-21T14:43:20.580346+0000","last_peered":"2024-05-21T14:43:20.580346+0000","last_clean":"2024-05-21T14:43:20.580346+0000","last_became_active":"2024-05-21T14:43:18.613838+0000","last_became_peered":"2024-05-21T14:43:18.613838+0000","last_unstale":"2024-05-21T14:43:20.580346+0000","last_undegraded":"2024-05-21T14:43:20.580346+0000","last_fullsized":"2024-05-21T14:43:20.580346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:32:09.174124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067194+0000","last_change":"2024-05-21T14:43:19.633585+0000","last_active":"2024-05-21T14:43:21.067194+0000","last_peered":"2024-05-21T14:43:21.067194+0000","last_clean":"2024-05-21T14:43:21.067194+0000","last_became_active":"2024-05-21T14:43:19.632476+0000","last_became_peered":"2024-05-21T14:43:19.632476+0000","last_unstale":"2024-05-21T14:43:21.067194+0000","last_undegraded":"2024-05-21T14:43:21.067194+0000","last_fullsized":"2024-05-21T14:43:21.067194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:53.023931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797713+0000","last_change":"2024-05-21T14:43:18.585548+0000","last_active":"2024-05-21T14:43:20.797713+0000","last_peered":"2024-05-21T14:43:20.797713+0000","last_clean":"2024-05-21T14:43:20.797713+0000","last_became_active":"2024-05-21T14:43:18.585099+0000","last_became_peered":"2024-05-21T14:43:18.585099+0000","last_unstale":"2024-05-21T14:43:20.797713+0000","last_undegraded":"2024-05-21T14:43:20.797713+0000","last_fullsized":"2024-05-21T14:43:20.797713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:20:16.856225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963459+0000","last_change":"2024-05-21T14:43:19.614884+0000","last_active":"2024-05-21T14:43:20.963459+0000","last_peered":"2024-05-21T14:43:20.963459+0000","last_clean":"2024-05-21T14:43:20.963459+0000","last_became_active":"2024-05-21T14:43:19.614064+0000","last_became_peered":"2024-05-21T14:43:19.614064+0000","last_unstale":"2024-05-21T14:43:20.963459+0000","last_undegraded":"2024-05-21T14:43:20.963459+0000","last_fullsized":"2024-05-21T14:43:20.963459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:42:17.091043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578207+0000","last_change":"2024-05-21T14:43:18.602794+0000","last_active":"2024-05-21T14:43:20.578207+0000","last_peered":"2024-05-21T14:43:20.578207+0000","last_clean":"2024-05-21T14:43:20.578207+0000","last_became_active":"2024-05-21T14:43:18.602429+0000","last_became_peered":"2024-05-21T14:43:18.602429+0000","last_unstale":"2024-05-21T14:43:20.578207+0000","last_undegraded":"2024-05-21T14:43:20.578207+0000","last_fullsized":"2024-05-21T14:43:20.578207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:50:14.465202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066483+0000","last_change":"2024-05-21T14:43:19.602663+0000","last_active":"2024-05-21T14:43:21.066483+0000","last_peered":"2024-05-21T14:43:21.066483+0000","last_clean":"2024-05-21T14:43:21.066483+0000","last_became_active":"2024-05-21T14:43:19.602294+0000","last_became_peered":"2024-05-21T14:43:19.602294+0000","last_unstale":"2024-05-21T14:43:21.066483+0000","last_undegraded":"2024-05-21T14:43:21.066483+0000","last_fullsized":"2024-05-21T14:43:21.066483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:48:56.271741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066944+0000","last_change":"2024-05-21T14:43:18.604601+0000","last_active":"2024-05-21T14:43:21.066944+0000","last_peered":"2024-05-21T14:43:21.066944+0000","last_clean":"2024-05-21T14:43:21.066944+0000","last_became_active":"2024-05-21T14:43:18.604262+0000","last_became_peered":"2024-05-21T14:43:18.604262+0000","last_unstale":"2024-05-21T14:43:21.066944+0000","last_undegraded":"2024-05-21T14:43:21.066944+0000","last_fullsized":"2024-05-21T14:43:21.066944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:15.490579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.068019+0000","last_change":"2024-05-21T14:43:19.613952+0000","last_active":"2024-05-21T14:43:21.068019+0000","last_peered":"2024-05-21T14:43:21.068019+0000","last_clean":"2024-05-21T14:43:21.068019+0000","last_became_active":"2024-05-21T14:43:19.613093+0000","last_became_peered":"2024-05-21T14:43:19.613093+0000","last_unstale":"2024-05-21T14:43:21.068019+0000","last_undegraded":"2024-05-21T14:43:21.068019+0000","last_fullsized":"2024-05-21T14:43:21.068019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:03:44.925212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.595969+0000","last_change":"2024-05-21T14:43:18.602343+0000","last_active":"2024-05-21T14:43:24.595969+0000","last_peered":"2024-05-21T14:43:24.595969+0000","last_clean":"2024-05-21T14:43:24.595969+0000","last_became_active":"2024-05-21T14:43:18.601500+0000","last_became_peered":"2024-05-21T14:43:18.601500+0000","last_unstale":"2024-05-21T14:43:24.595969+0000","last_undegraded":"2024-05-21T14:43:24.595969+0000","last_fullsized":"2024-05-21T14:43:24.595969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:54:21.960430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798025+0000","last_change":"2024-05-21T14:43:19.608580+0000","last_active":"2024-05-21T14:43:20.798025+0000","last_peered":"2024-05-21T14:43:20.798025+0000","last_clean":"2024-05-21T14:43:20.798025+0000","last_became_active":"2024-05-21T14:43:19.608038+0000","last_became_peered":"2024-05-21T14:43:19.608038+0000","last_unstale":"2024-05-21T14:43:20.798025+0000","last_undegraded":"2024-05-21T14:43:20.798025+0000","last_fullsized":"2024-05-21T14:43:20.798025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:19.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.596610+0000","last_change":"2024-05-21T14:43:18.606824+0000","last_active":"2024-05-21T14:43:24.596610+0000","last_peered":"2024-05-21T14:43:24.596610+0000","last_clean":"2024-05-21T14:43:24.596610+0000","last_became_active":"2024-05-21T14:43:18.606449+0000","last_became_peered":"2024-05-21T14:43:18.606449+0000","last_unstale":"2024-05-21T14:43:24.596610+0000","last_undegraded":"2024-05-21T14:43:24.596610+0000","last_fullsized":"2024-05-21T14:43:24.596610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:43:41.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066889+0000","last_change":"2024-05-21T14:43:19.634014+0000","last_active":"2024-05-21T14:43:21.066889+0000","last_peered":"2024-05-21T14:43:21.066889+0000","last_clean":"2024-05-21T14:43:21.066889+0000","last_became_active":"2024-05-21T14:43:19.633664+0000","last_became_peered":"2024-05-21T14:43:19.633664+0000","last_unstale":"2024-05-21T14:43:21.066889+0000","last_undegraded":"2024-05-21T14:43:21.066889+0000","last_fullsized":"2024-05-21T14:43:21.066889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:36:07.708164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.592042+0000","last_change":"2024-05-21T14:43:18.614764+0000","last_active":"2024-05-21T14:43:24.592042+0000","last_peered":"2024-05-21T14:43:24.592042+0000","last_clean":"2024-05-21T14:43:24.592042+0000","last_became_active":"2024-05-21T14:43:18.614214+0000","last_became_peered":"2024-05-21T14:43:18.614214+0000","last_unstale":"2024-05-21T14:43:24.592042+0000","last_undegraded":"2024-05-21T14:43:24.592042+0000","last_fullsized":"2024-05-21T14:43:24.592042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:34:40.294756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580771+0000","last_change":"2024-05-21T14:43:19.625313+0000","last_active":"2024-05-21T14:43:20.580771+0000","last_peered":"2024-05-21T14:43:20.580771+0000","last_clean":"2024-05-21T14:43:20.580771+0000","last_became_active":"2024-05-21T14:43:19.624474+0000","last_became_peered":"2024-05-21T14:43:19.624474+0000","last_unstale":"2024-05-21T14:43:20.580771+0000","last_undegraded":"2024-05-21T14:43:20.580771+0000","last_fullsized":"2024-05-21T14:43:20.580771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:28.280456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797927+0000","last_change":"2024-05-21T14:43:18.600736+0000","last_active":"2024-05-21T14:43:20.797927+0000","last_peered":"2024-05-21T14:43:20.797927+0000","last_clean":"2024-05-21T14:43:20.797927+0000","last_became_active":"2024-05-21T14:43:18.600415+0000","last_became_peered":"2024-05-21T14:43:18.600415+0000","last_unstale":"2024-05-21T14:43:20.797927+0000","last_undegraded":"2024-05-21T14:43:20.797927+0000","last_fullsized":"2024-05-21T14:43:20.797927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:03:57.207603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797724+0000","last_change":"2024-05-21T14:43:19.599637+0000","last_active":"2024-05-21T14:43:20.797724+0000","last_peered":"2024-05-21T14:43:20.797724+0000","last_clean":"2024-05-21T14:43:20.797724+0000","last_became_active":"2024-05-21T14:43:19.599195+0000","last_became_peered":"2024-05-21T14:43:19.599195+0000","last_unstale":"2024-05-21T14:43:20.797724+0000","last_undegraded":"2024-05-21T14:43:20.797724+0000","last_fullsized":"2024-05-21T14:43:20.797724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:17.350821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066280+0000","last_change":"2024-05-21T14:43:18.603064+0000","last_active":"2024-05-21T14:43:21.066280+0000","last_peered":"2024-05-21T14:43:21.066280+0000","last_clean":"2024-05-21T14:43:21.066280+0000","last_became_active":"2024-05-21T14:43:18.602658+0000","last_became_peered":"2024-05-21T14:43:18.602658+0000","last_unstale":"2024-05-21T14:43:21.066280+0000","last_undegraded":"2024-05-21T14:43:21.066280+0000","last_fullsized":"2024-05-21T14:43:21.066280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:09:28.623131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.577809+0000","last_change":"2024-05-21T14:43:19.620760+0000","last_active":"2024-05-21T14:43:20.577809+0000","last_peered":"2024-05-21T14:43:20.577809+0000","last_clean":"2024-05-21T14:43:20.577809+0000","last_became_active":"2024-05-21T14:43:19.620409+0000","last_became_peered":"2024-05-21T14:43:19.620409+0000","last_unstale":"2024-05-21T14:43:20.577809+0000","last_undegraded":"2024-05-21T14:43:20.577809+0000","last_fullsized":"2024-05-21T14:43:20.577809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:49:59.051131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.596990+0000","last_change":"2024-05-21T14:43:18.594225+0000","last_active":"2024-05-21T14:43:24.596990+0000","last_peered":"2024-05-21T14:43:24.596990+0000","last_clean":"2024-05-21T14:43:24.596990+0000","last_became_active":"2024-05-21T14:43:18.592335+0000","last_became_peered":"2024-05-21T14:43:18.592335+0000","last_unstale":"2024-05-21T14:43:24.596990+0000","last_undegraded":"2024-05-21T14:43:24.596990+0000","last_fullsized":"2024-05-21T14:43:24.596990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:00:58.772091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797667+0000","last_change":"2024-05-21T14:43:19.612442+0000","last_active":"2024-05-21T14:43:20.797667+0000","last_peered":"2024-05-21T14:43:20.797667+0000","last_clean":"2024-05-21T14:43:20.797667+0000","last_became_active":"2024-05-21T14:43:19.612110+0000","last_became_peered":"2024-05-21T14:43:19.612110+0000","last_unstale":"2024-05-21T14:43:20.797667+0000","last_undegraded":"2024-05-21T14:43:20.797667+0000","last_fullsized":"2024-05-21T14:43:20.797667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:53.451513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067149+0000","last_change":"2024-05-21T14:43:18.613433+0000","last_active":"2024-05-21T14:43:21.067149+0000","last_peered":"2024-05-21T14:43:21.067149+0000","last_clean":"2024-05-21T14:43:21.067149+0000","last_became_active":"2024-05-21T14:43:18.613048+0000","last_became_peered":"2024-05-21T14:43:18.613048+0000","last_unstale":"2024-05-21T14:43:21.067149+0000","last_undegraded":"2024-05-21T14:43:21.067149+0000","last_fullsized":"2024-05-21T14:43:21.067149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:00:16.454574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066572+0000","last_change":"2024-05-21T14:43:19.597079+0000","last_active":"2024-05-21T14:43:21.066572+0000","last_peered":"2024-05-21T14:43:21.066572+0000","last_clean":"2024-05-21T14:43:21.066572+0000","last_became_active":"2024-05-21T14:43:19.596736+0000","last_became_peered":"2024-05-21T14:43:19.596736+0000","last_unstale":"2024-05-21T14:43:21.066572+0000","last_undegraded":"2024-05-21T14:43:21.066572+0000","last_fullsized":"2024-05-21T14:43:21.066572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:09:03.687971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.594003+0000","last_change":"2024-05-21T14:43:18.620603+0000","last_active":"2024-05-21T14:43:24.594003+0000","last_peered":"2024-05-21T14:43:24.594003+0000","last_clean":"2024-05-21T14:43:24.594003+0000","last_became_active":"2024-05-21T14:43:18.619762+0000","last_became_peered":"2024-05-21T14:43:18.619762+0000","last_unstale":"2024-05-21T14:43:24.594003+0000","last_undegraded":"2024-05-21T14:43:24.594003+0000","last_fullsized":"2024-05-21T14:43:24.594003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:31:49.257435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067100+0000","last_change":"2024-05-21T14:43:19.611608+0000","last_active":"2024-05-21T14:43:21.067100+0000","last_peered":"2024-05-21T14:43:21.067100+0000","last_clean":"2024-05-21T14:43:21.067100+0000","last_became_active":"2024-05-21T14:43:19.610774+0000","last_became_peered":"2024-05-21T14:43:19.610774+0000","last_unstale":"2024-05-21T14:43:21.067100+0000","last_undegraded":"2024-05-21T14:43:21.067100+0000","last_fullsized":"2024-05-21T14:43:21.067100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:19:00.383286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067293+0000","last_change":"2024-05-21T14:43:18.610121+0000","last_active":"2024-05-21T14:43:21.067293+0000","last_peered":"2024-05-21T14:43:21.067293+0000","last_clean":"2024-05-21T14:43:21.067293+0000","last_became_active":"2024-05-21T14:43:18.609349+0000","last_became_peered":"2024-05-21T14:43:18.609349+0000","last_unstale":"2024-05-21T14:43:21.067293+0000","last_undegraded":"2024-05-21T14:43:21.067293+0000","last_fullsized":"2024-05-21T14:43:21.067293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:48.330067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066734+0000","last_change":"2024-05-21T14:43:19.605193+0000","last_active":"2024-05-21T14:43:21.066734+0000","last_peered":"2024-05-21T14:43:21.066734+0000","last_clean":"2024-05-21T14:43:21.066734+0000","last_became_active":"2024-05-21T14:43:19.604869+0000","last_became_peered":"2024-05-21T14:43:19.604869+0000","last_unstale":"2024-05-21T14:43:21.066734+0000","last_undegraded":"2024-05-21T14:43:21.066734+0000","last_fullsized":"2024-05-21T14:43:21.066734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:58:05.078363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582847+0000","last_change":"2024-05-21T14:43:18.616535+0000","last_active":"2024-05-21T14:43:20.582847+0000","last_peered":"2024-05-21T14:43:20.582847+0000","last_clean":"2024-05-21T14:43:20.582847+0000","last_became_active":"2024-05-21T14:43:18.615734+0000","last_became_peered":"2024-05-21T14:43:18.615734+0000","last_unstale":"2024-05-21T14:43:20.582847+0000","last_undegraded":"2024-05-21T14:43:20.582847+0000","last_fullsized":"2024-05-21T14:43:20.582847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:10:27.821535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798116+0000","last_change":"2024-05-21T14:43:19.615424+0000","last_active":"2024-05-21T14:43:20.798116+0000","last_peered":"2024-05-21T14:43:20.798116+0000","last_clean":"2024-05-21T14:43:20.798116+0000","last_became_active":"2024-05-21T14:43:19.614915+0000","last_became_peered":"2024-05-21T14:43:19.614915+0000","last_unstale":"2024-05-21T14:43:20.798116+0000","last_undegraded":"2024-05-21T14:43:20.798116+0000","last_fullsized":"2024-05-21T14:43:20.798116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:25:09.153430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.577738+0000","last_change":"2024-05-21T14:43:08.080234+0000","last_active":"2024-05-21T14:43:20.577738+0000","last_peered":"2024-05-21T14:43:20.577738+0000","last_clean":"2024-05-21T14:43:20.577738+0000","last_became_active":"2024-05-21T14:43:08.079934+0000","last_became_peered":"2024-05-21T14:43:08.079934+0000","last_unstale":"2024-05-21T14:43:20.577738+0000","last_undegraded":"2024-05-21T14:43:20.577738+0000","last_fullsized":"2024-05-21T14:43:20.577738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_clean_scrub_stamp":"2024-05-21T14:43:07.046978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:54:57.347768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797966+0000","last_change":"2024-05-21T14:43:18.599850+0000","last_active":"2024-05-21T14:43:20.797966+0000","last_peered":"2024-05-21T14:43:20.797966+0000","last_clean":"2024-05-21T14:43:20.797966+0000","last_became_active":"2024-05-21T14:43:18.599347+0000","last_became_peered":"2024-05-21T14:43:18.599347+0000","last_unstale":"2024-05-21T14:43:20.797966+0000","last_undegraded":"2024-05-21T14:43:20.797966+0000","last_fullsized":"2024-05-21T14:43:20.797966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:01:06.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963423+0000","last_change":"2024-05-21T14:43:19.613056+0000","last_active":"2024-05-21T14:43:20.963423+0000","last_peered":"2024-05-21T14:43:20.963423+0000","last_clean":"2024-05-21T14:43:20.963423+0000","last_became_active":"2024-05-21T14:43:19.611889+0000","last_became_peered":"2024-05-21T14:43:19.611889+0000","last_unstale":"2024-05-21T14:43:20.963423+0000","last_undegraded":"2024-05-21T14:43:20.963423+0000","last_fullsized":"2024-05-21T14:43:20.963423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:46:20.105282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797781+0000","last_change":"2024-05-21T14:43:18.621482+0000","last_active":"2024-05-21T14:43:20.797781+0000","last_peered":"2024-05-21T14:43:20.797781+0000","last_clean":"2024-05-21T14:43:20.797781+0000","last_became_active":"2024-05-21T14:43:18.621229+0000","last_became_peered":"2024-05-21T14:43:18.621229+0000","last_unstale":"2024-05-21T14:43:20.797781+0000","last_undegraded":"2024-05-21T14:43:20.797781+0000","last_fullsized":"2024-05-21T14:43:20.797781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:30:04.326588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580381+0000","last_change":"2024-05-21T14:43:19.625038+0000","last_active":"2024-05-21T14:43:20.580381+0000","last_peered":"2024-05-21T14:43:20.580381+0000","last_clean":"2024-05-21T14:43:20.580381+0000","last_became_active":"2024-05-21T14:43:19.624114+0000","last_became_peered":"2024-05-21T14:43:19.624114+0000","last_unstale":"2024-05-21T14:43:20.580381+0000","last_undegraded":"2024-05-21T14:43:20.580381+0000","last_fullsized":"2024-05-21T14:43:20.580381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:11.854243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580843+0000","last_change":"2024-05-21T14:43:18.618518+0000","last_active":"2024-05-21T14:43:20.580843+0000","last_peered":"2024-05-21T14:43:20.580843+0000","last_clean":"2024-05-21T14:43:20.580843+0000","last_became_active":"2024-05-21T14:43:18.617756+0000","last_became_peered":"2024-05-21T14:43:18.617756+0000","last_unstale":"2024-05-21T14:43:20.580843+0000","last_undegraded":"2024-05-21T14:43:20.580843+0000","last_fullsized":"2024-05-21T14:43:20.580843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:52:12.999877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066783+0000","last_change":"2024-05-21T14:43:19.613595+0000","last_active":"2024-05-21T14:43:21.066783+0000","last_peered":"2024-05-21T14:43:21.066783+0000","last_clean":"2024-05-21T14:43:21.066783+0000","last_became_active":"2024-05-21T14:43:19.612730+0000","last_became_peered":"2024-05-21T14:43:19.612730+0000","last_unstale":"2024-05-21T14:43:21.066783+0000","last_undegraded":"2024-05-21T14:43:21.066783+0000","last_fullsized":"2024-05-21T14:43:21.066783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:01:02.847071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797922+0000","last_change":"2024-05-21T14:43:18.608596+0000","last_active":"2024-05-21T14:43:20.797922+0000","last_peered":"2024-05-21T14:43:20.797922+0000","last_clean":"2024-05-21T14:43:20.797922+0000","last_became_active":"2024-05-21T14:43:18.608262+0000","last_became_peered":"2024-05-21T14:43:18.608262+0000","last_unstale":"2024-05-21T14:43:20.797922+0000","last_undegraded":"2024-05-21T14:43:20.797922+0000","last_fullsized":"2024-05-21T14:43:20.797922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:14.962554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066581+0000","last_change":"2024-05-21T14:43:19.607815+0000","last_active":"2024-05-21T14:43:21.066581+0000","last_peered":"2024-05-21T14:43:21.066581+0000","last_clean":"2024-05-21T14:43:21.066581+0000","last_became_active":"2024-05-21T14:43:19.607513+0000","last_became_peered":"2024-05-21T14:43:19.607513+0000","last_unstale":"2024-05-21T14:43:21.066581+0000","last_undegraded":"2024-05-21T14:43:21.066581+0000","last_fullsized":"2024-05-21T14:43:21.066581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:01:35.332981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066787+0000","last_change":"2024-05-21T14:43:18.603626+0000","last_active":"2024-05-21T14:43:21.066787+0000","last_peered":"2024-05-21T14:43:21.066787+0000","last_clean":"2024-05-21T14:43:21.066787+0000","last_became_active":"2024-05-21T14:43:18.602704+0000","last_became_peered":"2024-05-21T14:43:18.602704+0000","last_unstale":"2024-05-21T14:43:21.066787+0000","last_undegraded":"2024-05-21T14:43:21.066787+0000","last_fullsized":"2024-05-21T14:43:21.066787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:03.976820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066240+0000","last_change":"2024-05-21T14:43:19.634449+0000","last_active":"2024-05-21T14:43:21.066240+0000","last_peered":"2024-05-21T14:43:21.066240+0000","last_clean":"2024-05-21T14:43:21.066240+0000","last_became_active":"2024-05-21T14:43:19.633751+0000","last_became_peered":"2024-05-21T14:43:19.633751+0000","last_unstale":"2024-05-21T14:43:21.066240+0000","last_undegraded":"2024-05-21T14:43:21.066240+0000","last_fullsized":"2024-05-21T14:43:21.066240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:04:51.415303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798236+0000","last_change":"2024-05-21T14:43:18.608335+0000","last_active":"2024-05-21T14:43:20.798236+0000","last_peered":"2024-05-21T14:43:20.798236+0000","last_clean":"2024-05-21T14:43:20.798236+0000","last_became_active":"2024-05-21T14:43:18.607999+0000","last_became_peered":"2024-05-21T14:43:18.607999+0000","last_unstale":"2024-05-21T14:43:20.798236+0000","last_undegraded":"2024-05-21T14:43:20.798236+0000","last_fullsized":"2024-05-21T14:43:20.798236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:21.325953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582549+0000","last_change":"2024-05-21T14:43:19.626742+0000","last_active":"2024-05-21T14:43:20.582549+0000","last_peered":"2024-05-21T14:43:20.582549+0000","last_clean":"2024-05-21T14:43:20.582549+0000","last_became_active":"2024-05-21T14:43:19.626024+0000","last_became_peered":"2024-05-21T14:43:19.626024+0000","last_unstale":"2024-05-21T14:43:20.582549+0000","last_undegraded":"2024-05-21T14:43:20.582549+0000","last_fullsized":"2024-05-21T14:43:20.582549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:48:15.426224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.964590+0000","last_change":"2024-05-21T14:43:18.616913+0000","last_active":"2024-05-21T14:43:20.964590+0000","last_peered":"2024-05-21T14:43:20.964590+0000","last_clean":"2024-05-21T14:43:20.964590+0000","last_became_active":"2024-05-21T14:43:18.616214+0000","last_became_peered":"2024-05-21T14:43:18.616214+0000","last_unstale":"2024-05-21T14:43:20.964590+0000","last_undegraded":"2024-05-21T14:43:20.964590+0000","last_fullsized":"2024-05-21T14:43:20.964590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:22.112018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963796+0000","last_change":"2024-05-21T14:43:19.607521+0000","last_active":"2024-05-21T14:43:20.963796+0000","last_peered":"2024-05-21T14:43:20.963796+0000","last_clean":"2024-05-21T14:43:20.963796+0000","last_became_active":"2024-05-21T14:43:19.606673+0000","last_became_peered":"2024-05-21T14:43:19.606673+0000","last_unstale":"2024-05-21T14:43:20.963796+0000","last_undegraded":"2024-05-21T14:43:20.963796+0000","last_fullsized":"2024-05-21T14:43:20.963796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:50:50.373410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.586589+0000","last_change":"2024-05-21T14:43:18.615846+0000","last_active":"2024-05-21T14:43:24.586589+0000","last_peered":"2024-05-21T14:43:24.586589+0000","last_clean":"2024-05-21T14:43:24.586589+0000","last_became_active":"2024-05-21T14:43:18.615506+0000","last_became_peered":"2024-05-21T14:43:18.615506+0000","last_unstale":"2024-05-21T14:43:24.586589+0000","last_undegraded":"2024-05-21T14:43:24.586589+0000","last_fullsized":"2024-05-21T14:43:24.586589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:07:17.030757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.964252+0000","last_change":"2024-05-21T14:43:19.611473+0000","last_active":"2024-05-21T14:43:20.964252+0000","last_peered":"2024-05-21T14:43:20.964252+0000","last_clean":"2024-05-21T14:43:20.964252+0000","last_became_active":"2024-05-21T14:43:19.610600+0000","last_became_peered":"2024-05-21T14:43:19.610600+0000","last_unstale":"2024-05-21T14:43:20.964252+0000","last_undegraded":"2024-05-21T14:43:20.964252+0000","last_fullsized":"2024-05-21T14:43:20.964252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:48:07.659795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.065773+0000","last_change":"2024-05-21T14:43:18.604951+0000","last_active":"2024-05-21T14:43:21.065773+0000","last_peered":"2024-05-21T14:43:21.065773+0000","last_clean":"2024-05-21T14:43:21.065773+0000","last_became_active":"2024-05-21T14:43:18.602186+0000","last_became_peered":"2024-05-21T14:43:18.602186+0000","last_unstale":"2024-05-21T14:43:21.065773+0000","last_undegraded":"2024-05-21T14:43:21.065773+0000","last_fullsized":"2024-05-21T14:43:21.065773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:34:10.395484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797647+0000","last_change":"2024-05-21T14:43:19.600827+0000","last_active":"2024-05-21T14:43:20.797647+0000","last_peered":"2024-05-21T14:43:20.797647+0000","last_clean":"2024-05-21T14:43:20.797647+0000","last_became_active":"2024-05-21T14:43:19.600499+0000","last_became_peered":"2024-05-21T14:43:19.600499+0000","last_unstale":"2024-05-21T14:43:20.797647+0000","last_undegraded":"2024-05-21T14:43:20.797647+0000","last_fullsized":"2024-05-21T14:43:20.797647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:55:36.231321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963274+0000","last_change":"2024-05-21T14:43:18.615190+0000","last_active":"2024-05-21T14:43:20.963274+0000","last_peered":"2024-05-21T14:43:20.963274+0000","last_clean":"2024-05-21T14:43:20.963274+0000","last_became_active":"2024-05-21T14:43:18.614306+0000","last_became_peered":"2024-05-21T14:43:18.614306+0000","last_unstale":"2024-05-21T14:43:20.963274+0000","last_undegraded":"2024-05-21T14:43:20.963274+0000","last_fullsized":"2024-05-21T14:43:20.963274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:53.472559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.962948+0000","last_change":"2024-05-21T14:43:19.610903+0000","last_active":"2024-05-21T14:43:20.962948+0000","last_peered":"2024-05-21T14:43:20.962948+0000","last_clean":"2024-05-21T14:43:20.962948+0000","last_became_active":"2024-05-21T14:43:19.610101+0000","last_became_peered":"2024-05-21T14:43:19.610101+0000","last_unstale":"2024-05-21T14:43:20.962948+0000","last_undegraded":"2024-05-21T14:43:20.962948+0000","last_fullsized":"2024-05-21T14:43:20.962948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:16:24.580581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581222+0000","last_change":"2024-05-21T14:43:18.617785+0000","last_active":"2024-05-21T14:43:20.581222+0000","last_peered":"2024-05-21T14:43:20.581222+0000","last_clean":"2024-05-21T14:43:20.581222+0000","last_became_active":"2024-05-21T14:43:18.617041+0000","last_became_peered":"2024-05-21T14:43:18.617041+0000","last_unstale":"2024-05-21T14:43:20.581222+0000","last_undegraded":"2024-05-21T14:43:20.581222+0000","last_fullsized":"2024-05-21T14:43:20.581222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:02:50.837158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581606+0000","last_change":"2024-05-21T14:43:19.627096+0000","last_active":"2024-05-21T14:43:20.581606+0000","last_peered":"2024-05-21T14:43:20.581606+0000","last_clean":"2024-05-21T14:43:20.581606+0000","last_became_active":"2024-05-21T14:43:19.626265+0000","last_became_peered":"2024-05-21T14:43:19.626265+0000","last_unstale":"2024-05-21T14:43:20.581606+0000","last_undegraded":"2024-05-21T14:43:20.581606+0000","last_fullsized":"2024-05-21T14:43:20.581606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:23:47.818120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.586633+0000","last_change":"2024-05-21T14:43:18.599635+0000","last_active":"2024-05-21T14:43:24.586633+0000","last_peered":"2024-05-21T14:43:24.586633+0000","last_clean":"2024-05-21T14:43:24.586633+0000","last_became_active":"2024-05-21T14:43:18.598996+0000","last_became_peered":"2024-05-21T14:43:18.598996+0000","last_unstale":"2024-05-21T14:43:24.586633+0000","last_undegraded":"2024-05-21T14:43:24.586633+0000","last_fullsized":"2024-05-21T14:43:24.586633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:17:09.383291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797767+0000","last_change":"2024-05-21T14:43:19.617686+0000","last_active":"2024-05-21T14:43:20.797767+0000","last_peered":"2024-05-21T14:43:20.797767+0000","last_clean":"2024-05-21T14:43:20.797767+0000","last_became_active":"2024-05-21T14:43:19.617398+0000","last_became_peered":"2024-05-21T14:43:19.617398+0000","last_unstale":"2024-05-21T14:43:20.797767+0000","last_undegraded":"2024-05-21T14:43:20.797767+0000","last_fullsized":"2024-05-21T14:43:20.797767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:21:06.527871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798047+0000","last_change":"2024-05-21T14:43:19.601673+0000","last_active":"2024-05-21T14:43:20.798047+0000","last_peered":"2024-05-21T14:43:20.798047+0000","last_clean":"2024-05-21T14:43:20.798047+0000","last_became_active":"2024-05-21T14:43:19.601286+0000","last_became_peered":"2024-05-21T14:43:19.601286+0000","last_unstale":"2024-05-21T14:43:20.798047+0000","last_undegraded":"2024-05-21T14:43:20.798047+0000","last_fullsized":"2024-05-21T14:43:20.798047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:21:22.955055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.587618+0000","last_change":"2024-05-21T14:43:18.613555+0000","last_active":"2024-05-21T14:43:24.587618+0000","last_peered":"2024-05-21T14:43:24.587618+0000","last_clean":"2024-05-21T14:43:24.587618+0000","last_became_active":"2024-05-21T14:43:18.613117+0000","last_became_peered":"2024-05-21T14:43:18.613117+0000","last_unstale":"2024-05-21T14:43:24.587618+0000","last_undegraded":"2024-05-21T14:43:24.587618+0000","last_fullsized":"2024-05-21T14:43:24.587618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:38.151165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578450+0000","last_change":"2024-05-21T14:43:19.596736+0000","last_active":"2024-05-21T14:43:20.578450+0000","last_peered":"2024-05-21T14:43:20.578450+0000","last_clean":"2024-05-21T14:43:20.578450+0000","last_became_active":"2024-05-21T14:43:19.596157+0000","last_became_peered":"2024-05-21T14:43:19.596157+0000","last_unstale":"2024-05-21T14:43:20.578450+0000","last_undegraded":"2024-05-21T14:43:20.578450+0000","last_fullsized":"2024-05-21T14:43:20.578450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:22:14.002930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.587574+0000","last_change":"2024-05-21T14:43:18.614044+0000","last_active":"2024-05-21T14:43:24.587574+0000","last_peered":"2024-05-21T14:43:24.587574+0000","last_clean":"2024-05-21T14:43:24.587574+0000","last_became_active":"2024-05-21T14:43:18.613730+0000","last_became_peered":"2024-05-21T14:43:18.613730+0000","last_unstale":"2024-05-21T14:43:24.587574+0000","last_undegraded":"2024-05-21T14:43:24.587574+0000","last_fullsized":"2024-05-21T14:43:24.587574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:41:34.787779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067780+0000","last_change":"2024-05-21T14:43:19.621999+0000","last_active":"2024-05-21T14:43:21.067780+0000","last_peered":"2024-05-21T14:43:21.067780+0000","last_clean":"2024-05-21T14:43:21.067780+0000","last_became_active":"2024-05-21T14:43:19.614744+0000","last_became_peered":"2024-05-21T14:43:19.614744+0000","last_unstale":"2024-05-21T14:43:21.067780+0000","last_undegraded":"2024-05-21T14:43:21.067780+0000","last_fullsized":"2024-05-21T14:43:21.067780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:32:37.316833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067863+0000","last_change":"2024-05-21T14:43:18.614193+0000","last_active":"2024-05-21T14:43:21.067863+0000","last_peered":"2024-05-21T14:43:21.067863+0000","last_clean":"2024-05-21T14:43:21.067863+0000","last_became_active":"2024-05-21T14:43:18.609797+0000","last_became_peered":"2024-05-21T14:43:18.609797+0000","last_unstale":"2024-05-21T14:43:21.067863+0000","last_undegraded":"2024-05-21T14:43:21.067863+0000","last_fullsized":"2024-05-21T14:43:21.067863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:39:55.623816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067766+0000","last_change":"2024-05-21T14:43:19.610578+0000","last_active":"2024-05-21T14:43:21.067766+0000","last_peered":"2024-05-21T14:43:21.067766+0000","last_clean":"2024-05-21T14:43:21.067766+0000","last_became_active":"2024-05-21T14:43:19.606575+0000","last_became_peered":"2024-05-21T14:43:19.606575+0000","last_unstale":"2024-05-21T14:43:21.067766+0000","last_undegraded":"2024-05-21T14:43:21.067766+0000","last_fullsized":"2024-05-21T14:43:21.067766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:50:06.088520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.594513+0000","last_change":"2024-05-21T14:43:18.601862+0000","last_active":"2024-05-21T14:43:24.594513+0000","last_peered":"2024-05-21T14:43:24.594513+0000","last_clean":"2024-05-21T14:43:24.594513+0000","last_became_active":"2024-05-21T14:43:18.601311+0000","last_became_peered":"2024-05-21T14:43:18.601311+0000","last_unstale":"2024-05-21T14:43:24.594513+0000","last_undegraded":"2024-05-21T14:43:24.594513+0000","last_fullsized":"2024-05-21T14:43:24.594513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:02.736061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":671695,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":671673,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T14:43:31.003 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-21T14:43:31.003 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-21T14:43:31.003 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-21T14:43:31.004 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-21T14:43:31.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.185+0000 7f1d05e00640 1 Processor -- start 2024-05-21T14:43:31.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.185+0000 7f1d05e00640 1 -- start start 2024-05-21T14:43:31.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.185+0000 7f1d05e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1d000c9550 0x7f1d0015d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:31.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.185+0000 7f1d05e00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d000c3eb0 con 0x7f1d000718b0 2024-05-21T14:43:31.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.185+0000 7f1d05e00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d0015cc70 con 0x7f1d000714a0 2024-05-21T14:43:31.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.185+0000 7f1d05e00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f1d00071010 con 0x7f1d000c9550 2024-05-21T14:43:31.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.185+0000 7f1cfea00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1d000c9550 0x7f1d0015d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:31.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.185+0000 7f1cff400640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1d000718b0 0x7f1d00164000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57542/0 (socket says 172.21.15.78:57542) 2024-05-21T14:43:31.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.185+0000 7f1cff400640 1 -- 172.21.15.78:0/499532425 learned_addr learned my addr 172.21.15.78:0/499532425 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:31.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.185+0000 7f1cfea00640 1 -- 172.21.15.78:0/499532425 >> v1:172.21.15.84:6789/0 conn(0x7f1d000714a0 legacy=0x7f1d000cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:31.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.185+0000 7f1cfea00640 1 -- 172.21.15.78:0/499532425 >> v1:172.21.15.78:6789/0 conn(0x7f1d000718b0 legacy=0x7f1d00164000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:31.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.185+0000 7f1cfea00640 1 -- 172.21.15.78:0/499532425 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d000cacc0 con 0x7f1d000c9550 2024-05-21T14:43:31.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.185+0000 7f1cfd600640 1 -- 172.21.15.78:0/499532425 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1839573941 0 0) 0x7f1d000c3eb0 con 0x7f1d000718b0 2024-05-21T14:43:31.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.189+0000 7f1cfea00640 1 --2- 172.21.15.78:0/499532425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d000c9550 0x7f1d0015d730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00097c0 tx=0x7f1cf001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8c40de1bbdae43 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:31.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.189+0000 7f1cfd600640 1 -- 172.21.15.78:0/499532425 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf00b5070 con 0x7f1d000c9550 2024-05-21T14:43:31.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.189+0000 7f1cfd600640 1 -- 172.21.15.78:0/499532425 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf00a8990 con 0x7f1d000c9550 2024-05-21T14:43:31.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.189+0000 7f1cfd600640 1 -- 172.21.15.78:0/499532425 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf00a8d60 con 0x7f1d000c9550 2024-05-21T14:43:31.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.189+0000 7f1d05e00640 1 -- 172.21.15.78:0/499532425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d000c9550 msgr2=0x7f1d0015d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:31.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.189+0000 7f1d05e00640 1 --2- 172.21.15.78:0/499532425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d000c9550 0x7f1d0015d730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00097c0 tx=0x7f1cf001ec90 comp rx=0 tx=0).stop 2024-05-21T14:43:31.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.189+0000 7f1d05e00640 1 -- 172.21.15.78:0/499532425 shutdown_connections 2024-05-21T14:43:31.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.189+0000 7f1d05e00640 1 --2- 172.21.15.78:0/499532425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d000c9550 0x7f1d0015d730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:31.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.189+0000 7f1d05e00640 1 -- 172.21.15.78:0/499532425 >> 172.21.15.78:0/499532425 conn(0x7f1d000752c0 msgr2=0x7f1d000ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:31.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.189+0000 7f1d05e00640 1 -- 172.21.15.78:0/499532425 shutdown_connections 2024-05-21T14:43:31.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.189+0000 7f1d05e00640 1 -- 172.21.15.78:0/499532425 wait complete. 2024-05-21T14:43:31.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1d05e00640 1 Processor -- start 2024-05-21T14:43:31.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1d05e00640 1 -- start start 2024-05-21T14:43:31.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1d05e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d000714a0 0x7f1d001f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:31.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1d05e00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d000718b0 0x7f1d00159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:31.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1d05e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d000c9550 0x7f1d00157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:31.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1d05e00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1d000c4430 con 0x7f1d000c9550 2024-05-21T14:43:31.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1d05e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1d00071cc0 con 0x7f1d000714a0 2024-05-21T14:43:31.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1d05e00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1d000cf3b0 con 0x7f1d000718b0 2024-05-21T14:43:31.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1cff400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d000c9550 0x7f1d00157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:31.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1cff400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d000c9550 0x7f1d00157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38642/0 (socket says 172.21.15.78:38642) 2024-05-21T14:43:31.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1cff400640 1 -- 172.21.15.78:0/2396853931 learned_addr learned my addr 172.21.15.78:0/2396853931 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:31.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1cfe000640 1 --2- 172.21.15.78:0/2396853931 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d000718b0 0x7f1d00159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:31.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1cfea00640 1 --2- 172.21.15.78:0/2396853931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d000714a0 0x7f1d001f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1cff400640 1 -- 172.21.15.78:0/2396853931 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d000718b0 msgr2=0x7f1d00159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1cff400640 1 --2- 172.21.15.78:0/2396853931 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d000718b0 0x7f1d00159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1cff400640 1 -- 172.21.15.78:0/2396853931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d000714a0 msgr2=0x7f1d001f2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1cff400640 1 --2- 172.21.15.78:0/2396853931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d000714a0 0x7f1d001f2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1cff400640 1 -- 172.21.15.78:0/2396853931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d00159c90 con 0x7f1d000c9550 2024-05-21T14:43:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.193+0000 7f1cff400640 1 --2- 172.21.15.78:0/2396853931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d000c9550 0x7f1d00157bd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800cb20 tx=0x7f1cf80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.197+0000 7f1cf7400640 1 -- 172.21.15.78:0/2396853931 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf800ac00 con 0x7f1d000c9550 2024-05-21T14:43:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.197+0000 7f1cf7400640 1 -- 172.21.15.78:0/2396853931 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf800adc0 con 0x7f1d000c9550 2024-05-21T14:43:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.197+0000 7f1d05e00640 1 -- 172.21.15.78:0/2396853931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d00157790 con 0x7f1d000c9550 2024-05-21T14:43:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.197+0000 7f1cf7400640 1 -- 172.21.15.78:0/2396853931 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8012640 con 0x7f1d000c9550 2024-05-21T14:43:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.197+0000 7f1d05e00640 1 -- 172.21.15.78:0/2396853931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d001e28c0 con 0x7f1d000c9550 2024-05-21T14:43:31.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.197+0000 7f1d05e00640 1 -- 172.21.15.78:0/2396853931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d001e2350 con 0x7f1d000c9550 2024-05-21T14:43:31.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.197+0000 7f1cf7400640 1 -- 172.21.15.78:0/2396853931 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1cf80127e0 con 0x7f1d000c9550 2024-05-21T14:43:31.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.201+0000 7f1cf7400640 1 --2- 172.21.15.78:0/2396853931 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1ce00678f0 0x7f1ce0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:31.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.201+0000 7f1cf7400640 1 -- 172.21.15.78:0/2396853931 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1cf80860d0 con 0x7f1d000c9550 2024-05-21T14:43:31.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.201+0000 7f1cfea00640 1 --2- 172.21.15.78:0/2396853931 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1ce00678f0 0x7f1ce0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:31.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.201+0000 7f1cfea00640 1 --2- 172.21.15.78:0/2396853931 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1ce00678f0 0x7f1ce0069e00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00b2000 tx=0x7f1cf0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:31.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.209+0000 7f1cf7400640 1 -- 172.21.15.78:0/2396853931 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1cf80565b0 con 0x7f1d000c9550 2024-05-21T14:43:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.397+0000 7f1d05e00640 1 -- 172.21.15.78:0/2396853931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1d0004f730 con 0x7f1d000c9550 2024-05-21T14:43:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.401+0000 7f1cf7400640 1 -- 172.21.15.78:0/2396853931 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f1cf805a8b0 con 0x7f1d000c9550 2024-05-21T14:43:31.407 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:31.407 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-05-21T14:43:31.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.401+0000 7f1d05e00640 1 -- 172.21.15.78:0/2396853931 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1ce00678f0 msgr2=0x7f1ce0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:31.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.401+0000 7f1d05e00640 1 --2- 172.21.15.78:0/2396853931 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1ce00678f0 0x7f1ce0069e00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00b2000 tx=0x7f1cf0008040 comp rx=0 tx=0).stop 2024-05-21T14:43:31.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.401+0000 7f1d05e00640 1 -- 172.21.15.78:0/2396853931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d000c9550 msgr2=0x7f1d00157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:31.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.401+0000 7f1d05e00640 1 --2- 172.21.15.78:0/2396853931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d000c9550 0x7f1d00157bd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800cb20 tx=0x7f1cf80021d0 comp rx=0 tx=0).stop 2024-05-21T14:43:31.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.401+0000 7f1d05e00640 1 -- 172.21.15.78:0/2396853931 shutdown_connections 2024-05-21T14:43:31.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.401+0000 7f1d05e00640 1 --2- 172.21.15.78:0/2396853931 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1ce00678f0 0x7f1ce0069e00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:31.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.401+0000 7f1d05e00640 1 --2- 172.21.15.78:0/2396853931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d000c9550 0x7f1d00157bd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:31.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.401+0000 7f1d05e00640 1 --2- 172.21.15.78:0/2396853931 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d000718b0 0x7f1d00159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:31.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.401+0000 7f1d05e00640 1 --2- 172.21.15.78:0/2396853931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d000714a0 0x7f1d001f2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:31.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.401+0000 7f1d05e00640 1 -- 172.21.15.78:0/2396853931 >> 172.21.15.78:0/2396853931 conn(0x7f1d000752c0 msgr2=0x7f1d000ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:31.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.401+0000 7f1d05e00640 1 -- 172.21.15.78:0/2396853931 shutdown_connections 2024-05-21T14:43:31.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:31.401+0000 7f1d05e00640 1 -- 172.21.15.78:0/2396853931 wait complete. 2024-05-21T14:43:33.315 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-05-21T14:43:33.309+0000 7f9a2ec00640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-05-21T14:43:34.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-21T14:43:34.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.569+0000 7f1571c00640 1 Processor -- start 2024-05-21T14:43:34.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.569+0000 7f1571c00640 1 -- start start 2024-05-21T14:43:34.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.569+0000 7f1571c00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f156c156dc0 0x7f156c0c9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:34.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.569+0000 7f1571c00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f156c159a60 con 0x7f156c0719c0 2024-05-21T14:43:34.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.569+0000 7f1571c00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f156c159d40 con 0x7f156c074cc0 2024-05-21T14:43:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.569+0000 7f1571c00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f156c070e20 con 0x7f156c156dc0 2024-05-21T14:43:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.569+0000 7f156aa00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f156c156dc0 0x7f156c0c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.569+0000 7f156b400640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f156c0719c0 0x7f156c163fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39904/0 (socket says 172.21.15.78:39904) 2024-05-21T14:43:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.569+0000 7f156b400640 1 -- 172.21.15.78:0/4038958215 learned_addr learned my addr 172.21.15.78:0/4038958215 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.573+0000 7f156aa00640 1 -- 172.21.15.78:0/4038958215 >> v1:172.21.15.84:6789/0 conn(0x7f156c074cc0 legacy=0x7f156c0712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:34.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.573+0000 7f156aa00640 1 -- 172.21.15.78:0/4038958215 >> v1:172.21.15.78:6789/0 conn(0x7f156c0719c0 legacy=0x7f156c163fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.573+0000 7f156aa00640 1 -- 172.21.15.78:0/4038958215 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f156c15a020 con 0x7f156c156dc0 2024-05-21T14:43:34.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.573+0000 7f1569600640 1 -- 172.21.15.78:0/4038958215 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212174157 0 0) 0x7f156c159a60 con 0x7f156c0719c0 2024-05-21T14:43:34.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.573+0000 7f156aa00640 1 --2- 172.21.15.78:0/4038958215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c156dc0 0x7f156c0c9550 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f155c0097c0 tx=0x7f155c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9314b75d9dd43bf0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:34.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.573+0000 7f1569600640 1 -- 172.21.15.78:0/4038958215 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155c0b5070 con 0x7f156c156dc0 2024-05-21T14:43:34.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.573+0000 7f1569600640 1 -- 172.21.15.78:0/4038958215 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f155c0a8990 con 0x7f156c156dc0 2024-05-21T14:43:34.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.573+0000 7f1569600640 1 -- 172.21.15.78:0/4038958215 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155c0a8d60 con 0x7f156c156dc0 2024-05-21T14:43:34.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.577+0000 7f1571c00640 1 -- 172.21.15.78:0/4038958215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c156dc0 msgr2=0x7f156c0c9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:34.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.577+0000 7f1571c00640 1 --2- 172.21.15.78:0/4038958215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c156dc0 0x7f156c0c9550 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f155c0097c0 tx=0x7f155c01ec90 comp rx=0 tx=0).stop 2024-05-21T14:43:34.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.577+0000 7f1571c00640 1 -- 172.21.15.78:0/4038958215 shutdown_connections 2024-05-21T14:43:34.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.577+0000 7f1571c00640 1 --2- 172.21.15.78:0/4038958215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c156dc0 0x7f156c0c9550 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:34.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.577+0000 7f1571c00640 1 -- 172.21.15.78:0/4038958215 >> 172.21.15.78:0/4038958215 conn(0x7f156c073cb0 msgr2=0x7f156c0ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:34.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.577+0000 7f1571c00640 1 -- 172.21.15.78:0/4038958215 shutdown_connections 2024-05-21T14:43:34.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.577+0000 7f1571c00640 1 -- 172.21.15.78:0/4038958215 wait complete. 2024-05-21T14:43:34.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.577+0000 7f1571c00640 1 Processor -- start 2024-05-21T14:43:34.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.577+0000 7f1571c00640 1 -- start start 2024-05-21T14:43:34.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.577+0000 7f1571c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c0719c0 0x7f156c1e36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:34.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.577+0000 7f1571c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f156c074cc0 0x7f156c156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:34.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f1571c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f156c156dc0 0x7f156c0c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:34.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f1571c00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f156c0c9a90 con 0x7f156c0719c0 2024-05-21T14:43:34.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f1571c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f156c1571d0 con 0x7f156c074cc0 2024-05-21T14:43:34.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f1571c00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f156c159730 con 0x7f156c156dc0 2024-05-21T14:43:34.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f156aa00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c0719c0 0x7f156c1e36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:34.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f156aa00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c0719c0 0x7f156c1e36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50660/0 (socket says 172.21.15.78:50660) 2024-05-21T14:43:34.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f156aa00640 1 -- 172.21.15.78:0/714057022 learned_addr learned my addr 172.21.15.78:0/714057022 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:34.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f156b400640 1 --2- 172.21.15.78:0/714057022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f156c156dc0 0x7f156c0c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:34.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f156a000640 1 --2- 172.21.15.78:0/714057022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f156c074cc0 0x7f156c156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:34.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f156aa00640 1 -- 172.21.15.78:0/714057022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f156c156dc0 msgr2=0x7f156c0c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:34.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f156aa00640 1 --2- 172.21.15.78:0/714057022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f156c156dc0 0x7f156c0c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:34.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f156aa00640 1 -- 172.21.15.78:0/714057022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f156c074cc0 msgr2=0x7f156c156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:34.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f156aa00640 1 --2- 172.21.15.78:0/714057022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f156c074cc0 0x7f156c156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:34.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f156aa00640 1 -- 172.21.15.78:0/714057022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f156c1e3c30 con 0x7f156c0719c0 2024-05-21T14:43:34.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f156aa00640 1 --2- 172.21.15.78:0/714057022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c0719c0 0x7f156c1e36f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f155c01b8a0 tx=0x7f155c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:34.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f1562a00640 1 -- 172.21.15.78:0/714057022 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155c0b5040 con 0x7f156c0719c0 2024-05-21T14:43:34.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f1562a00640 1 -- 172.21.15.78:0/714057022 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f155c0c0070 con 0x7f156c0719c0 2024-05-21T14:43:34.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f1571c00640 1 -- 172.21.15.78:0/714057022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f156c0c8680 con 0x7f156c0719c0 2024-05-21T14:43:34.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f1562a00640 1 -- 172.21.15.78:0/714057022 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155c0b0aa0 con 0x7f156c0719c0 2024-05-21T14:43:34.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f1571c00640 1 -- 172.21.15.78:0/714057022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f156c1efde0 con 0x7f156c0719c0 2024-05-21T14:43:34.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f1571c00640 1 -- 172.21.15.78:0/714057022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f156c04f730 con 0x7f156c0719c0 2024-05-21T14:43:34.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.581+0000 7f1562a00640 1 -- 172.21.15.78:0/714057022 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f155c0b0c40 con 0x7f156c0719c0 2024-05-21T14:43:34.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.585+0000 7f1562a00640 1 --2- 172.21.15.78:0/714057022 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f154c0678c0 0x7f154c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:34.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.585+0000 7f1562a00640 1 -- 172.21.15.78:0/714057022 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f155c123e40 con 0x7f156c0719c0 2024-05-21T14:43:34.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.585+0000 7f156a000640 1 --2- 172.21.15.78:0/714057022 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f154c0678c0 0x7f154c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:34.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.585+0000 7f156a000640 1 --2- 172.21.15.78:0/714057022 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f154c0678c0 0x7f154c069dd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f156c158a50 tx=0x7f1558009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:34.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.589+0000 7f1562a00640 1 -- 172.21.15.78:0/714057022 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f155c0ca020 con 0x7f156c0719c0 2024-05-21T14:43:34.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.781+0000 7f1571c00640 1 -- 172.21.15.78:0/714057022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f156c1532b0 con 0x7f156c0719c0 2024-05-21T14:43:34.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.785+0000 7f1562a00640 1 -- 172.21.15.78:0/714057022 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f155c0187f0 con 0x7f156c0719c0 2024-05-21T14:43:34.791 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:34.791 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-05-21T14:43:34.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.785+0000 7f1571c00640 1 -- 172.21.15.78:0/714057022 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f154c0678c0 msgr2=0x7f154c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:34.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.785+0000 7f1571c00640 1 --2- 172.21.15.78:0/714057022 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f154c0678c0 0x7f154c069dd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f156c158a50 tx=0x7f1558009040 comp rx=0 tx=0).stop 2024-05-21T14:43:34.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.785+0000 7f1571c00640 1 -- 172.21.15.78:0/714057022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c0719c0 msgr2=0x7f156c1e36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:34.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.785+0000 7f1571c00640 1 --2- 172.21.15.78:0/714057022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c0719c0 0x7f156c1e36f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f155c01b8a0 tx=0x7f155c01ba30 comp rx=0 tx=0).stop 2024-05-21T14:43:34.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.785+0000 7f1571c00640 1 -- 172.21.15.78:0/714057022 shutdown_connections 2024-05-21T14:43:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.785+0000 7f1571c00640 1 --2- 172.21.15.78:0/714057022 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f154c0678c0 0x7f154c069dd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.785+0000 7f1571c00640 1 --2- 172.21.15.78:0/714057022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f156c156dc0 0x7f156c0c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.785+0000 7f1571c00640 1 --2- 172.21.15.78:0/714057022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f156c074cc0 0x7f156c156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.785+0000 7f1571c00640 1 --2- 172.21.15.78:0/714057022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c0719c0 0x7f156c1e36f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.785+0000 7f1571c00640 1 -- 172.21.15.78:0/714057022 >> 172.21.15.78:0/714057022 conn(0x7f156c073cb0 msgr2=0x7f156c150740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.785+0000 7f1571c00640 1 -- 172.21.15.78:0/714057022 shutdown_connections 2024-05-21T14:43:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:34.785+0000 7f1571c00640 1 -- 172.21.15.78:0/714057022 wait complete. 2024-05-21T14:43:37.813 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-21T14:43:37.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.953+0000 7f83d7200640 1 Processor -- start 2024-05-21T14:43:37.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.953+0000 7f83d7200640 1 -- start start 2024-05-21T14:43:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.953+0000 7f83d7200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83d01536f0 0x7f83d015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.953+0000 7f83d7200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f83d00c76f0 0x7f83d00c5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.953+0000 7f83d7200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83d00c4f60 con 0x7f83d00c7b00 2024-05-21T14:43:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.953+0000 7f83d7200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f83d006d270 con 0x7f83d01536f0 2024-05-21T14:43:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.953+0000 7f83d7200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f83d00c5200 con 0x7f83d00c76f0 2024-05-21T14:43:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.953+0000 7f83cfe00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83d01536f0 0x7f83d015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.953+0000 7f83cfe00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83d01536f0 0x7f83d015cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50668/0 (socket says 172.21.15.78:50668) 2024-05-21T14:43:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.953+0000 7f83cfe00640 1 -- 172.21.15.78:0/4148382211 learned_addr learned my addr 172.21.15.78:0/4148382211 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.957+0000 7f83c7e00640 1 --2- 172.21.15.78:0/4148382211 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f83d00c76f0 0x7f83d00c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:37.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.957+0000 7f83cfe00640 1 -- 172.21.15.78:0/4148382211 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f83d00c76f0 msgr2=0x7f83d00c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:37.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.957+0000 7f83cfe00640 1 --2- 172.21.15.78:0/4148382211 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f83d00c76f0 0x7f83d00c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:37.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.957+0000 7f83cfe00640 1 -- 172.21.15.78:0/4148382211 >> v1:172.21.15.84:6789/0 conn(0x7f83d00c7b00 legacy=0x7f83d0159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:37.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.957+0000 7f83cfe00640 1 -- 172.21.15.78:0/4148382211 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d00c54e0 con 0x7f83d01536f0 2024-05-21T14:43:37.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.957+0000 7f83cfe00640 1 --2- 172.21.15.78:0/4148382211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d01536f0 0x7f83d015cad0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009870 tx=0x7f83c001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589d5ce124059f2e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:37.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.957+0000 7f83cf400640 1 -- 172.21.15.78:0/4148382211 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c00b2070 con 0x7f83d01536f0 2024-05-21T14:43:37.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.957+0000 7f83cf400640 1 -- 172.21.15.78:0/4148382211 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c00a9070 con 0x7f83d01536f0 2024-05-21T14:43:37.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.957+0000 7f83cf400640 1 -- 172.21.15.78:0/4148382211 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c00ad880 con 0x7f83d01536f0 2024-05-21T14:43:37.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.961+0000 7f83d7200640 1 -- 172.21.15.78:0/4148382211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d01536f0 msgr2=0x7f83d015cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:37.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.961+0000 7f83d7200640 1 --2- 172.21.15.78:0/4148382211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d01536f0 0x7f83d015cad0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009870 tx=0x7f83c001c560 comp rx=0 tx=0).stop 2024-05-21T14:43:37.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.961+0000 7f83d7200640 1 -- 172.21.15.78:0/4148382211 shutdown_connections 2024-05-21T14:43:37.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.961+0000 7f83d7200640 1 --2- 172.21.15.78:0/4148382211 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f83d00c76f0 0x7f83d00c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:37.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.961+0000 7f83d7200640 1 --2- 172.21.15.78:0/4148382211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d01536f0 0x7f83d015cad0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.961+0000 7f83d7200640 1 -- 172.21.15.78:0/4148382211 >> 172.21.15.78:0/4148382211 conn(0x7f83d00cacb0 msgr2=0x7f83d00cd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.961+0000 7f83d7200640 1 -- 172.21.15.78:0/4148382211 shutdown_connections 2024-05-21T14:43:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.961+0000 7f83d7200640 1 -- 172.21.15.78:0/4148382211 wait complete. 2024-05-21T14:43:37.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.961+0000 7f83d7200640 1 Processor -- start 2024-05-21T14:43:37.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83d7200640 1 -- start start 2024-05-21T14:43:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83d7200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d00c76f0 0x7f83d014b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83d7200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f83d00c7b00 0x7f83d01421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83d7200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83d01536f0 0x7f83d0142700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83d7200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f83d006d700 con 0x7f83d00c76f0 2024-05-21T14:43:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83d7200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f83d015d010 con 0x7f83d01536f0 2024-05-21T14:43:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83d7200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f83d0150450 con 0x7f83d00c7b00 2024-05-21T14:43:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83cfe00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d00c76f0 0x7f83d014b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83cfe00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d00c76f0 0x7f83d014b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50680/0 (socket says 172.21.15.78:50680) 2024-05-21T14:43:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83cfe00640 1 -- 172.21.15.78:0/2235775637 learned_addr learned my addr 172.21.15.78:0/2235775637 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83c7e00640 1 --2- 172.21.15.78:0/2235775637 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f83d00c7b00 0x7f83d01421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83cfe00640 1 -- 172.21.15.78:0/2235775637 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f83d00c7b00 msgr2=0x7f83d01421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83cfe00640 1 --2- 172.21.15.78:0/2235775637 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f83d00c7b00 0x7f83d01421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83cfe00640 1 -- 172.21.15.78:0/2235775637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83d01536f0 msgr2=0x7f83d0142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83cfe00640 1 --2- 172.21.15.78:0/2235775637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83d01536f0 0x7f83d0142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83cfe00640 1 -- 172.21.15.78:0/2235775637 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d00cbda0 con 0x7f83d00c76f0 2024-05-21T14:43:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83cfe00640 1 --2- 172.21.15.78:0/2235775637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d00c76f0 0x7f83d014b190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f83c00b0040 tx=0x7f83c001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:37.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83ccc00640 1 -- 172.21.15.78:0/2235775637 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c00b2040 con 0x7f83d00c76f0 2024-05-21T14:43:37.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83ccc00640 1 -- 172.21.15.78:0/2235775637 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c00be070 con 0x7f83d00c76f0 2024-05-21T14:43:37.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83d7200640 1 -- 172.21.15.78:0/2235775637 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d00cc040 con 0x7f83d00c76f0 2024-05-21T14:43:37.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83ccc00640 1 -- 172.21.15.78:0/2235775637 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c00b8420 con 0x7f83d00c76f0 2024-05-21T14:43:37.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.965+0000 7f83d7200640 1 -- 172.21.15.78:0/2235775637 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d01446a0 con 0x7f83d00c76f0 2024-05-21T14:43:37.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.969+0000 7f83d7200640 1 -- 172.21.15.78:0/2235775637 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d004f730 con 0x7f83d00c76f0 2024-05-21T14:43:37.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.969+0000 7f83ccc00640 1 -- 172.21.15.78:0/2235775637 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f83c00ab070 con 0x7f83d00c76f0 2024-05-21T14:43:37.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.969+0000 7f83ccc00640 1 --2- 172.21.15.78:0/2235775637 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f83ac0678f0 0x7f83ac069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.969+0000 7f83ccc00640 1 -- 172.21.15.78:0/2235775637 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f83c011fd00 con 0x7f83d00c76f0 2024-05-21T14:43:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.969+0000 7f83c7e00640 1 --2- 172.21.15.78:0/2235775637 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f83ac0678f0 0x7f83ac069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:37.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.973+0000 7f83c7e00640 1 --2- 172.21.15.78:0/2235775637 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f83ac0678f0 0x7f83ac069e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009a50 tx=0x7f83b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:37.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:37.973+0000 7f83ccc00640 1 -- 172.21.15.78:0/2235775637 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f83c0016150 con 0x7f83d00c76f0 2024-05-21T14:43:38.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:38.165+0000 7f83d7200640 1 -- 172.21.15.78:0/2235775637 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f83d00c47b0 con 0x7f83d00c76f0 2024-05-21T14:43:38.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:38.165+0000 7f83ccc00640 1 -- 172.21.15.78:0/2235775637 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f83c00f07a0 con 0x7f83d00c76f0 2024-05-21T14:43:38.172 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:38.172 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-05-21T14:43:38.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:38.165+0000 7f83d7200640 1 -- 172.21.15.78:0/2235775637 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f83ac0678f0 msgr2=0x7f83ac069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:38.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:38.165+0000 7f83d7200640 1 --2- 172.21.15.78:0/2235775637 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f83ac0678f0 0x7f83ac069e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009a50 tx=0x7f83b8008040 comp rx=0 tx=0).stop 2024-05-21T14:43:38.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:38.165+0000 7f83d7200640 1 -- 172.21.15.78:0/2235775637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d00c76f0 msgr2=0x7f83d014b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:38.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:38.165+0000 7f83d7200640 1 --2- 172.21.15.78:0/2235775637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d00c76f0 0x7f83d014b190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f83c00b0040 tx=0x7f83c001ada0 comp rx=0 tx=0).stop 2024-05-21T14:43:38.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:38.165+0000 7f83d7200640 1 -- 172.21.15.78:0/2235775637 shutdown_connections 2024-05-21T14:43:38.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:38.165+0000 7f83d7200640 1 --2- 172.21.15.78:0/2235775637 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f83ac0678f0 0x7f83ac069e00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:38.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:38.165+0000 7f83d7200640 1 --2- 172.21.15.78:0/2235775637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83d01536f0 0x7f83d0142700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:38.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:38.165+0000 7f83d7200640 1 --2- 172.21.15.78:0/2235775637 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f83d00c7b00 0x7f83d01421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:38.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:38.165+0000 7f83d7200640 1 --2- 172.21.15.78:0/2235775637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d00c76f0 0x7f83d014b190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:38.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:38.165+0000 7f83d7200640 1 -- 172.21.15.78:0/2235775637 >> 172.21.15.78:0/2235775637 conn(0x7f83d00cacb0 msgr2=0x7f83d015b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:38.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:38.165+0000 7f83d7200640 1 -- 172.21.15.78:0/2235775637 shutdown_connections 2024-05-21T14:43:38.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:38.165+0000 7f83d7200640 1 -- 172.21.15.78:0/2235775637 wait complete. 2024-05-21T14:43:38.316 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-05-21T14:43:38.309+0000 7f9a2ec00640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-05-21T14:43:41.195 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-21T14:43:41.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.333+0000 7fd8f0400640 1 Processor -- start 2024-05-21T14:43:41.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.333+0000 7fd8f0400640 1 -- start start 2024-05-21T14:43:41.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.337+0000 7fd8f0400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd8e80c9790 0x7fd8e8070d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:41.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.337+0000 7fd8f0400640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8e8071420 con 0x7fd8e8155b80 2024-05-21T14:43:41.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.337+0000 7fd8f0400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8e8071700 con 0x7fd8e80cb5b0 2024-05-21T14:43:41.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.337+0000 7fd8f0400640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fd8e815f2d0 con 0x7fd8e80c9790 2024-05-21T14:43:41.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.337+0000 7fd8ed000640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd8e8155b80 0x7fd8e815f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39916/0 (socket says 172.21.15.78:39916) 2024-05-21T14:43:41.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.337+0000 7fd8ed000640 1 -- 172.21.15.78:0/1723792910 learned_addr learned my addr 172.21.15.78:0/1723792910 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:41.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.337+0000 7fd8eda00640 1 --2- 172.21.15.78:0/1723792910 >> v2:172.21.15.78:3300/0 conn(0x7fd8e80c9790 0x7fd8e8070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:41.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.337+0000 7fd8e7e00640 1 -- 172.21.15.78:0/1723792910 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3810233083 0 0) 0x7fd8e8071420 con 0x7fd8e8155b80 2024-05-21T14:43:41.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.337+0000 7fd8e7e00640 1 -- 172.21.15.78:0/1723792910 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8d0003530 con 0x7fd8e8155b80 2024-05-21T14:43:41.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.337+0000 7fd8eda00640 1 -- 172.21.15.78:0/1723792910 >> v1:172.21.15.84:6789/0 conn(0x7fd8e80cb5b0 legacy=0x7fd8e81661a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:41.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.337+0000 7fd8eda00640 1 -- 172.21.15.78:0/1723792910 >> v1:172.21.15.78:6789/0 conn(0x7fd8e8155b80 legacy=0x7fd8e815f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:41.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.337+0000 7fd8eda00640 1 -- 172.21.15.78:0/1723792910 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e80719e0 con 0x7fd8e80c9790 2024-05-21T14:43:41.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.341+0000 7fd8eda00640 1 --2- 172.21.15.78:0/1723792910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80c9790 0x7fd8e8070d70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0097c0 tx=0x7fd8dc01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e66549be6e10c66 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:41.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.341+0000 7fd8e7e00640 1 -- 172.21.15.78:0/1723792910 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc0b5070 con 0x7fd8e80c9790 2024-05-21T14:43:41.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.341+0000 7fd8e7e00640 1 -- 172.21.15.78:0/1723792910 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8dc0a8990 con 0x7fd8e80c9790 2024-05-21T14:43:41.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.341+0000 7fd8e7e00640 1 -- 172.21.15.78:0/1723792910 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc0a8d60 con 0x7fd8e80c9790 2024-05-21T14:43:41.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.341+0000 7fd8f0400640 1 -- 172.21.15.78:0/1723792910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80c9790 msgr2=0x7fd8e8070d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:41.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.341+0000 7fd8f0400640 1 --2- 172.21.15.78:0/1723792910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80c9790 0x7fd8e8070d70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0097c0 tx=0x7fd8dc01ec90 comp rx=0 tx=0).stop 2024-05-21T14:43:41.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.341+0000 7fd8f0400640 1 -- 172.21.15.78:0/1723792910 shutdown_connections 2024-05-21T14:43:41.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.341+0000 7fd8f0400640 1 --2- 172.21.15.78:0/1723792910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80c9790 0x7fd8e8070d70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:41.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.341+0000 7fd8f0400640 1 -- 172.21.15.78:0/1723792910 >> 172.21.15.78:0/1723792910 conn(0x7fd8e80752c0 msgr2=0x7fd8e80ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:41.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.341+0000 7fd8f0400640 1 -- 172.21.15.78:0/1723792910 shutdown_connections 2024-05-21T14:43:41.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.341+0000 7fd8f0400640 1 -- 172.21.15.78:0/1723792910 wait complete. 2024-05-21T14:43:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.341+0000 7fd8f0400640 1 Processor -- start 2024-05-21T14:43:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.341+0000 7fd8f0400640 1 -- start start 2024-05-21T14:43:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8f0400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e80c9790 0x7fd8e80cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8f0400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80cb5b0 0x7fd8e814e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8f0400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8e8155b80 0x7fd8e814eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8f0400640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e80c9fe0 con 0x7fd8e80cb5b0 2024-05-21T14:43:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8f0400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e8155f90 con 0x7fd8e80c9790 2024-05-21T14:43:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8f0400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e80ca160 con 0x7fd8e8155b80 2024-05-21T14:43:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8ed000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80cb5b0 0x7fd8e814e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8ed000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80cb5b0 0x7fd8e814e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50700/0 (socket says 172.21.15.78:50700) 2024-05-21T14:43:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8ed000640 1 -- 172.21.15.78:0/3965125353 learned_addr learned my addr 172.21.15.78:0/3965125353 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8eda00640 1 --2- 172.21.15.78:0/3965125353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e80c9790 0x7fd8e80cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8ee400640 1 --2- 172.21.15.78:0/3965125353 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8e8155b80 0x7fd8e814eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:41.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8ed000640 1 -- 172.21.15.78:0/3965125353 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8e8155b80 msgr2=0x7fd8e814eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:41.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8ed000640 1 --2- 172.21.15.78:0/3965125353 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8e8155b80 0x7fd8e814eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:41.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8ed000640 1 -- 172.21.15.78:0/3965125353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e80c9790 msgr2=0x7fd8e80cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:41.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8ed000640 1 --2- 172.21.15.78:0/3965125353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e80c9790 0x7fd8e80cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:41.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8ed000640 1 -- 172.21.15.78:0/3965125353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e80c5090 con 0x7fd8e80cb5b0 2024-05-21T14:43:41.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8ed000640 1 --2- 172.21.15.78:0/3965125353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80cb5b0 0x7fd8e814e5f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400c430 tx=0x7fd8d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:41.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8e5600640 1 -- 172.21.15.78:0/3965125353 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4017070 con 0x7fd8e80cb5b0 2024-05-21T14:43:41.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8e5600640 1 -- 172.21.15.78:0/3965125353 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d4005cf0 con 0x7fd8e80cb5b0 2024-05-21T14:43:41.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8e5600640 1 -- 172.21.15.78:0/3965125353 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d40072d0 con 0x7fd8e80cb5b0 2024-05-21T14:43:41.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8f0400640 1 -- 172.21.15.78:0/3965125353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e80cd1a0 con 0x7fd8e80cb5b0 2024-05-21T14:43:41.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8f0400640 1 -- 172.21.15.78:0/3965125353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e80ccf00 con 0x7fd8e80cb5b0 2024-05-21T14:43:41.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.345+0000 7fd8f0400640 1 -- 172.21.15.78:0/3965125353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8e804f730 con 0x7fd8e80cb5b0 2024-05-21T14:43:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.349+0000 7fd8e5600640 1 -- 172.21.15.78:0/3965125353 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd8d4007470 con 0x7fd8e80cb5b0 2024-05-21T14:43:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.349+0000 7fd8e5600640 1 --2- 172.21.15.78:0/3965125353 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fd8c80678c0 0x7fd8c8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.349+0000 7fd8e5600640 1 -- 172.21.15.78:0/3965125353 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd8d4084e80 con 0x7fd8e80cb5b0 2024-05-21T14:43:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.349+0000 7fd8eda00640 1 --2- 172.21.15.78:0/3965125353 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fd8c80678c0 0x7fd8c8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:41.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.353+0000 7fd8eda00640 1 --2- 172.21.15.78:0/3965125353 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fd8c80678c0 0x7fd8c8069dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0b2000 tx=0x7fd8dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:41.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.357+0000 7fd8e5600640 1 -- 172.21.15.78:0/3965125353 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fd8d4055410 con 0x7fd8e80cb5b0 2024-05-21T14:43:41.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.545+0000 7fd8f0400640 1 -- 172.21.15.78:0/3965125353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd8e80cb390 con 0x7fd8e80cb5b0 2024-05-21T14:43:41.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.549+0000 7fd8e5600640 1 -- 172.21.15.78:0/3965125353 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7fd8d4059710 con 0x7fd8e80cb5b0 2024-05-21T14:43:41.555 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:41.556 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-05-21T14:43:41.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.549+0000 7fd8f0400640 1 -- 172.21.15.78:0/3965125353 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fd8c80678c0 msgr2=0x7fd8c8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:41.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.549+0000 7fd8f0400640 1 --2- 172.21.15.78:0/3965125353 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fd8c80678c0 0x7fd8c8069dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0b2000 tx=0x7fd8dc008040 comp rx=0 tx=0).stop 2024-05-21T14:43:41.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.549+0000 7fd8f0400640 1 -- 172.21.15.78:0/3965125353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80cb5b0 msgr2=0x7fd8e814e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:41.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.549+0000 7fd8f0400640 1 --2- 172.21.15.78:0/3965125353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80cb5b0 0x7fd8e814e5f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400c430 tx=0x7fd8d400c8f0 comp rx=0 tx=0).stop 2024-05-21T14:43:41.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.549+0000 7fd8f0400640 1 -- 172.21.15.78:0/3965125353 shutdown_connections 2024-05-21T14:43:41.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.549+0000 7fd8f0400640 1 --2- 172.21.15.78:0/3965125353 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fd8c80678c0 0x7fd8c8069dd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:41.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.549+0000 7fd8f0400640 1 --2- 172.21.15.78:0/3965125353 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8e8155b80 0x7fd8e814eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:41.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.549+0000 7fd8f0400640 1 --2- 172.21.15.78:0/3965125353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e80cb5b0 0x7fd8e814e5f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:41.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.549+0000 7fd8f0400640 1 --2- 172.21.15.78:0/3965125353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e80c9790 0x7fd8e80cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:41.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.549+0000 7fd8f0400640 1 -- 172.21.15.78:0/3965125353 >> 172.21.15.78:0/3965125353 conn(0x7fd8e80752c0 msgr2=0x7fd8e806d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:41.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.549+0000 7fd8f0400640 1 -- 172.21.15.78:0/3965125353 shutdown_connections 2024-05-21T14:43:41.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:41.549+0000 7fd8f0400640 1 -- 172.21.15.78:0/3965125353 wait complete. 2024-05-21T14:43:43.316 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-05-21T14:43:43.309+0000 7f9a2ec00640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-05-21T14:43:44.578 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-21T14:43:44.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.717+0000 7fa013e00640 1 Processor -- start 2024-05-21T14:43:44.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.717+0000 7fa013e00640 1 -- start start 2024-05-21T14:43:44.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.717+0000 7fa013e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa01415cc30 0x7fa014073870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:44.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.717+0000 7fa013e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa014153960 0x7fa014164010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:44.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.717+0000 7fa013e00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0140c9f90 con 0x7fa0140c8290 2024-05-21T14:43:44.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.717+0000 7fa013e00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fa014073100 con 0x7fa014153960 2024-05-21T14:43:44.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.717+0000 7fa013e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa0140733e0 con 0x7fa01415cc30 2024-05-21T14:43:44.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.717+0000 7fa013400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa014153960 0x7fa014164010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:44.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.717+0000 7fa013400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa014153960 0x7fa014164010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42464/0 (socket says 172.21.15.78:42464) 2024-05-21T14:43:44.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.717+0000 7fa013400640 1 -- 172.21.15.78:0/292896180 learned_addr learned my addr 172.21.15.78:0/292896180 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:44.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.717+0000 7fa00be00640 1 --2- 172.21.15.78:0/292896180 >> v2:172.21.15.84:3300/0 conn(0x7fa01415cc30 0x7fa014073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:44.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.721+0000 7fa013400640 1 -- 172.21.15.78:0/292896180 >> v2:172.21.15.84:3300/0 conn(0x7fa01415cc30 msgr2=0x7fa014073870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:44.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.721+0000 7fa013400640 1 --2- 172.21.15.78:0/292896180 >> v2:172.21.15.84:3300/0 conn(0x7fa01415cc30 0x7fa014073870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:44.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.721+0000 7fa013400640 1 -- 172.21.15.78:0/292896180 >> v1:172.21.15.84:6789/0 conn(0x7fa0140c8290 legacy=0x7fa0140c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:44.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.721+0000 7fa013400640 1 -- 172.21.15.78:0/292896180 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa01406c7a0 con 0x7fa014153960 2024-05-21T14:43:44.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.721+0000 7fa013400640 1 --2- 172.21.15.78:0/292896180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa014153960 0x7fa014164010 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa014071da0 tx=0x7fa00c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3be77da6c663a39 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:44.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.721+0000 7fa012000640 1 -- 172.21.15.78:0/292896180 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00c0a5670 con 0x7fa014153960 2024-05-21T14:43:44.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.721+0000 7fa012000640 1 -- 172.21.15.78:0/292896180 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00c0a5810 con 0x7fa014153960 2024-05-21T14:43:44.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.721+0000 7fa012000640 1 -- 172.21.15.78:0/292896180 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00c0a5be0 con 0x7fa014153960 2024-05-21T14:43:44.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.721+0000 7fa013e00640 1 -- 172.21.15.78:0/292896180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa014153960 msgr2=0x7fa014164010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:44.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.721+0000 7fa013e00640 1 --2- 172.21.15.78:0/292896180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa014153960 0x7fa014164010 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa014071da0 tx=0x7fa00c01c9b0 comp rx=0 tx=0).stop 2024-05-21T14:43:44.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.721+0000 7fa013e00640 1 -- 172.21.15.78:0/292896180 shutdown_connections 2024-05-21T14:43:44.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.721+0000 7fa013e00640 1 --2- 172.21.15.78:0/292896180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa014153960 0x7fa014164010 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:44.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.721+0000 7fa013e00640 1 --2- 172.21.15.78:0/292896180 >> v2:172.21.15.84:3300/0 conn(0x7fa01415cc30 0x7fa014073870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:44.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.721+0000 7fa013e00640 1 -- 172.21.15.78:0/292896180 >> 172.21.15.78:0/292896180 conn(0x7fa01406e0a0 msgr2=0x7fa01406e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:44.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.721+0000 7fa013e00640 1 -- 172.21.15.78:0/292896180 shutdown_connections 2024-05-21T14:43:44.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.725+0000 7fa013e00640 1 -- 172.21.15.78:0/292896180 wait complete. 2024-05-21T14:43:44.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.725+0000 7fa013e00640 1 Processor -- start 2024-05-21T14:43:44.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.725+0000 7fa013e00640 1 -- start start 2024-05-21T14:43:44.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.725+0000 7fa013e00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa0140c8290 0x7fa0141f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:44.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.725+0000 7fa013e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa014153960 0x7fa0141598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:44.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.725+0000 7fa013e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa01415cc30 0x7fa01414f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:44.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.725+0000 7fa013e00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa0140722f0 con 0x7fa014153960 2024-05-21T14:43:44.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.725+0000 7fa013e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa01415d040 con 0x7fa01415cc30 2024-05-21T14:43:44.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.725+0000 7fa013e00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa0140c76b0 con 0x7fa0140c8290 2024-05-21T14:43:44.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.725+0000 7fa00be00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa014153960 0x7fa0141598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:44.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.725+0000 7fa00be00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa014153960 0x7fa0141598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42466/0 (socket says 172.21.15.78:42466) 2024-05-21T14:43:44.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.725+0000 7fa00be00640 1 -- 172.21.15.78:0/1873190532 learned_addr learned my addr 172.21.15.78:0/1873190532 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:44.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.725+0000 7fa012a00640 1 --2- 172.21.15.78:0/1873190532 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa0140c8290 0x7fa0141f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:44.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.725+0000 7fa013400640 1 --2- 172.21.15.78:0/1873190532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa01415cc30 0x7fa01414f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:44.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.729+0000 7fa00be00640 1 -- 172.21.15.78:0/1873190532 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa0140c8290 msgr2=0x7fa0141f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:44.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.729+0000 7fa00be00640 1 --2- 172.21.15.78:0/1873190532 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa0140c8290 0x7fa0141f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:44.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.729+0000 7fa00be00640 1 -- 172.21.15.78:0/1873190532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa01415cc30 msgr2=0x7fa01414f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:44.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.729+0000 7fa00be00640 1 --2- 172.21.15.78:0/1873190532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa01415cc30 0x7fa01414f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:44.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.729+0000 7fa00be00640 1 -- 172.21.15.78:0/1873190532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa014162250 con 0x7fa014153960 2024-05-21T14:43:44.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.729+0000 7fa00be00640 1 --2- 172.21.15.78:0/1873190532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa014153960 0x7fa0141598a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00d5d0 tx=0x7f9ffc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:44.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.729+0000 7fa00aa00640 1 -- 172.21.15.78:0/1873190532 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc004240 con 0x7fa014153960 2024-05-21T14:43:44.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.729+0000 7fa00aa00640 1 -- 172.21.15.78:0/1873190532 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ffc0043e0 con 0x7fa014153960 2024-05-21T14:43:44.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.729+0000 7fa00aa00640 1 -- 172.21.15.78:0/1873190532 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc003840 con 0x7fa014153960 2024-05-21T14:43:44.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.729+0000 7fa013e00640 1 -- 172.21.15.78:0/1873190532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa014156250 con 0x7fa014153960 2024-05-21T14:43:44.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.729+0000 7fa013e00640 1 -- 172.21.15.78:0/1873190532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa014156810 con 0x7fa014153960 2024-05-21T14:43:44.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.729+0000 7fa013e00640 1 -- 172.21.15.78:0/1873190532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa014069f30 con 0x7fa014153960 2024-05-21T14:43:44.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.729+0000 7fa00aa00640 1 -- 172.21.15.78:0/1873190532 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ffc0039e0 con 0x7fa014153960 2024-05-21T14:43:44.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.733+0000 7fa00aa00640 1 --2- 172.21.15.78:0/1873190532 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9ff00678f0 0x7f9ff0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:44.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.733+0000 7fa00aa00640 1 -- 172.21.15.78:0/1873190532 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9ffc085e40 con 0x7fa014153960 2024-05-21T14:43:44.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.733+0000 7fa012a00640 1 --2- 172.21.15.78:0/1873190532 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9ff00678f0 0x7f9ff0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:44.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.733+0000 7fa012a00640 1 --2- 172.21.15.78:0/1873190532 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9ff00678f0 0x7f9ff0069e00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa0040098e0 tx=0x7fa004009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:44.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.737+0000 7fa00aa00640 1 -- 172.21.15.78:0/1873190532 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f9ffc056290 con 0x7fa014153960 2024-05-21T14:43:44.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.929+0000 7fa013e00640 1 -- 172.21.15.78:0/1873190532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa01406c580 con 0x7fa014153960 2024-05-21T14:43:44.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.929+0000 7fa00aa00640 1 -- 172.21.15.78:0/1873190532 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9ffc05a590 con 0x7fa014153960 2024-05-21T14:43:44.936 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:44.936 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-21T14:43:44.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.929+0000 7fa013e00640 1 -- 172.21.15.78:0/1873190532 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9ff00678f0 msgr2=0x7f9ff0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:44.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.929+0000 7fa013e00640 1 --2- 172.21.15.78:0/1873190532 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9ff00678f0 0x7f9ff0069e00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa0040098e0 tx=0x7fa004009060 comp rx=0 tx=0).stop 2024-05-21T14:43:44.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.929+0000 7fa013e00640 1 -- 172.21.15.78:0/1873190532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa014153960 msgr2=0x7fa0141598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:44.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.929+0000 7fa013e00640 1 --2- 172.21.15.78:0/1873190532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa014153960 0x7fa0141598a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00d5d0 tx=0x7f9ffc00da90 comp rx=0 tx=0).stop 2024-05-21T14:43:44.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.929+0000 7fa013e00640 1 -- 172.21.15.78:0/1873190532 shutdown_connections 2024-05-21T14:43:44.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.929+0000 7fa013e00640 1 --2- 172.21.15.78:0/1873190532 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9ff00678f0 0x7f9ff0069e00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:44.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.929+0000 7fa013e00640 1 --2- 172.21.15.78:0/1873190532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa01415cc30 0x7fa01414f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:44.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.929+0000 7fa013e00640 1 --2- 172.21.15.78:0/1873190532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa014153960 0x7fa0141598a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:44.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.929+0000 7fa013e00640 1 --2- 172.21.15.78:0/1873190532 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa0140c8290 0x7fa0141f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:44.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.929+0000 7fa013e00640 1 -- 172.21.15.78:0/1873190532 >> 172.21.15.78:0/1873190532 conn(0x7fa01406e0a0 msgr2=0x7fa0140cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:44.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.929+0000 7fa013e00640 1 -- 172.21.15.78:0/1873190532 shutdown_connections 2024-05-21T14:43:44.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:44.929+0000 7fa013e00640 1 -- 172.21.15.78:0/1873190532 wait complete. 2024-05-21T14:43:44.958 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-21T14:43:44.958 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:43:45.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.097+0000 7f6dc6a00640 1 Processor -- start 2024-05-21T14:43:45.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.097+0000 7f6dc6a00640 1 -- start start 2024-05-21T14:43:45.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.101+0000 7f6dc6a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6dc01536f0 0x7f6dc015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:45.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.101+0000 7f6dc6a00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6dc00c76f0 0x7f6dc00c5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:45.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.101+0000 7f6dc6a00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dc00c4f60 con 0x7f6dc00c7b00 2024-05-21T14:43:45.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.101+0000 7f6dc6a00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f6dc006d270 con 0x7f6dc00c76f0 2024-05-21T14:43:45.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.101+0000 7f6dc6a00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f6dc00c5200 con 0x7f6dc01536f0 2024-05-21T14:43:45.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.101+0000 7f6dc4a00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6dc00c7b00 0x7f6dc0159520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38960/0 (socket says 172.21.15.78:38960) 2024-05-21T14:43:45.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.101+0000 7f6db7e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6dc00c76f0 0x7f6dc00c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:45.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.101+0000 7f6dc4a00640 1 -- 172.21.15.78:0/2240878182 learned_addr learned my addr 172.21.15.78:0/2240878182 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:45.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.101+0000 7f6dbfe00640 1 --2- 172.21.15.78:0/2240878182 >> v2:172.21.15.84:3300/0 conn(0x7f6dc01536f0 0x7f6dc015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:45.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.101+0000 7f6db7e00640 1 -- 172.21.15.78:0/2240878182 >> v2:172.21.15.84:3300/0 conn(0x7f6dc01536f0 msgr2=0x7f6dc015cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:45.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.101+0000 7f6db7e00640 1 --2- 172.21.15.78:0/2240878182 >> v2:172.21.15.84:3300/0 conn(0x7f6dc01536f0 0x7f6dc015cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.101+0000 7f6db7e00640 1 -- 172.21.15.78:0/2240878182 >> v1:172.21.15.78:6789/0 conn(0x7f6dc00c7b00 legacy=0x7f6dc0159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.101+0000 7f6db7e00640 1 -- 172.21.15.78:0/2240878182 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc00c54e0 con 0x7f6dc00c76f0 2024-05-21T14:43:45.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.101+0000 7f6dbf400640 1 -- 172.21.15.78:0/2240878182 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 479128070 0 0) 0x7f6dc00c4f60 con 0x7f6dc00c7b00 2024-05-21T14:43:45.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.105+0000 7f6db7e00640 1 --2- 172.21.15.78:0/2240878182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dc00c76f0 0x7f6dc00c5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00c9f70 tx=0x7f6da801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5157a8335ea2ffc server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:45.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.105+0000 7f6dbf400640 1 -- 172.21.15.78:0/2240878182 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da80b0070 con 0x7f6dc00c76f0 2024-05-21T14:43:45.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.105+0000 7f6dbf400640 1 -- 172.21.15.78:0/2240878182 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da80ab600 con 0x7f6dc00c76f0 2024-05-21T14:43:45.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.105+0000 7f6dbf400640 1 -- 172.21.15.78:0/2240878182 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da80ab9d0 con 0x7f6dc00c76f0 2024-05-21T14:43:45.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.105+0000 7f6dc6a00640 1 -- 172.21.15.78:0/2240878182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dc00c76f0 msgr2=0x7f6dc00c5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.105+0000 7f6dc6a00640 1 --2- 172.21.15.78:0/2240878182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dc00c76f0 0x7f6dc00c5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00c9f70 tx=0x7f6da801c480 comp rx=0 tx=0).stop 2024-05-21T14:43:45.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.105+0000 7f6dc6a00640 1 -- 172.21.15.78:0/2240878182 shutdown_connections 2024-05-21T14:43:45.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.105+0000 7f6dc6a00640 1 --2- 172.21.15.78:0/2240878182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dc00c76f0 0x7f6dc00c5780 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.105+0000 7f6dc6a00640 1 --2- 172.21.15.78:0/2240878182 >> v2:172.21.15.84:3300/0 conn(0x7f6dc01536f0 0x7f6dc015cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.105+0000 7f6dc6a00640 1 -- 172.21.15.78:0/2240878182 >> 172.21.15.78:0/2240878182 conn(0x7f6dc00cacb0 msgr2=0x7f6dc00cd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:45.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.105+0000 7f6dc6a00640 1 -- 172.21.15.78:0/2240878182 shutdown_connections 2024-05-21T14:43:45.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.105+0000 7f6dc6a00640 1 -- 172.21.15.78:0/2240878182 wait complete. 2024-05-21T14:43:45.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.105+0000 7f6dc6a00640 1 Processor -- start 2024-05-21T14:43:45.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6dc6a00640 1 -- start start 2024-05-21T14:43:45.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6dc6a00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dc00c76f0 0x7f6dc0159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:45.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6dc6a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dc00c7b00 0x7f6dc015c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:45.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6dc6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc01536f0 0x7f6dc0148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:45.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6dc6a00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc006d700 con 0x7f6dc00c7b00 2024-05-21T14:43:45.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6dc6a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc015d010 con 0x7f6dc01536f0 2024-05-21T14:43:45.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6dc6a00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc01580b0 con 0x7f6dc00c76f0 2024-05-21T14:43:45.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6db7e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dc00c7b00 0x7f6dc015c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:45.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6db7e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dc00c7b00 0x7f6dc015c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42476/0 (socket says 172.21.15.78:42476) 2024-05-21T14:43:45.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6db7e00640 1 -- 172.21.15.78:0/158208930 learned_addr learned my addr 172.21.15.78:0/158208930 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:45.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6dc4a00640 1 --2- 172.21.15.78:0/158208930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc01536f0 0x7f6dc0148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:45.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6dbfe00640 1 --2- 172.21.15.78:0/158208930 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dc00c76f0 0x7f6dc0159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:45.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6db7e00640 1 -- 172.21.15.78:0/158208930 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dc00c76f0 msgr2=0x7f6dc0159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6db7e00640 1 --2- 172.21.15.78:0/158208930 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dc00c76f0 0x7f6dc0159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6db7e00640 1 -- 172.21.15.78:0/158208930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc01536f0 msgr2=0x7f6dc0148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6db7e00640 1 --2- 172.21.15.78:0/158208930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc01536f0 0x7f6dc0148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6db7e00640 1 -- 172.21.15.78:0/158208930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc01f51b0 con 0x7f6dc00c7b00 2024-05-21T14:43:45.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6dc4a00640 1 --2- 172.21.15.78:0/158208930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc01536f0 0x7f6dc0148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:45.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6db7e00640 1 --2- 172.21.15.78:0/158208930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dc00c7b00 0x7f6dc015c8e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6da80ae040 tx=0x7f6da801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:45.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6dbcc00640 1 -- 172.21.15.78:0/158208930 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da80bc070 con 0x7f6dc00c7b00 2024-05-21T14:43:45.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6dbcc00640 1 -- 172.21.15.78:0/158208930 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da80b1040 con 0x7f6dc00c7b00 2024-05-21T14:43:45.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6dbcc00640 1 -- 172.21.15.78:0/158208930 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da80b0050 con 0x7f6dc00c7b00 2024-05-21T14:43:45.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6dc6a00640 1 -- 172.21.15.78:0/158208930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc015c600 con 0x7f6dc00c7b00 2024-05-21T14:43:45.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.109+0000 7f6dc6a00640 1 -- 172.21.15.78:0/158208930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc01f5750 con 0x7f6dc00c7b00 2024-05-21T14:43:45.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.113+0000 7f6dc6a00640 1 -- 172.21.15.78:0/158208930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc004f730 con 0x7f6dc00c7b00 2024-05-21T14:43:45.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.113+0000 7f6dbcc00640 1 -- 172.21.15.78:0/158208930 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6da8004230 con 0x7f6dc00c7b00 2024-05-21T14:43:45.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.113+0000 7f6dbcc00640 1 --2- 172.21.15.78:0/158208930 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f6d9c0678c0 0x7f6d9c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:45.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.113+0000 7f6dbcc00640 1 -- 172.21.15.78:0/158208930 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6da811f7c0 con 0x7f6dc00c7b00 2024-05-21T14:43:45.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.113+0000 7f6dbfe00640 1 --2- 172.21.15.78:0/158208930 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f6d9c0678c0 0x7f6d9c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:45.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.113+0000 7f6dbfe00640 1 --2- 172.21.15.78:0/158208930 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f6d9c0678c0 0x7f6d9c069dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009a50 tx=0x7f6db0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:45.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.121+0000 7f6dbcc00640 1 -- 172.21.15.78:0/158208930 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f6da8016070 con 0x7f6dc00c7b00 2024-05-21T14:43:45.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.277+0000 7f6dc6a00640 1 -- 172.21.15.78:0/158208930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6dc015c350 con 0x7f6dc00c7b00 2024-05-21T14:43:45.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.281+0000 7f6dbcc00640 1 -- 172.21.15.78:0/158208930 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16537 (secure 0 0 0) 0x7f6da80f01d0 con 0x7f6dc00c7b00 2024-05-21T14:43:45.289 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:45.289 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:20.573644+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T14:43:17.088549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T14:43:18.012571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:43:45.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.281+0000 7f6dc6a00640 1 -- 172.21.15.78:0/158208930 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f6d9c0678c0 msgr2=0x7f6d9c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.281+0000 7f6dc6a00640 1 --2- 172.21.15.78:0/158208930 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f6d9c0678c0 0x7f6d9c069dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009a50 tx=0x7f6db0008040 comp rx=0 tx=0).stop 2024-05-21T14:43:45.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.281+0000 7f6dc6a00640 1 -- 172.21.15.78:0/158208930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dc00c7b00 msgr2=0x7f6dc015c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.281+0000 7f6dc6a00640 1 --2- 172.21.15.78:0/158208930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dc00c7b00 0x7f6dc015c8e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6da80ae040 tx=0x7f6da801acc0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.281+0000 7f6dc6a00640 1 -- 172.21.15.78:0/158208930 shutdown_connections 2024-05-21T14:43:45.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.281+0000 7f6dc6a00640 1 --2- 172.21.15.78:0/158208930 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f6d9c0678c0 0x7f6d9c069dd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.281+0000 7f6dc6a00640 1 --2- 172.21.15.78:0/158208930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc01536f0 0x7f6dc0148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.281+0000 7f6dc6a00640 1 --2- 172.21.15.78:0/158208930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dc00c7b00 0x7f6dc015c8e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.281+0000 7f6dc6a00640 1 --2- 172.21.15.78:0/158208930 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dc00c76f0 0x7f6dc0159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.281+0000 7f6dc6a00640 1 -- 172.21.15.78:0/158208930 >> 172.21.15.78:0/158208930 conn(0x7f6dc00cacb0 msgr2=0x7f6dc014bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:45.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.281+0000 7f6dc6a00640 1 -- 172.21.15.78:0/158208930 shutdown_connections 2024-05-21T14:43:45.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.281+0000 7f6dc6a00640 1 -- 172.21.15.78:0/158208930 wait complete. 2024-05-21T14:43:45.311 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-21T14:43:06.569415+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-21T14:43:17.088549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-21T14:43:18.012571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-21T14:43:45.312 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-21T14:43:45.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.457+0000 7f2feb600640 1 Processor -- start 2024-05-21T14:43:45.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.457+0000 7f2feb600640 1 -- start start 2024-05-21T14:43:45.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.457+0000 7f2feb600640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2fe40ca000 0x7f2fe40caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:45.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.457+0000 7f2feb600640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe40c9ad0 con 0x7f2fe4070d70 2024-05-21T14:43:45.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.457+0000 7f2feb600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe40c4a60 con 0x7f2fe415c610 2024-05-21T14:43:45.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.457+0000 7f2feb600640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe40c4830 con 0x7f2fe40ca000 2024-05-21T14:43:45.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.457+0000 7f2fe3e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2fe40ca000 0x7f2fe40caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:45.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.457+0000 7f2fe9600640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2fe4070d70 0x7f2fe41662c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38970/0 (socket says 172.21.15.78:38970) 2024-05-21T14:43:45.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.457+0000 7f2fe9600640 1 -- 172.21.15.78:0/3127738 learned_addr learned my addr 172.21.15.78:0/3127738 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:45.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.457+0000 7f2fe3e00640 1 -- 172.21.15.78:0/3127738 >> v1:172.21.15.84:6789/0 conn(0x7f2fe415c610 legacy=0x7f2fe415f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.457+0000 7f2fe3e00640 1 -- 172.21.15.78:0/3127738 >> v1:172.21.15.78:6789/0 conn(0x7f2fe4070d70 legacy=0x7f2fe41662c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.457+0000 7f2fe3e00640 1 -- 172.21.15.78:0/3127738 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe40c4d40 con 0x7f2fe40ca000 2024-05-21T14:43:45.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.461+0000 7f2fe3e00640 1 --2- 172.21.15.78:0/3127738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fe40ca000 0x7f2fe40caf00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2fd00097c0 tx=0x7f2fd001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ab0a97e7e12c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:45.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.461+0000 7f2fe3400640 1 -- 172.21.15.78:0/3127738 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd00b1070 con 0x7f2fe40ca000 2024-05-21T14:43:45.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.461+0000 7f2fe3400640 1 -- 172.21.15.78:0/3127738 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd00ac410 con 0x7f2fe40ca000 2024-05-21T14:43:45.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.461+0000 7f2fe3400640 1 -- 172.21.15.78:0/3127738 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd00ac7e0 con 0x7f2fe40ca000 2024-05-21T14:43:45.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.461+0000 7f2feb600640 1 -- 172.21.15.78:0/3127738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fe40ca000 msgr2=0x7f2fe40caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.461+0000 7f2feb600640 1 --2- 172.21.15.78:0/3127738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fe40ca000 0x7f2fe40caf00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2fd00097c0 tx=0x7f2fd001c4a0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.461+0000 7f2feb600640 1 -- 172.21.15.78:0/3127738 shutdown_connections 2024-05-21T14:43:45.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.461+0000 7f2feb600640 1 --2- 172.21.15.78:0/3127738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fe40ca000 0x7f2fe40caf00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.461+0000 7f2feb600640 1 -- 172.21.15.78:0/3127738 >> 172.21.15.78:0/3127738 conn(0x7f2fe4074060 msgr2=0x7f2fe40cb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:45.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.461+0000 7f2feb600640 1 -- 172.21.15.78:0/3127738 shutdown_connections 2024-05-21T14:43:45.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.461+0000 7f2feb600640 1 -- 172.21.15.78:0/3127738 wait complete. 2024-05-21T14:43:45.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2feb600640 1 Processor -- start 2024-05-21T14:43:45.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2feb600640 1 -- start start 2024-05-21T14:43:45.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2feb600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fe4070d70 0x7f2fe41f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:45.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2feb600640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2fe40ca000 0x7f2fe4147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:45.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2feb600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fe415c610 0x7f2fe4145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:45.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2feb600640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe40ca410 con 0x7f2fe4070d70 2024-05-21T14:43:45.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2feb600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe415c0f0 con 0x7f2fe415c610 2024-05-21T14:43:45.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2feb600640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe4071590 con 0x7f2fe40ca000 2024-05-21T14:43:45.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2fe8c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fe4070d70 0x7f2fe41f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:45.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2fe8c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fe4070d70 0x7f2fe41f6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42502/0 (socket says 172.21.15.78:42502) 2024-05-21T14:43:45.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2fe8c00640 1 -- 172.21.15.78:0/1982510590 learned_addr learned my addr 172.21.15.78:0/1982510590 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:45.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2fe3e00640 1 --2- 172.21.15.78:0/1982510590 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2fe40ca000 0x7f2fe4147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:45.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2fe9600640 1 --2- 172.21.15.78:0/1982510590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fe415c610 0x7f2fe4145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:45.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2fe8c00640 1 -- 172.21.15.78:0/1982510590 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2fe40ca000 msgr2=0x7f2fe4147490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2fe8c00640 1 --2- 172.21.15.78:0/1982510590 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2fe40ca000 0x7f2fe4147490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2fe8c00640 1 -- 172.21.15.78:0/1982510590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fe415c610 msgr2=0x7f2fe4145150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2fe8c00640 1 --2- 172.21.15.78:0/1982510590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fe415c610 0x7f2fe4145150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.465+0000 7f2fe8c00640 1 -- 172.21.15.78:0/1982510590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe414ee20 con 0x7f2fe4070d70 2024-05-21T14:43:45.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.469+0000 7f2fe8c00640 1 --2- 172.21.15.78:0/1982510590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fe4070d70 0x7f2fe41f6180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800c3c0 tx=0x7f2fd800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:45.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.469+0000 7f2fe0c00640 1 -- 172.21.15.78:0/1982510590 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8017070 con 0x7f2fe4070d70 2024-05-21T14:43:45.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.469+0000 7f2fe0c00640 1 -- 172.21.15.78:0/1982510590 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd80052d0 con 0x7f2fe4070d70 2024-05-21T14:43:45.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.469+0000 7f2feb600640 1 -- 172.21.15.78:0/1982510590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe414f100 con 0x7f2fe4070d70 2024-05-21T14:43:45.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.469+0000 7f2fe0c00640 1 -- 172.21.15.78:0/1982510590 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8003840 con 0x7f2fe4070d70 2024-05-21T14:43:45.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.469+0000 7f2feb600640 1 -- 172.21.15.78:0/1982510590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe414f6c0 con 0x7f2fe4070d70 2024-05-21T14:43:45.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.469+0000 7f2feb600640 1 -- 172.21.15.78:0/1982510590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe404f730 con 0x7f2fe4070d70 2024-05-21T14:43:45.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.469+0000 7f2fe0c00640 1 -- 172.21.15.78:0/1982510590 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2fd801a070 con 0x7f2fe4070d70 2024-05-21T14:43:45.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.469+0000 7f2fe0c00640 1 --2- 172.21.15.78:0/1982510590 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2fc40678c0 0x7f2fc4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:45.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.469+0000 7f2fe0c00640 1 -- 172.21.15.78:0/1982510590 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2fd8085070 con 0x7f2fe4070d70 2024-05-21T14:43:45.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.469+0000 7f2fe3e00640 1 --2- 172.21.15.78:0/1982510590 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2fc40678c0 0x7f2fc4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:45.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.473+0000 7f2fe3e00640 1 --2- 172.21.15.78:0/1982510590 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2fc40678c0 0x7f2fc4069dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2fd00ae000 tx=0x7f2fd0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:45.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.473+0000 7f2fe0c00640 1 -- 172.21.15.78:0/1982510590 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f2fd8005480 con 0x7f2fe4070d70 2024-05-21T14:43:45.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.633+0000 7f2feb600640 1 -- 172.21.15.78:0/1982510590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2fe4072030 con 0x7f2fe4070d70 2024-05-21T14:43:45.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.633+0000 7f2fe0c00640 1 -- 172.21.15.78:0/1982510590 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f2fd8055b10 con 0x7f2fe4070d70 2024-05-21T14:43:45.641 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-05-21T14:43:45.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.633+0000 7f2feb600640 1 -- 172.21.15.78:0/1982510590 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2fc40678c0 msgr2=0x7f2fc4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.633+0000 7f2feb600640 1 --2- 172.21.15.78:0/1982510590 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2fc40678c0 0x7f2fc4069dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2fd00ae000 tx=0x7f2fd0008040 comp rx=0 tx=0).stop 2024-05-21T14:43:45.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.633+0000 7f2feb600640 1 -- 172.21.15.78:0/1982510590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fe4070d70 msgr2=0x7f2fe41f6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.633+0000 7f2feb600640 1 --2- 172.21.15.78:0/1982510590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fe4070d70 0x7f2fe41f6180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800c3c0 tx=0x7f2fd800c880 comp rx=0 tx=0).stop 2024-05-21T14:43:45.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.633+0000 7f2feb600640 1 -- 172.21.15.78:0/1982510590 shutdown_connections 2024-05-21T14:43:45.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.633+0000 7f2feb600640 1 --2- 172.21.15.78:0/1982510590 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2fc40678c0 0x7f2fc4069dd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.633+0000 7f2feb600640 1 --2- 172.21.15.78:0/1982510590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fe415c610 0x7f2fe4145150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.633+0000 7f2feb600640 1 --2- 172.21.15.78:0/1982510590 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2fe40ca000 0x7f2fe4147490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.633+0000 7f2feb600640 1 --2- 172.21.15.78:0/1982510590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fe4070d70 0x7f2fe41f6180 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.633+0000 7f2feb600640 1 -- 172.21.15.78:0/1982510590 >> 172.21.15.78:0/1982510590 conn(0x7f2fe4074060 msgr2=0x7f2fe415de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:45.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.633+0000 7f2feb600640 1 -- 172.21.15.78:0/1982510590 shutdown_connections 2024-05-21T14:43:45.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.633+0000 7f2feb600640 1 -- 172.21.15.78:0/1982510590 wait complete. 2024-05-21T14:43:45.663 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-21T14:43:45.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.805+0000 7f8e3cc00640 1 Processor -- start 2024-05-21T14:43:45.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.805+0000 7f8e3cc00640 1 -- start start 2024-05-21T14:43:45.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.809+0000 7f8e3cc00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e38153820 0x7f8e380c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:45.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.809+0000 7f8e3cc00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8e38161f70 0x7f8e38164390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:45.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.809+0000 7f8e3cc00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e3815a3c0 con 0x7f8e380c74e0 2024-05-21T14:43:45.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.809+0000 7f8e3cc00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f8e380c9430 con 0x7f8e38161f70 2024-05-21T14:43:45.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.809+0000 7f8e3cc00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8e380c9680 con 0x7f8e38153820 2024-05-21T14:43:45.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.809+0000 7f8e2fe00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8e380c74e0 0x7f8e380c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38974/0 (socket says 172.21.15.78:38974) 2024-05-21T14:43:45.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.809+0000 7f8e2fe00640 1 -- 172.21.15.78:0/3313330573 learned_addr learned my addr 172.21.15.78:0/3313330573 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:45.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.809+0000 7f8e37e00640 1 --2- 172.21.15.78:0/3313330573 >> v2:172.21.15.78:3300/0 conn(0x7f8e38161f70 0x7f8e38164390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:45.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.809+0000 7f8e37400640 1 --2- 172.21.15.78:0/3313330573 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e38153820 0x7f8e380c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:45.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.809+0000 7f8e36a00640 1 -- 172.21.15.78:0/3313330573 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1200410497 0 0) 0x7f8e3815a3c0 con 0x7f8e380c74e0 2024-05-21T14:43:45.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.809+0000 7f8e36a00640 1 -- 172.21.15.78:0/3313330573 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e1c003530 con 0x7f8e380c74e0 2024-05-21T14:43:45.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.809+0000 7f8e37e00640 1 -- 172.21.15.78:0/3313330573 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e38153820 msgr2=0x7f8e380c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:45.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.809+0000 7f8e37e00640 1 --2- 172.21.15.78:0/3313330573 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e38153820 0x7f8e380c6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.809+0000 7f8e37e00640 1 -- 172.21.15.78:0/3313330573 >> v1:172.21.15.78:6789/0 conn(0x7f8e380c74e0 legacy=0x7f8e380c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.809+0000 7f8e37e00640 1 -- 172.21.15.78:0/3313330573 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3806d200 con 0x7f8e38161f70 2024-05-21T14:43:45.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.813+0000 7f8e37e00640 1 --2- 172.21.15.78:0/3313330573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e38161f70 0x7f8e38164390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8e30009d90 tx=0x7f8e3001c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a418bf1518f1b095 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:45.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.813+0000 7f8e36a00640 1 -- 172.21.15.78:0/3313330573 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e300b2070 con 0x7f8e38161f70 2024-05-21T14:43:45.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.813+0000 7f8e36a00640 1 -- 172.21.15.78:0/3313330573 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e300a5920 con 0x7f8e38161f70 2024-05-21T14:43:45.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.813+0000 7f8e36a00640 1 -- 172.21.15.78:0/3313330573 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e300a5cf0 con 0x7f8e38161f70 2024-05-21T14:43:45.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.813+0000 7f8e3cc00640 1 -- 172.21.15.78:0/3313330573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e38161f70 msgr2=0x7f8e38164390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.813+0000 7f8e3cc00640 1 --2- 172.21.15.78:0/3313330573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e38161f70 0x7f8e38164390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8e30009d90 tx=0x7f8e3001c990 comp rx=0 tx=0).stop 2024-05-21T14:43:45.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.813+0000 7f8e3cc00640 1 -- 172.21.15.78:0/3313330573 shutdown_connections 2024-05-21T14:43:45.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.813+0000 7f8e3cc00640 1 --2- 172.21.15.78:0/3313330573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e38161f70 0x7f8e38164390 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.813+0000 7f8e3cc00640 1 --2- 172.21.15.78:0/3313330573 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e38153820 0x7f8e380c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.813+0000 7f8e3cc00640 1 -- 172.21.15.78:0/3313330573 >> 172.21.15.78:0/3313330573 conn(0x7f8e380ca390 msgr2=0x7f8e380ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:45.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.813+0000 7f8e3cc00640 1 -- 172.21.15.78:0/3313330573 shutdown_connections 2024-05-21T14:43:45.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.813+0000 7f8e3cc00640 1 -- 172.21.15.78:0/3313330573 wait complete. 2024-05-21T14:43:45.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e3cc00640 1 Processor -- start 2024-05-21T14:43:45.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e3cc00640 1 -- start start 2024-05-21T14:43:45.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e3cc00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e380c74e0 0x7f8e381575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:45.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e3cc00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e38153820 0x7f8e38147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:45.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e3cc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e38161f70 0x7f8e381478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:45.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e3cc00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8e380c9c80 con 0x7f8e38153820 2024-05-21T14:43:45.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e3cc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8e380c9960 con 0x7f8e38161f70 2024-05-21T14:43:45.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e3cc00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8e38153c30 con 0x7f8e380c74e0 2024-05-21T14:43:45.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e2fe00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e38153820 0x7f8e38147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:45.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e2fe00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e38153820 0x7f8e38147370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42526/0 (socket says 172.21.15.78:42526) 2024-05-21T14:43:45.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e2fe00640 1 -- 172.21.15.78:0/1801009747 learned_addr learned my addr 172.21.15.78:0/1801009747 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:45.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e37e00640 1 --2- 172.21.15.78:0/1801009747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e38161f70 0x7f8e381478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:45.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e37400640 1 --2- 172.21.15.78:0/1801009747 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e380c74e0 0x7f8e381575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:45.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e2fe00640 1 -- 172.21.15.78:0/1801009747 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e380c74e0 msgr2=0x7f8e381575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e2fe00640 1 --2- 172.21.15.78:0/1801009747 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e380c74e0 0x7f8e381575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e2fe00640 1 -- 172.21.15.78:0/1801009747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e38161f70 msgr2=0x7f8e381478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e2fe00640 1 --2- 172.21.15.78:0/1801009747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e38161f70 0x7f8e381478b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e2fe00640 1 -- 172.21.15.78:0/1801009747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e381642c0 con 0x7f8e38153820 2024-05-21T14:43:45.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e2fe00640 1 --2- 172.21.15.78:0/1801009747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e38153820 0x7f8e38147370 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8e380ca360 tx=0x7f8e20001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:45.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e2f400640 1 -- 172.21.15.78:0/1801009747 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20017070 con 0x7f8e38153820 2024-05-21T14:43:45.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e2f400640 1 -- 172.21.15.78:0/1801009747 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e20005cf0 con 0x7f8e38153820 2024-05-21T14:43:45.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e3cc00640 1 -- 172.21.15.78:0/1801009747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e38148260 con 0x7f8e38153820 2024-05-21T14:43:45.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e2f400640 1 -- 172.21.15.78:0/1801009747 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e200072f0 con 0x7f8e38153820 2024-05-21T14:43:45.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.817+0000 7f8e3cc00640 1 -- 172.21.15.78:0/1801009747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e381634f0 con 0x7f8e38153820 2024-05-21T14:43:45.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.821+0000 7f8e3cc00640 1 -- 172.21.15.78:0/1801009747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e3804f730 con 0x7f8e38153820 2024-05-21T14:43:45.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.821+0000 7f8e2f400640 1 -- 172.21.15.78:0/1801009747 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8e2001a070 con 0x7f8e38153820 2024-05-21T14:43:45.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.821+0000 7f8e2f400640 1 --2- 172.21.15.78:0/1801009747 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f8e140678c0 0x7f8e14069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:45.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.821+0000 7f8e2f400640 1 -- 172.21.15.78:0/1801009747 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8e20084fd0 con 0x7f8e38153820 2024-05-21T14:43:45.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.821+0000 7f8e37400640 1 --2- 172.21.15.78:0/1801009747 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f8e140678c0 0x7f8e14069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:45.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.825+0000 7f8e37400640 1 --2- 172.21.15.78:0/1801009747 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f8e140678c0 0x7f8e14069dd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009ac0 tx=0x7f8e28009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:45.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.825+0000 7f8e2f400640 1 -- 172.21.15.78:0/1801009747 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f8e20055390 con 0x7f8e38153820 2024-05-21T14:43:45.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.981+0000 7f8e3cc00640 1 -- 172.21.15.78:0/1801009747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8e380c9f90 con 0x7f8e38153820 2024-05-21T14:43:45.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.985+0000 7f8e2f400640 1 -- 172.21.15.78:0/1801009747 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f8e20059690 con 0x7f8e38153820 2024-05-21T14:43:45.992 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-05-21T14:43:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.985+0000 7f8e3cc00640 1 -- 172.21.15.78:0/1801009747 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f8e140678c0 msgr2=0x7f8e14069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.985+0000 7f8e3cc00640 1 --2- 172.21.15.78:0/1801009747 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f8e140678c0 0x7f8e14069dd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009ac0 tx=0x7f8e28009190 comp rx=0 tx=0).stop 2024-05-21T14:43:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.985+0000 7f8e3cc00640 1 -- 172.21.15.78:0/1801009747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e38153820 msgr2=0x7f8e38147370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.985+0000 7f8e3cc00640 1 --2- 172.21.15.78:0/1801009747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e38153820 0x7f8e38147370 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8e380ca360 tx=0x7f8e20001e80 comp rx=0 tx=0).stop 2024-05-21T14:43:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.985+0000 7f8e3cc00640 1 -- 172.21.15.78:0/1801009747 shutdown_connections 2024-05-21T14:43:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.985+0000 7f8e3cc00640 1 --2- 172.21.15.78:0/1801009747 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f8e140678c0 0x7f8e14069dd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.985+0000 7f8e3cc00640 1 --2- 172.21.15.78:0/1801009747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e38161f70 0x7f8e381478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.985+0000 7f8e3cc00640 1 --2- 172.21.15.78:0/1801009747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e38153820 0x7f8e38147370 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.985+0000 7f8e3cc00640 1 --2- 172.21.15.78:0/1801009747 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e380c74e0 0x7f8e381575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.985+0000 7f8e3cc00640 1 -- 172.21.15.78:0/1801009747 >> 172.21.15.78:0/1801009747 conn(0x7f8e380ca390 msgr2=0x7f8e3806fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:45.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.985+0000 7f8e3cc00640 1 -- 172.21.15.78:0/1801009747 shutdown_connections 2024-05-21T14:43:45.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:45.985+0000 7f8e3cc00640 1 -- 172.21.15.78:0/1801009747 wait complete. 2024-05-21T14:43:46.013 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-21T14:43:46.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.153+0000 7f2c87000640 1 Processor -- start 2024-05-21T14:43:46.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.153+0000 7f2c87000640 1 -- start start 2024-05-21T14:43:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.157+0000 7f2c87000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2c800c8290 0x7f2c8015c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.157+0000 7f2c87000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2c80155b00 0x7f2c8015edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.157+0000 7f2c87000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2c80072380 0x7f2c80072790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.157+0000 7f2c87000640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f2c8015f2f0 con 0x7f2c80155b00 2024-05-21T14:43:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.157+0000 7f2c87000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f2c8015b840 con 0x7f2c800c8290 2024-05-21T14:43:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.157+0000 7f2c87000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8015f560 con 0x7f2c80072380 2024-05-21T14:43:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.157+0000 7f2c85200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2c80155b00 0x7f2c8015edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.157+0000 7f2c85200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2c80155b00 0x7f2c8015edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42532/0 (socket says 172.21.15.78:42532) 2024-05-21T14:43:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.157+0000 7f2c85200640 1 -- 172.21.15.78:0/2229421150 learned_addr learned my addr 172.21.15.78:0/2229421150 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:46.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.157+0000 7f2c85c00640 1 --2- 172.21.15.78:0/2229421150 >> v2:172.21.15.84:3300/0 conn(0x7f2c800c8290 0x7f2c8015c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.157+0000 7f2c86600640 1 --2- 172.21.15.78:0/2229421150 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2c80072380 0x7f2c80072790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.157+0000 7f2c85200640 1 -- 172.21.15.78:0/2229421150 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2c80072380 msgr2=0x7f2c80072790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:46.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.157+0000 7f2c85200640 1 --2- 172.21.15.78:0/2229421150 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2c80072380 0x7f2c80072790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.157+0000 7f2c85200640 1 -- 172.21.15.78:0/2229421150 >> v2:172.21.15.84:3300/0 conn(0x7f2c800c8290 msgr2=0x7f2c8015c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:46.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.157+0000 7f2c85200640 1 --2- 172.21.15.78:0/2229421150 >> v2:172.21.15.84:3300/0 conn(0x7f2c800c8290 0x7f2c8015c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.157+0000 7f2c85200640 1 -- 172.21.15.78:0/2229421150 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8015f840 con 0x7f2c80155b00 2024-05-21T14:43:46.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.157+0000 7f2c85c00640 1 --2- 172.21.15.78:0/2229421150 >> v2:172.21.15.84:3300/0 conn(0x7f2c800c8290 0x7f2c8015c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:46.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.161+0000 7f2c85200640 1 --2- 172.21.15.78:0/2229421150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c80155b00 0x7f2c8015edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2c80071b50 tx=0x7f2c6c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ac1d8e96e33e3b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:46.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.161+0000 7f2c7fe00640 1 -- 172.21.15.78:0/2229421150 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0b0070 con 0x7f2c80155b00 2024-05-21T14:43:46.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.161+0000 7f2c7fe00640 1 -- 172.21.15.78:0/2229421150 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c6c0ab600 con 0x7f2c80155b00 2024-05-21T14:43:46.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.161+0000 7f2c7fe00640 1 -- 172.21.15.78:0/2229421150 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0ab9d0 con 0x7f2c80155b00 2024-05-21T14:43:46.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.161+0000 7f2c87000640 1 -- 172.21.15.78:0/2229421150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c80155b00 msgr2=0x7f2c8015edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:46.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.161+0000 7f2c87000640 1 --2- 172.21.15.78:0/2229421150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c80155b00 0x7f2c8015edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2c80071b50 tx=0x7f2c6c01c490 comp rx=0 tx=0).stop 2024-05-21T14:43:46.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.161+0000 7f2c87000640 1 -- 172.21.15.78:0/2229421150 shutdown_connections 2024-05-21T14:43:46.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.161+0000 7f2c87000640 1 --2- 172.21.15.78:0/2229421150 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2c80072380 0x7f2c80072790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.161+0000 7f2c87000640 1 --2- 172.21.15.78:0/2229421150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c80155b00 0x7f2c8015edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.161+0000 7f2c87000640 1 --2- 172.21.15.78:0/2229421150 >> v2:172.21.15.84:3300/0 conn(0x7f2c800c8290 0x7f2c8015c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.161+0000 7f2c87000640 1 -- 172.21.15.78:0/2229421150 >> 172.21.15.78:0/2229421150 conn(0x7f2c800ca390 msgr2=0x7f2c800ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:46.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.161+0000 7f2c87000640 1 -- 172.21.15.78:0/2229421150 shutdown_connections 2024-05-21T14:43:46.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.161+0000 7f2c87000640 1 -- 172.21.15.78:0/2229421150 wait complete. 2024-05-21T14:43:46.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.161+0000 7f2c87000640 1 Processor -- start 2024-05-21T14:43:46.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c87000640 1 -- start start 2024-05-21T14:43:46.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c87000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2c80072380 0x7f2c801f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c87000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c800c8290 0x7f2c801545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c87000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c80155b00 0x7f2c80154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c87000640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2c800caeb0 con 0x7f2c80155b00 2024-05-21T14:43:46.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c87000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2c80155f10 con 0x7f2c800c8290 2024-05-21T14:43:46.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c87000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f2c800cb030 con 0x7f2c80072380 2024-05-21T14:43:46.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c86600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c80155b00 0x7f2c80154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c86600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c80155b00 0x7f2c80154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42548/0 (socket says 172.21.15.78:42548) 2024-05-21T14:43:46.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c86600640 1 -- 172.21.15.78:0/1810244661 learned_addr learned my addr 172.21.15.78:0/1810244661 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:46.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c85c00640 1 --2- 172.21.15.78:0/1810244661 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2c80072380 0x7f2c801f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c85200640 1 --2- 172.21.15.78:0/1810244661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c800c8290 0x7f2c801545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c86600640 1 -- 172.21.15.78:0/1810244661 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2c80072380 msgr2=0x7f2c801f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:46.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c86600640 1 --2- 172.21.15.78:0/1810244661 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2c80072380 0x7f2c801f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c86600640 1 -- 172.21.15.78:0/1810244661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c800c8290 msgr2=0x7f2c801545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:46.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c86600640 1 --2- 172.21.15.78:0/1810244661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c800c8290 0x7f2c801545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c86600640 1 -- 172.21.15.78:0/1810244661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c801f5120 con 0x7f2c80155b00 2024-05-21T14:43:46.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c86600640 1 --2- 172.21.15.78:0/1810244661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c80155b00 0x7f2c80154b20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2c78007d40 tx=0x7f2c7800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:46.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c7d600640 1 -- 172.21.15.78:0/1810244661 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78014420 con 0x7f2c80155b00 2024-05-21T14:43:46.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c7d600640 1 -- 172.21.15.78:0/1810244661 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c78019070 con 0x7f2c80155b00 2024-05-21T14:43:46.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c87000640 1 -- 172.21.15.78:0/1810244661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c800c7080 con 0x7f2c80155b00 2024-05-21T14:43:46.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c7d600640 1 -- 172.21.15.78:0/1810244661 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78014800 con 0x7f2c80155b00 2024-05-21T14:43:46.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c87000640 1 -- 172.21.15.78:0/1810244661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c800c5d80 con 0x7f2c80155b00 2024-05-21T14:43:46.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.165+0000 7f2c87000640 1 -- 172.21.15.78:0/1810244661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c8004f730 con 0x7f2c80155b00 2024-05-21T14:43:46.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.169+0000 7f2c7d600640 1 -- 172.21.15.78:0/1810244661 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2c780149a0 con 0x7f2c80155b00 2024-05-21T14:43:46.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.169+0000 7f2c7d600640 1 --2- 172.21.15.78:0/1810244661 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2c600678f0 0x7f2c60069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.169+0000 7f2c7d600640 1 -- 172.21.15.78:0/1810244661 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2c78086d00 con 0x7f2c80155b00 2024-05-21T14:43:46.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.169+0000 7f2c85c00640 1 --2- 172.21.15.78:0/1810244661 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2c600678f0 0x7f2c60069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.173+0000 7f2c85c00640 1 --2- 172.21.15.78:0/1810244661 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2c600678f0 0x7f2c60069e00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2c740045f0 tx=0x7f2c74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:46.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.173+0000 7f2c7d600640 1 -- 172.21.15.78:0/1810244661 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f2c78057210 con 0x7f2c80155b00 2024-05-21T14:43:46.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.329+0000 7f2c87000640 1 -- 172.21.15.78:0/1810244661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2c80072f50 con 0x7f2c80155b00 2024-05-21T14:43:46.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.329+0000 7f2c7d600640 1 -- 172.21.15.78:0/1810244661 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f2c7805b510 con 0x7f2c80155b00 2024-05-21T14:43:46.338 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-05-21T14:43:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.333+0000 7f2c87000640 1 -- 172.21.15.78:0/1810244661 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2c600678f0 msgr2=0x7f2c60069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.333+0000 7f2c87000640 1 --2- 172.21.15.78:0/1810244661 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2c600678f0 0x7f2c60069e00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2c740045f0 tx=0x7f2c74008040 comp rx=0 tx=0).stop 2024-05-21T14:43:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.333+0000 7f2c87000640 1 -- 172.21.15.78:0/1810244661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c80155b00 msgr2=0x7f2c80154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.333+0000 7f2c87000640 1 --2- 172.21.15.78:0/1810244661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c80155b00 0x7f2c80154b20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2c78007d40 tx=0x7f2c7800e4b0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.333+0000 7f2c87000640 1 -- 172.21.15.78:0/1810244661 shutdown_connections 2024-05-21T14:43:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.333+0000 7f2c87000640 1 --2- 172.21.15.78:0/1810244661 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2c600678f0 0x7f2c60069e00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.333+0000 7f2c87000640 1 --2- 172.21.15.78:0/1810244661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c80155b00 0x7f2c80154b20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.333+0000 7f2c87000640 1 --2- 172.21.15.78:0/1810244661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c800c8290 0x7f2c801545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.333+0000 7f2c87000640 1 --2- 172.21.15.78:0/1810244661 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2c80072380 0x7f2c801f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.333+0000 7f2c87000640 1 -- 172.21.15.78:0/1810244661 >> 172.21.15.78:0/1810244661 conn(0x7f2c800ca390 msgr2=0x7f2c8014f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.333+0000 7f2c87000640 1 -- 172.21.15.78:0/1810244661 shutdown_connections 2024-05-21T14:43:46.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.333+0000 7f2c87000640 1 -- 172.21.15.78:0/1810244661 wait complete. 2024-05-21T14:43:46.360 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T14:43:46.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.501+0000 7f9cc4c00640 1 Processor -- start 2024-05-21T14:43:46.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.501+0000 7f9cc4c00640 1 -- start start 2024-05-21T14:43:46.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.501+0000 7f9cc4c00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9cc015ca80 0x7f9cc0159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.501+0000 7f9cc4c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9cc00ca7b0 0x7f9cc00732c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.501+0000 7f9cc4c00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cc015a430 con 0x7f9cc0073800 2024-05-21T14:43:46.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.501+0000 7f9cc4c00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f9cc0074520 con 0x7f9cc015ca80 2024-05-21T14:43:46.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.501+0000 7f9cc4c00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f9cc0074260 con 0x7f9cc00ca7b0 2024-05-21T14:43:46.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.501+0000 7f9cbfe00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9cc0073800 0x7f9cc00709f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38976/0 (socket says 172.21.15.78:38976) 2024-05-21T14:43:46.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.501+0000 7f9cbfe00640 1 -- 172.21.15.78:0/3648101144 learned_addr learned my addr 172.21.15.78:0/3648101144 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:46.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.501+0000 7f9cbf400640 1 --2- 172.21.15.78:0/3648101144 >> v2:172.21.15.78:3300/0 conn(0x7f9cc015ca80 0x7f9cc0159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.501+0000 7f9cb7e00640 1 --2- 172.21.15.78:0/3648101144 >> v2:172.21.15.84:3300/0 conn(0x7f9cc00ca7b0 0x7f9cc00732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.501+0000 7f9cbea00640 1 -- 172.21.15.78:0/3648101144 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1075855404 0 0) 0x7f9cb80014a0 con 0x7f9cc0073800 2024-05-21T14:43:46.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.501+0000 7f9cbea00640 1 -- 172.21.15.78:0/3648101144 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ca4003530 con 0x7f9cc0073800 2024-05-21T14:43:46.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.501+0000 7f9cbf400640 1 -- 172.21.15.78:0/3648101144 >> v2:172.21.15.84:3300/0 conn(0x7f9cc00ca7b0 msgr2=0x7f9cc00732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:46.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.501+0000 7f9cbf400640 1 --2- 172.21.15.78:0/3648101144 >> v2:172.21.15.84:3300/0 conn(0x7f9cc00ca7b0 0x7f9cc00732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.501+0000 7f9cbf400640 1 -- 172.21.15.78:0/3648101144 >> v1:172.21.15.78:6789/0 conn(0x7f9cc0073800 legacy=0x7f9cc00709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:46.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.501+0000 7f9cbf400640 1 -- 172.21.15.78:0/3648101144 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc00caea0 con 0x7f9cc015ca80 2024-05-21T14:43:46.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.505+0000 7f9cbf400640 1 --2- 172.21.15.78:0/3648101144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cc015ca80 0x7f9cc0159ef0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0070590 tx=0x7f9cb001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8256abf0870c1642 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:46.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.505+0000 7f9cbea00640 1 -- 172.21.15.78:0/3648101144 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00b0070 con 0x7f9cc015ca80 2024-05-21T14:43:46.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.505+0000 7f9cbea00640 1 -- 172.21.15.78:0/3648101144 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb00ab600 con 0x7f9cc015ca80 2024-05-21T14:43:46.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.505+0000 7f9cbea00640 1 -- 172.21.15.78:0/3648101144 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00ab9b0 con 0x7f9cc015ca80 2024-05-21T14:43:46.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.509+0000 7f9cc4c00640 1 -- 172.21.15.78:0/3648101144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cc015ca80 msgr2=0x7f9cc0159ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:46.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.509+0000 7f9cc4c00640 1 --2- 172.21.15.78:0/3648101144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cc015ca80 0x7f9cc0159ef0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0070590 tx=0x7f9cb001c3f0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.509+0000 7f9cc4c00640 1 -- 172.21.15.78:0/3648101144 shutdown_connections 2024-05-21T14:43:46.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.509+0000 7f9cc4c00640 1 --2- 172.21.15.78:0/3648101144 >> v2:172.21.15.84:3300/0 conn(0x7f9cc00ca7b0 0x7f9cc00732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.509+0000 7f9cc4c00640 1 --2- 172.21.15.78:0/3648101144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cc015ca80 0x7f9cc0159ef0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.509+0000 7f9cc4c00640 1 -- 172.21.15.78:0/3648101144 >> 172.21.15.78:0/3648101144 conn(0x7f9cc00ce870 msgr2=0x7f9cc00cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:46.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.509+0000 7f9cc4c00640 1 -- 172.21.15.78:0/3648101144 shutdown_connections 2024-05-21T14:43:46.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.509+0000 7f9cc4c00640 1 -- 172.21.15.78:0/3648101144 wait complete. 2024-05-21T14:43:46.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.509+0000 7f9cc4c00640 1 Processor -- start 2024-05-21T14:43:46.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.509+0000 7f9cc4c00640 1 -- start start 2024-05-21T14:43:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.509+0000 7f9cc4c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9cc0073800 0x7f9cc0148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.509+0000 7f9cc4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc00ca7b0 0x7f9cc014c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.509+0000 7f9cc4c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cc015ca80 0x7f9cc01f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.509+0000 7f9cc4c00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc00ca310 con 0x7f9cc015ca80 2024-05-21T14:43:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.509+0000 7f9cc4c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc00ca190 con 0x7f9cc00ca7b0 2024-05-21T14:43:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.509+0000 7f9cc4c00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f9cc00c91f0 con 0x7f9cc0073800 2024-05-21T14:43:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cbfe00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cc015ca80 0x7f9cc01f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cbfe00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cc015ca80 0x7f9cc01f61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42576/0 (socket says 172.21.15.78:42576) 2024-05-21T14:43:46.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cbfe00640 1 -- 172.21.15.78:0/2625307678 learned_addr learned my addr 172.21.15.78:0/2625307678 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:46.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cbf400640 1 --2- 172.21.15.78:0/2625307678 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9cc0073800 0x7f9cc0148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cb7e00640 1 --2- 172.21.15.78:0/2625307678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc00ca7b0 0x7f9cc014c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cbfe00640 1 -- 172.21.15.78:0/2625307678 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9cc0073800 msgr2=0x7f9cc0148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cbfe00640 1 --2- 172.21.15.78:0/2625307678 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9cc0073800 0x7f9cc0148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cbfe00640 1 -- 172.21.15.78:0/2625307678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc00ca7b0 msgr2=0x7f9cc014c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cbfe00640 1 --2- 172.21.15.78:0/2625307678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc00ca7b0 0x7f9cc014c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cbfe00640 1 -- 172.21.15.78:0/2625307678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc01490f0 con 0x7f9cc015ca80 2024-05-21T14:43:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cbfe00640 1 --2- 172.21.15.78:0/2625307678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cc015ca80 0x7f9cc01f61e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800cad0 tx=0x7f9cb800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cb7400640 1 -- 172.21.15.78:0/2625307678 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8017070 con 0x7f9cc015ca80 2024-05-21T14:43:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cb7400640 1 -- 172.21.15.78:0/2625307678 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb800ac30 con 0x7f9cc015ca80 2024-05-21T14:43:46.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cb7400640 1 -- 172.21.15.78:0/2625307678 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8012400 con 0x7f9cc015ca80 2024-05-21T14:43:46.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cc4c00640 1 -- 172.21.15.78:0/2625307678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc01487f0 con 0x7f9cc015ca80 2024-05-21T14:43:46.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cc4c00640 1 -- 172.21.15.78:0/2625307678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc015aa20 con 0x7f9cc015ca80 2024-05-21T14:43:46.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cc4c00640 1 -- 172.21.15.78:0/2625307678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cc013e140 con 0x7f9cc015ca80 2024-05-21T14:43:46.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.513+0000 7f9cb7400640 1 -- 172.21.15.78:0/2625307678 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9cb801a070 con 0x7f9cc015ca80 2024-05-21T14:43:46.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.517+0000 7f9cb7400640 1 --2- 172.21.15.78:0/2625307678 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9c9c0678f0 0x7f9c9c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.517+0000 7f9cb7400640 1 -- 172.21.15.78:0/2625307678 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9cb80858b0 con 0x7f9cc015ca80 2024-05-21T14:43:46.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.517+0000 7f9cbf400640 1 --2- 172.21.15.78:0/2625307678 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9c9c0678f0 0x7f9c9c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.517+0000 7f9cbf400640 1 --2- 172.21.15.78:0/2625307678 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9c9c0678f0 0x7f9c9c069e00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00ad000 tx=0x7f9cb00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:46.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.521+0000 7f9cb7400640 1 -- 172.21.15.78:0/2625307678 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f9cc013e140 con 0x7f9cc015ca80 2024-05-21T14:43:46.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.705+0000 7f9cc4c00640 1 -- 172.21.15.78:0/2625307678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cc0069f30 con 0x7f9cc015ca80 2024-05-21T14:43:46.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.709+0000 7f9cb7400640 1 -- 172.21.15.78:0/2625307678 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6902 (secure 0 0 0) 0x7f9cc015a430 con 0x7f9cc015ca80 2024-05-21T14:43:46.716 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:46.716 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1952345794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1952345794},{"type":"v1","addr":"172.21.15.78:6833","nonce":1952345794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T14:43:18.985546+0000","modified":"2024-05-21T14:43:42.748742+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4321,"mds_1":4300,"mds_2":4297,"mds_3":4294,"mds_4":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":4,"incarnation":15,"state":"up:creating","state_seq":1,"addr":"172.21.15.78:6836/3517628193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3517628193},{"type":"v1","addr":"172.21.15.78:6836","nonce":3517628193}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":9,"addr":"172.21.15.84:6835/3155872080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3155872080},{"type":"v1","addr":"172.21.15.84:6835","nonce":3155872080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6838/1750816366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1750816366},{"type":"v1","addr":"172.21.15.84:6838","nonce":1750816366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6839/4232079477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6837","nonce":4232079477},{"type":"v1","addr":"172.21.15.84:6839","nonce":4232079477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6837/1924967428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1924967428},{"type":"v1","addr":"172.21.15.78:6837","nonce":1924967428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4321,4300,4297,4294]},"id":1}]} 2024-05-21T14:43:46.717 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 15 2024-05-21T14:43:46.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.709+0000 7f9cc4c00640 1 -- 172.21.15.78:0/2625307678 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9c9c0678f0 msgr2=0x7f9c9c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:46.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.709+0000 7f9cc4c00640 1 --2- 172.21.15.78:0/2625307678 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9c9c0678f0 0x7f9c9c069e00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00ad000 tx=0x7f9cb00a6000 comp rx=0 tx=0).stop 2024-05-21T14:43:46.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.709+0000 7f9cc4c00640 1 -- 172.21.15.78:0/2625307678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cc015ca80 msgr2=0x7f9cc01f61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:46.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.709+0000 7f9cc4c00640 1 --2- 172.21.15.78:0/2625307678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cc015ca80 0x7f9cc01f61e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800cad0 tx=0x7f9cb800cf90 comp rx=0 tx=0).stop 2024-05-21T14:43:46.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.709+0000 7f9cc4c00640 1 -- 172.21.15.78:0/2625307678 shutdown_connections 2024-05-21T14:43:46.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.709+0000 7f9cc4c00640 1 --2- 172.21.15.78:0/2625307678 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9c9c0678f0 0x7f9c9c069e00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.709+0000 7f9cc4c00640 1 --2- 172.21.15.78:0/2625307678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cc015ca80 0x7f9cc01f61e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.709+0000 7f9cc4c00640 1 --2- 172.21.15.78:0/2625307678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc00ca7b0 0x7f9cc014c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.709+0000 7f9cc4c00640 1 --2- 172.21.15.78:0/2625307678 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9cc0073800 0x7f9cc0148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.709+0000 7f9cc4c00640 1 -- 172.21.15.78:0/2625307678 >> 172.21.15.78:0/2625307678 conn(0x7f9cc00ce870 msgr2=0x7f9cc0152fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:46.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.709+0000 7f9cc4c00640 1 -- 172.21.15.78:0/2625307678 shutdown_connections 2024-05-21T14:43:46.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.709+0000 7f9cc4c00640 1 -- 172.21.15.78:0/2625307678 wait complete. 2024-05-21T14:43:46.738 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:43:46.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.881+0000 7f1519400640 1 Processor -- start 2024-05-21T14:43:46.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.881+0000 7f1519400640 1 -- start start 2024-05-21T14:43:46.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.881+0000 7f1519400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1514153870 0x7f15140c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.881+0000 7f1519400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1514159ec0 0x7f151406f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.881+0000 7f1519400640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15140c9060 con 0x7f151406fca0 2024-05-21T14:43:46.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.881+0000 7f1519400640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f151415cef0 con 0x7f1514153870 2024-05-21T14:43:46.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.881+0000 7f1519400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f151415d140 con 0x7f1514159ec0 2024-05-21T14:43:46.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.881+0000 7f1513e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1514153870 0x7f15140c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.881+0000 7f1518a00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f151406fca0 0x7f15140c96e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38992/0 (socket says 172.21.15.78:38992) 2024-05-21T14:43:46.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.881+0000 7f1518a00640 1 -- 172.21.15.78:0/3737527674 learned_addr learned my addr 172.21.15.78:0/3737527674 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:46.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.881+0000 7f1513400640 1 --2- 172.21.15.78:0/3737527674 >> v2:172.21.15.84:3300/0 conn(0x7f1514159ec0 0x7f151406f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.881+0000 7f1513e00640 1 -- 172.21.15.78:0/3737527674 >> v2:172.21.15.84:3300/0 conn(0x7f1514159ec0 msgr2=0x7f151406f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:46.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.881+0000 7f1513e00640 1 --2- 172.21.15.78:0/3737527674 >> v2:172.21.15.84:3300/0 conn(0x7f1514159ec0 0x7f151406f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.881+0000 7f1513e00640 1 -- 172.21.15.78:0/3737527674 >> v1:172.21.15.78:6789/0 conn(0x7f151406fca0 legacy=0x7f15140c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:46.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.881+0000 7f1513e00640 1 -- 172.21.15.78:0/3737527674 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151415d9c0 con 0x7f1514153870 2024-05-21T14:43:46.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.881+0000 7f1512a00640 1 -- 172.21.15.78:0/3737527674 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1534411005 0 0) 0x7f15140c9060 con 0x7f151406fca0 2024-05-21T14:43:46.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.885+0000 7f1513e00640 1 --2- 172.21.15.78:0/3737527674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1514153870 0x7f15140c8b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f151406c580 tx=0x7f150401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbc950b64c94c1c server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:46.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.885+0000 7f1512a00640 1 -- 172.21.15.78:0/3737527674 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15040b5070 con 0x7f1514153870 2024-05-21T14:43:46.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.885+0000 7f1512a00640 1 -- 172.21.15.78:0/3737527674 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15040a8970 con 0x7f1514153870 2024-05-21T14:43:46.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.885+0000 7f1512a00640 1 -- 172.21.15.78:0/3737527674 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15040a8d40 con 0x7f1514153870 2024-05-21T14:43:46.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.885+0000 7f1519400640 1 -- 172.21.15.78:0/3737527674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1514153870 msgr2=0x7f15140c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:46.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.885+0000 7f1519400640 1 --2- 172.21.15.78:0/3737527674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1514153870 0x7f15140c8b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f151406c580 tx=0x7f150401ec70 comp rx=0 tx=0).stop 2024-05-21T14:43:46.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.885+0000 7f1519400640 1 -- 172.21.15.78:0/3737527674 shutdown_connections 2024-05-21T14:43:46.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.885+0000 7f1519400640 1 --2- 172.21.15.78:0/3737527674 >> v2:172.21.15.84:3300/0 conn(0x7f1514159ec0 0x7f151406f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.885+0000 7f1519400640 1 --2- 172.21.15.78:0/3737527674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1514153870 0x7f15140c8b20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.885+0000 7f1519400640 1 -- 172.21.15.78:0/3737527674 >> 172.21.15.78:0/3737527674 conn(0x7f151406b7f0 msgr2=0x7f151406bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:46.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.885+0000 7f1519400640 1 -- 172.21.15.78:0/3737527674 shutdown_connections 2024-05-21T14:43:46.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.885+0000 7f1519400640 1 -- 172.21.15.78:0/3737527674 wait complete. 2024-05-21T14:43:46.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1519400640 1 Processor -- start 2024-05-21T14:43:46.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1519400640 1 -- start start 2024-05-21T14:43:46.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1519400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f151406fca0 0x7f15140c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1519400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1514153870 0x7f15140c3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1519400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1514159ec0 0x7f151414d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1519400640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f15141596c0 con 0x7f1514159ec0 2024-05-21T14:43:46.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1519400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f151415d6e0 con 0x7f151406fca0 2024-05-21T14:43:46.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1519400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f15141599a0 con 0x7f1514153870 2024-05-21T14:43:46.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1518a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1514159ec0 0x7f151414d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1518a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1514159ec0 0x7f151414d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42604/0 (socket says 172.21.15.78:42604) 2024-05-21T14:43:46.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1518a00640 1 -- 172.21.15.78:0/4016028659 learned_addr learned my addr 172.21.15.78:0/4016028659 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:46.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1513400640 1 --2- 172.21.15.78:0/4016028659 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1514153870 0x7f15140c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1513e00640 1 --2- 172.21.15.78:0/4016028659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f151406fca0 0x7f15140c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1518a00640 1 -- 172.21.15.78:0/4016028659 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1514153870 msgr2=0x7f15140c3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:46.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1518a00640 1 --2- 172.21.15.78:0/4016028659 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1514153870 0x7f15140c3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1518a00640 1 -- 172.21.15.78:0/4016028659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f151406fca0 msgr2=0x7f15140c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:46.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1518a00640 1 --2- 172.21.15.78:0/4016028659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f151406fca0 0x7f15140c5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:46.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1518a00640 1 -- 172.21.15.78:0/4016028659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15140c5a80 con 0x7f1514159ec0 2024-05-21T14:43:46.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.889+0000 7f1518a00640 1 --2- 172.21.15.78:0/4016028659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1514159ec0 0x7f151414d160 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f150c00c700 tx=0x7f150c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:46.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.893+0000 7f150be00640 1 -- 172.21.15.78:0/4016028659 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c018070 con 0x7f1514159ec0 2024-05-21T14:43:46.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.893+0000 7f150be00640 1 -- 172.21.15.78:0/4016028659 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150c00ce10 con 0x7f1514159ec0 2024-05-21T14:43:46.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.893+0000 7f150be00640 1 -- 172.21.15.78:0/4016028659 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c00a880 con 0x7f1514159ec0 2024-05-21T14:43:46.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.893+0000 7f1519400640 1 -- 172.21.15.78:0/4016028659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15140b2fc0 con 0x7f1514159ec0 2024-05-21T14:43:46.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.893+0000 7f1519400640 1 -- 172.21.15.78:0/4016028659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15141f24b0 con 0x7f1514159ec0 2024-05-21T14:43:46.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.893+0000 7f1519400640 1 -- 172.21.15.78:0/4016028659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1514069f30 con 0x7f1514159ec0 2024-05-21T14:43:46.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.893+0000 7f150be00640 1 -- 172.21.15.78:0/4016028659 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f150c00aa20 con 0x7f1514159ec0 2024-05-21T14:43:46.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.893+0000 7f150be00640 1 --2- 172.21.15.78:0/4016028659 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f14f40678c0 0x7f14f4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:46.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.893+0000 7f150be00640 1 -- 172.21.15.78:0/4016028659 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f150c085220 con 0x7f1514159ec0 2024-05-21T14:43:46.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.893+0000 7f1513e00640 1 --2- 172.21.15.78:0/4016028659 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f14f40678c0 0x7f14f4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:46.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.897+0000 7f1513e00640 1 --2- 172.21.15.78:0/4016028659 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f14f40678c0 0x7f14f4069dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f15040b2000 tx=0x7f1504008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:46.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:46.897+0000 7f150be00640 1 -- 172.21.15.78:0/4016028659 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f150c055670 con 0x7f1514159ec0 2024-05-21T14:43:47.028 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:43:47.031 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:43:47.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.057+0000 7f1519400640 1 -- 172.21.15.78:0/4016028659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15141f1f60 con 0x7f1514159ec0 2024-05-21T14:43:47.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.061+0000 7f150be00640 1 -- 172.21.15.78:0/4016028659 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16537 (secure 0 0 0) 0x7f150c059970 con 0x7f1514159ec0 2024-05-21T14:43:47.068 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:47.068 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:20.573644+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T14:43:17.088549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T14:43:18.012571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:43:47.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.061+0000 7f1519400640 1 -- 172.21.15.78:0/4016028659 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f14f40678c0 msgr2=0x7f14f4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:47.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.061+0000 7f1519400640 1 --2- 172.21.15.78:0/4016028659 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f14f40678c0 0x7f14f4069dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f15040b2000 tx=0x7f1504008040 comp rx=0 tx=0).stop 2024-05-21T14:43:47.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.061+0000 7f1519400640 1 -- 172.21.15.78:0/4016028659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1514159ec0 msgr2=0x7f151414d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:47.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.061+0000 7f1519400640 1 --2- 172.21.15.78:0/4016028659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1514159ec0 0x7f151414d160 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f150c00c700 tx=0x7f150c00cbc0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.061+0000 7f1519400640 1 -- 172.21.15.78:0/4016028659 shutdown_connections 2024-05-21T14:43:47.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.061+0000 7f1519400640 1 --2- 172.21.15.78:0/4016028659 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f14f40678c0 0x7f14f4069dd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.061+0000 7f1519400640 1 --2- 172.21.15.78:0/4016028659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1514159ec0 0x7f151414d160 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.061+0000 7f1519400640 1 --2- 172.21.15.78:0/4016028659 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1514153870 0x7f15140c3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.061+0000 7f1519400640 1 --2- 172.21.15.78:0/4016028659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f151406fca0 0x7f15140c5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.061+0000 7f1519400640 1 -- 172.21.15.78:0/4016028659 >> 172.21.15.78:0/4016028659 conn(0x7f151406b7f0 msgr2=0x7f1514152dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:47.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.061+0000 7f1519400640 1 -- 172.21.15.78:0/4016028659 shutdown_connections 2024-05-21T14:43:47.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.061+0000 7f1519400640 1 -- 172.21.15.78:0/4016028659 wait complete. 2024-05-21T14:43:47.090 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-21T14:43:06.569415+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-21T14:43:17.088549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-21T14:43:18.012571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-21T14:43:47.090 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-21T14:43:47.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.269+0000 7f2498800640 1 Processor -- start 2024-05-21T14:43:47.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2498800640 1 -- start start 2024-05-21T14:43:47.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2498800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2490074cc0 0x7f24900750d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:47.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2498800640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f249015cca0 con 0x7f24901596b0 2024-05-21T14:43:47.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2498800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24900c70e0 con 0x7f24900c8900 2024-05-21T14:43:47.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2498800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f249015d870 con 0x7f2490074cc0 2024-05-21T14:43:47.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2496800640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f24901596b0 0x7f2490159ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39004/0 (socket says 172.21.15.78:39004) 2024-05-21T14:43:47.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2496800640 1 -- 172.21.15.78:0/4218801435 learned_addr learned my addr 172.21.15.78:0/4218801435 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:47.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2495400640 1 --2- 172.21.15.78:0/4218801435 >> v2:172.21.15.84:3300/0 conn(0x7f2490074cc0 0x7f24900750d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:47.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2494a00640 1 -- 172.21.15.78:0/4218801435 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1084064555 0 0) 0x7f249015cca0 con 0x7f24901596b0 2024-05-21T14:43:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2494a00640 1 -- 172.21.15.78:0/4218801435 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2478003530 con 0x7f24901596b0 2024-05-21T14:43:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2494a00640 1 -- 172.21.15.78:0/4218801435 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3328079830 0 0) 0x7f2478003530 con 0x7f24901596b0 2024-05-21T14:43:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2494a00640 1 -- 172.21.15.78:0/4218801435 >> v2:172.21.15.84:3300/0 conn(0x7f2490074cc0 msgr2=0x7f24900750d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2494a00640 1 --2- 172.21.15.78:0/4218801435 >> v2:172.21.15.84:3300/0 conn(0x7f2490074cc0 0x7f24900750d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2494a00640 1 -- 172.21.15.78:0/4218801435 >> v1:172.21.15.84:6789/0 conn(0x7f24900c8900 legacy=0x7f24900c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2494a00640 1 -- 172.21.15.78:0/4218801435 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249015cf40 con 0x7f24901596b0 2024-05-21T14:43:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2494a00640 1 -- 172.21.15.78:0/4218801435 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7f248c001a00 con 0x7f24901596b0 2024-05-21T14:43:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2495400640 1 --2- 172.21.15.78:0/4218801435 >> v2:172.21.15.84:3300/0 conn(0x7f2490074cc0 0x7f24900750d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:43:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2494a00640 1 -- 172.21.15.78:0/4218801435 >> v1:172.21.15.78:6789/0 conn(0x7f24901596b0 legacy=0x7f2490159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2494a00640 1 --2- 172.21.15.78:0/4218801435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2478003a30 0x7f2478003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2494a00640 1 --2- 172.21.15.78:0/4218801435 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2478004810 0x7f2478004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2494a00640 1 --2- 172.21.15.78:0/4218801435 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2478005280 0x7f247800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2494a00640 1 -- 172.21.15.78:0/4218801435 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f249015d870 con 0x7f2478004810 2024-05-21T14:43:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2494a00640 1 -- 172.21.15.78:0/4218801435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f247800c1e0 con 0x7f2478003a30 2024-05-21T14:43:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2494a00640 1 -- 172.21.15.78:0/4218801435 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f247800c3e0 con 0x7f2478005280 2024-05-21T14:43:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2495400640 1 --2- 172.21.15.78:0/4218801435 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2478004810 0x7f2478004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2495e00640 1 --2- 172.21.15.78:0/4218801435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2478003a30 0x7f2478003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2496800640 1 --2- 172.21.15.78:0/4218801435 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2478005280 0x7f247800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2495400640 1 -- 172.21.15.78:0/4218801435 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2478005280 msgr2=0x7f247800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.273+0000 7f2495400640 1 --2- 172.21.15.78:0/4218801435 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2478005280 0x7f247800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.277+0000 7f2495400640 1 -- 172.21.15.78:0/4218801435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2478003a30 msgr2=0x7f2478003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.277+0000 7f2495400640 1 --2- 172.21.15.78:0/4218801435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2478003a30 0x7f2478003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.277+0000 7f2495400640 1 -- 172.21.15.78:0/4218801435 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2478003530 con 0x7f2478004810 2024-05-21T14:43:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.277+0000 7f2495e00640 1 --2- 172.21.15.78:0/4218801435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2478003a30 0x7f2478003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.277+0000 7f2496800640 1 -- 172.21.15.78:0/4218801435 reap_dead start 2024-05-21T14:43:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.281+0000 7f2495400640 1 --2- 172.21.15.78:0/4218801435 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2478004810 0x7f2478004c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f24900cc240 tx=0x7f248001cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b678e2df9b0cbb77 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.281+0000 7f2494a00640 1 -- 172.21.15.78:0/4218801435 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24800b2070 con 0x7f2478004810 2024-05-21T14:43:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.281+0000 7f2494a00640 1 -- 172.21.15.78:0/4218801435 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24800a5850 con 0x7f2478004810 2024-05-21T14:43:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.281+0000 7f2494a00640 1 -- 172.21.15.78:0/4218801435 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480009880 con 0x7f2478004810 2024-05-21T14:43:47.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.281+0000 7f2498800640 1 -- 172.21.15.78:0/4218801435 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2478004810 msgr2=0x7f2478004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:47.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.281+0000 7f2498800640 1 --2- 172.21.15.78:0/4218801435 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2478004810 0x7f2478004c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f24900cc240 tx=0x7f248001cb90 comp rx=0 tx=0).stop 2024-05-21T14:43:47.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.281+0000 7f2498800640 1 -- 172.21.15.78:0/4218801435 shutdown_connections 2024-05-21T14:43:47.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.281+0000 7f2498800640 1 --2- 172.21.15.78:0/4218801435 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2478004810 0x7f2478004c20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.281+0000 7f2498800640 1 -- 172.21.15.78:0/4218801435 >> 172.21.15.78:0/4218801435 conn(0x7f24900cb4e0 msgr2=0x7f24900cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:47.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.281+0000 7f2498800640 1 -- 172.21.15.78:0/4218801435 shutdown_connections 2024-05-21T14:43:47.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.281+0000 7f2498800640 1 -- 172.21.15.78:0/4218801435 wait complete. 2024-05-21T14:43:47.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.285+0000 7f2498800640 1 Processor -- start 2024-05-21T14:43:47.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.285+0000 7f2498800640 1 -- start start 2024-05-21T14:43:47.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.285+0000 7f2498800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2478004810 0x7f24901511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:47.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2498800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2490152650 0x7f249014c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:47.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2498800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249015ba50 0x7f249014a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:47.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2498800640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f24900c8d10 con 0x7f249015ba50 2024-05-21T14:43:47.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2498800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f249015d500 con 0x7f2478004810 2024-05-21T14:43:47.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2498800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f24900c8e90 con 0x7f2490152650 2024-05-21T14:43:47.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2496800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249015ba50 0x7f249014a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:47.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2495e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2478004810 0x7f24901511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:47.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2496800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249015ba50 0x7f249014a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42624/0 (socket says 172.21.15.78:42624) 2024-05-21T14:43:47.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2496800640 1 -- 172.21.15.78:0/603026895 learned_addr learned my addr 172.21.15.78:0/603026895 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2495400640 1 --2- 172.21.15.78:0/603026895 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2490152650 0x7f249014c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2496800640 1 -- 172.21.15.78:0/603026895 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2490152650 msgr2=0x7f249014c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2496800640 1 --2- 172.21.15.78:0/603026895 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2490152650 0x7f249014c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2496800640 1 -- 172.21.15.78:0/603026895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2478004810 msgr2=0x7f24901511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2496800640 1 --2- 172.21.15.78:0/603026895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2478004810 0x7f24901511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2496800640 1 -- 172.21.15.78:0/603026895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249006dad0 con 0x7f249015ba50 2024-05-21T14:43:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2495400640 1 --2- 172.21.15.78:0/603026895 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2490152650 0x7f249014c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2496800640 1 --2- 172.21.15.78:0/603026895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249015ba50 0x7f249014a2b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f24900cc930 tx=0x7f248c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:47.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f248a000640 1 -- 172.21.15.78:0/603026895 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c007ae0 con 0x7f249015ba50 2024-05-21T14:43:47.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f248a000640 1 -- 172.21.15.78:0/603026895 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f248c00eda0 con 0x7f249015ba50 2024-05-21T14:43:47.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2498800640 1 -- 172.21.15.78:0/603026895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2490152ef0 con 0x7f249015ba50 2024-05-21T14:43:47.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f248a000640 1 -- 172.21.15.78:0/603026895 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c014670 con 0x7f249015ba50 2024-05-21T14:43:47.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2498800640 1 -- 172.21.15.78:0/603026895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24901534b0 con 0x7f249015ba50 2024-05-21T14:43:47.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f2498800640 1 -- 172.21.15.78:0/603026895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2490153680 con 0x7f249015ba50 2024-05-21T14:43:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.289+0000 7f248a000640 1 -- 172.21.15.78:0/603026895 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f248c014810 con 0x7f249015ba50 2024-05-21T14:43:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.293+0000 7f248a000640 1 --2- 172.21.15.78:0/603026895 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24740678c0 0x7f2474069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.293+0000 7f248a000640 1 -- 172.21.15.78:0/603026895 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f248c0859f0 con 0x7f249015ba50 2024-05-21T14:43:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.293+0000 7f2495e00640 1 --2- 172.21.15.78:0/603026895 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24740678c0 0x7f2474069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.293+0000 7f2495e00640 1 --2- 172.21.15.78:0/603026895 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24740678c0 0x7f2474069dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2484007fd0 tx=0x7f2484009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:47.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.297+0000 7f248a000640 1 -- 172.21.15.78:0/603026895 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f2490153680 con 0x7f249015ba50 2024-05-21T14:43:47.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.453+0000 7f2498800640 1 -- 172.21.15.78:0/603026895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f249004f730 con 0x7f249015ba50 2024-05-21T14:43:47.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.453+0000 7f248a000640 1 -- 172.21.15.78:0/603026895 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f248c055e40 con 0x7f249015ba50 2024-05-21T14:43:47.461 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-05-21T14:43:47.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.453+0000 7f2498800640 1 -- 172.21.15.78:0/603026895 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24740678c0 msgr2=0x7f2474069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:47.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.453+0000 7f2498800640 1 --2- 172.21.15.78:0/603026895 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24740678c0 0x7f2474069dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2484007fd0 tx=0x7f2484009040 comp rx=0 tx=0).stop 2024-05-21T14:43:47.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.453+0000 7f2498800640 1 -- 172.21.15.78:0/603026895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249015ba50 msgr2=0x7f249014a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:47.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.453+0000 7f2498800640 1 --2- 172.21.15.78:0/603026895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249015ba50 0x7f249014a2b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f24900cc930 tx=0x7f248c00e530 comp rx=0 tx=0).stop 2024-05-21T14:43:47.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.453+0000 7f2498800640 1 -- 172.21.15.78:0/603026895 shutdown_connections 2024-05-21T14:43:47.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.453+0000 7f2498800640 1 --2- 172.21.15.78:0/603026895 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f24740678c0 0x7f2474069dd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.453+0000 7f2498800640 1 --2- 172.21.15.78:0/603026895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249015ba50 0x7f249014a2b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.453+0000 7f2498800640 1 --2- 172.21.15.78:0/603026895 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2490152650 0x7f249014c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.453+0000 7f2498800640 1 --2- 172.21.15.78:0/603026895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2478004810 0x7f24901511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.453+0000 7f2498800640 1 -- 172.21.15.78:0/603026895 >> 172.21.15.78:0/603026895 conn(0x7f24900cb4e0 msgr2=0x7f24900737f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:47.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.457+0000 7f2498800640 1 -- 172.21.15.78:0/603026895 shutdown_connections 2024-05-21T14:43:47.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.457+0000 7f2498800640 1 -- 172.21.15.78:0/603026895 wait complete. 2024-05-21T14:43:47.483 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-21T14:43:47.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.625+0000 7f7644e00640 1 Processor -- start 2024-05-21T14:43:47.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.625+0000 7f7644e00640 1 -- start start 2024-05-21T14:43:47.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.625+0000 7f7644e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7640074cc0 0x7f76400750d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:47.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.625+0000 7f7644e00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f764015cca0 con 0x7f76400c8900 2024-05-21T14:43:47.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.625+0000 7f7644e00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76400c70e0 con 0x7f76401596b0 2024-05-21T14:43:47.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.625+0000 7f7644e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f764015d870 con 0x7f7640074cc0 2024-05-21T14:43:47.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.625+0000 7f763de00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f76400c8900 0x7f76400c67e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39020/0 (socket says 172.21.15.78:39020) 2024-05-21T14:43:47.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.625+0000 7f763de00640 1 -- 172.21.15.78:0/1458335518 learned_addr learned my addr 172.21.15.78:0/1458335518 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:47.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.625+0000 7f7637e00640 1 --2- 172.21.15.78:0/1458335518 >> v2:172.21.15.84:3300/0 conn(0x7f7640074cc0 0x7f76400750d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.625+0000 7f763d400640 1 -- 172.21.15.78:0/1458335518 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3937350694 0 0) 0x7f764015cca0 con 0x7f76400c8900 2024-05-21T14:43:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.625+0000 7f763d400640 1 -- 172.21.15.78:0/1458335518 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7624003530 con 0x7f76400c8900 2024-05-21T14:43:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.625+0000 7f763d400640 1 -- 172.21.15.78:0/1458335518 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 360084136 0 0) 0x7f7624003530 con 0x7f76400c8900 2024-05-21T14:43:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.625+0000 7f7637e00640 1 -- 172.21.15.78:0/1458335518 >> v1:172.21.15.84:6789/0 conn(0x7f76401596b0 legacy=0x7f7640159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.625+0000 7f7637e00640 1 -- 172.21.15.78:0/1458335518 >> v1:172.21.15.78:6789/0 conn(0x7f76400c8900 legacy=0x7f76400c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.625+0000 7f7637e00640 1 -- 172.21.15.78:0/1458335518 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764015cf40 con 0x7f7640074cc0 2024-05-21T14:43:47.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.629+0000 7f7637e00640 1 --2- 172.21.15.78:0/1458335518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7640074cc0 0x7f76400750d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f764015d9f0 tx=0x7f762801ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8564a2b90e5e08d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.629+0000 7f763d400640 1 -- 172.21.15.78:0/1458335518 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76280b5070 con 0x7f7640074cc0 2024-05-21T14:43:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.629+0000 7f763d400640 1 -- 172.21.15.78:0/1458335518 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76280a8630 con 0x7f7640074cc0 2024-05-21T14:43:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.629+0000 7f763d400640 1 -- 172.21.15.78:0/1458335518 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7630001680 con 0x7f7640074cc0 2024-05-21T14:43:47.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.629+0000 7f7644e00640 1 -- 172.21.15.78:0/1458335518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7640074cc0 msgr2=0x7f76400750d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:47.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.629+0000 7f7644e00640 1 --2- 172.21.15.78:0/1458335518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7640074cc0 0x7f76400750d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f764015d9f0 tx=0x7f762801ebb0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.629+0000 7f7644e00640 1 -- 172.21.15.78:0/1458335518 shutdown_connections 2024-05-21T14:43:47.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.629+0000 7f7644e00640 1 --2- 172.21.15.78:0/1458335518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7640074cc0 0x7f76400750d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.629+0000 7f7644e00640 1 -- 172.21.15.78:0/1458335518 >> 172.21.15.78:0/1458335518 conn(0x7f76400cb4e0 msgr2=0x7f76400cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:47.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.629+0000 7f7644e00640 1 -- 172.21.15.78:0/1458335518 shutdown_connections 2024-05-21T14:43:47.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.629+0000 7f7644e00640 1 -- 172.21.15.78:0/1458335518 wait complete. 2024-05-21T14:43:47.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.633+0000 7f7644e00640 1 Processor -- start 2024-05-21T14:43:47.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.633+0000 7f7644e00640 1 -- start start 2024-05-21T14:43:47.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.633+0000 7f7644e00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7640074cc0 0x7f764015b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:47.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.633+0000 7f7644e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76400c8900 0x7f764006da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:47.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.633+0000 7f7644e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76401596b0 0x7f764006dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:47.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.633+0000 7f7644e00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f76400c8d10 con 0x7f76400c8900 2024-05-21T14:43:47.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.633+0000 7f7644e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f764015d500 con 0x7f76401596b0 2024-05-21T14:43:47.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.633+0000 7f7644e00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f76400c8e90 con 0x7f7640074cc0 2024-05-21T14:43:47.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.633+0000 7f7637e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76400c8900 0x7f764006da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:47.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.633+0000 7f7637e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76400c8900 0x7f764006da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42640/0 (socket says 172.21.15.78:42640) 2024-05-21T14:43:47.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.633+0000 7f7637e00640 1 -- 172.21.15.78:0/2986714804 learned_addr learned my addr 172.21.15.78:0/2986714804 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:47.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.633+0000 7f763de00640 1 --2- 172.21.15.78:0/2986714804 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7640074cc0 0x7f764015b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:47.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.633+0000 7f763e800640 1 --2- 172.21.15.78:0/2986714804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76401596b0 0x7f764006dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:47.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.637+0000 7f7637e00640 1 -- 172.21.15.78:0/2986714804 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7640074cc0 msgr2=0x7f764015b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:47.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.637+0000 7f7637e00640 1 --2- 172.21.15.78:0/2986714804 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7640074cc0 0x7f764015b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.637+0000 7f7637e00640 1 -- 172.21.15.78:0/2986714804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76401596b0 msgr2=0x7f764006dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:47.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.637+0000 7f7637e00640 1 --2- 172.21.15.78:0/2986714804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76401596b0 0x7f764006dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.637+0000 7f7637e00640 1 -- 172.21.15.78:0/2986714804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764015bee0 con 0x7f76400c8900 2024-05-21T14:43:47.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.637+0000 7f7637e00640 1 --2- 172.21.15.78:0/2986714804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76400c8900 0x7f764006da80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f76280b3040 tx=0x7f762801b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:47.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.637+0000 7f7636000640 1 -- 172.21.15.78:0/2986714804 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76280b5040 con 0x7f76400c8900 2024-05-21T14:43:47.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.637+0000 7f7636000640 1 -- 172.21.15.78:0/2986714804 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76280c0070 con 0x7f76400c8900 2024-05-21T14:43:47.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.637+0000 7f7636000640 1 -- 172.21.15.78:0/2986714804 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76280a9d10 con 0x7f76400c8900 2024-05-21T14:43:47.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.637+0000 7f7644e00640 1 -- 172.21.15.78:0/2986714804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76400ca750 con 0x7f76400c8900 2024-05-21T14:43:47.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.637+0000 7f7644e00640 1 -- 172.21.15.78:0/2986714804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76401549d0 con 0x7f76400c8900 2024-05-21T14:43:47.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.637+0000 7f7644e00640 1 -- 172.21.15.78:0/2986714804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f764004f730 con 0x7f76400c8900 2024-05-21T14:43:47.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.637+0000 7f7636000640 1 -- 172.21.15.78:0/2986714804 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7628003620 con 0x7f76400c8900 2024-05-21T14:43:47.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.637+0000 7f7636000640 1 --2- 172.21.15.78:0/2986714804 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f761c0678c0 0x7f761c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:47.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.637+0000 7f7636000640 1 -- 172.21.15.78:0/2986714804 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7628122fc0 con 0x7f76400c8900 2024-05-21T14:43:47.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.641+0000 7f763de00640 1 --2- 172.21.15.78:0/2986714804 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f761c0678c0 0x7f761c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:47.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.641+0000 7f763de00640 1 --2- 172.21.15.78:0/2986714804 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f761c0678c0 0x7f761c069dd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7630005890 tx=0x7f7630009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:47.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.645+0000 7f7636000640 1 -- 172.21.15.78:0/2986714804 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f7628018710 con 0x7f76400c8900 2024-05-21T14:43:47.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.849+0000 7f7644e00640 1 -- 172.21.15.78:0/2986714804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f76400c8020 con 0x7f76400c8900 2024-05-21T14:43:47.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.849+0000 7f7636000640 1 -- 172.21.15.78:0/2986714804 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f76280f3b30 con 0x7f76400c8900 2024-05-21T14:43:47.856 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-05-21T14:43:47.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.849+0000 7f7644e00640 1 -- 172.21.15.78:0/2986714804 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f761c0678c0 msgr2=0x7f761c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:47.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.849+0000 7f7644e00640 1 --2- 172.21.15.78:0/2986714804 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f761c0678c0 0x7f761c069dd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7630005890 tx=0x7f7630009040 comp rx=0 tx=0).stop 2024-05-21T14:43:47.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.849+0000 7f7644e00640 1 -- 172.21.15.78:0/2986714804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76400c8900 msgr2=0x7f764006da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:47.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.849+0000 7f7644e00640 1 --2- 172.21.15.78:0/2986714804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76400c8900 0x7f764006da80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f76280b3040 tx=0x7f762801b950 comp rx=0 tx=0).stop 2024-05-21T14:43:47.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.849+0000 7f7644e00640 1 -- 172.21.15.78:0/2986714804 shutdown_connections 2024-05-21T14:43:47.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.849+0000 7f7644e00640 1 --2- 172.21.15.78:0/2986714804 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f761c0678c0 0x7f761c069dd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.849+0000 7f7644e00640 1 --2- 172.21.15.78:0/2986714804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76401596b0 0x7f764006dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.849+0000 7f7644e00640 1 --2- 172.21.15.78:0/2986714804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76400c8900 0x7f764006da80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.849+0000 7f7644e00640 1 --2- 172.21.15.78:0/2986714804 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7640074cc0 0x7f764015b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:47.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.849+0000 7f7644e00640 1 -- 172.21.15.78:0/2986714804 >> 172.21.15.78:0/2986714804 conn(0x7f76400cb4e0 msgr2=0x7f7640157cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:47.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.849+0000 7f7644e00640 1 -- 172.21.15.78:0/2986714804 shutdown_connections 2024-05-21T14:43:47.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:47.849+0000 7f7644e00640 1 -- 172.21.15.78:0/2986714804 wait complete. 2024-05-21T14:43:47.878 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-21T14:43:48.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.017+0000 7f5489400640 1 Processor -- start 2024-05-21T14:43:48.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.017+0000 7f5489400640 1 -- start start 2024-05-21T14:43:48.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5489400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f54840c9590 0x7f548415c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5489400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f548415c780 0x7f5484073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5489400640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54840ca900 con 0x7f54840c99a0 2024-05-21T14:43:48.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5489400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f54840c5d90 con 0x7f548415c780 2024-05-21T14:43:48.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5489400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f54840ca6d0 con 0x7f54840c9590 2024-05-21T14:43:48.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5483200640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f54840c99a0 0x7f5484074cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39032/0 (socket says 172.21.15.78:39032) 2024-05-21T14:43:48.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5483200640 1 -- 172.21.15.78:0/1198511323 learned_addr learned my addr 172.21.15.78:0/1198511323 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:48.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5482800640 1 --2- 172.21.15.78:0/1198511323 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f54840c9590 0x7f548415c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481e00640 1 --2- 172.21.15.78:0/1198511323 >> v2:172.21.15.84:3300/0 conn(0x7f548415c780 0x7f5484073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481400640 1 -- 172.21.15.78:0/1198511323 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2730541646 0 0) 0x7f54840ca900 con 0x7f54840c99a0 2024-05-21T14:43:48.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481400640 1 -- 172.21.15.78:0/1198511323 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5468003530 con 0x7f54840c99a0 2024-05-21T14:43:48.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481400640 1 -- 172.21.15.78:0/1198511323 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 137799388 0 0) 0x7f5468003530 con 0x7f54840c99a0 2024-05-21T14:43:48.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481400640 1 -- 172.21.15.78:0/1198511323 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f54840c9590 msgr2=0x7f548415c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481400640 1 --2- 172.21.15.78:0/1198511323 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f54840c9590 0x7f548415c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481400640 1 -- 172.21.15.78:0/1198511323 >> v2:172.21.15.84:3300/0 conn(0x7f548415c780 msgr2=0x7f5484073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481400640 1 --2- 172.21.15.78:0/1198511323 >> v2:172.21.15.84:3300/0 conn(0x7f548415c780 0x7f5484073600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481400640 1 -- 172.21.15.78:0/1198511323 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54840cabe0 con 0x7f54840c99a0 2024-05-21T14:43:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481400640 1 -- 172.21.15.78:0/1198511323 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7f547c001a00 con 0x7f54840c99a0 2024-05-21T14:43:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5482800640 1 --2- 172.21.15.78:0/1198511323 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f54840c9590 0x7f548415c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:43:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481400640 1 -- 172.21.15.78:0/1198511323 >> v1:172.21.15.78:6789/0 conn(0x7f54840c99a0 legacy=0x7f5484074cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481400640 1 --2- 172.21.15.78:0/1198511323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5468003a60 0x7f5468003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481400640 1 --2- 172.21.15.78:0/1198511323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5468004810 0x7f5468004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481400640 1 --2- 172.21.15.78:0/1198511323 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f54840c9590 0x7f5468005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481400640 1 -- 172.21.15.78:0/1198511323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f546800ba80 con 0x7f5468003a60 2024-05-21T14:43:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481400640 1 -- 172.21.15.78:0/1198511323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f546800bc00 con 0x7f5468004810 2024-05-21T14:43:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481400640 1 -- 172.21.15.78:0/1198511323 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f546800bdb0 con 0x7f54840c9590 2024-05-21T14:43:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481e00640 1 --2- 172.21.15.78:0/1198511323 >> v2:172.21.15.84:3300/0 conn(0x7f548415c780 0x7f5484073600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:43:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5482800640 1 --2- 172.21.15.78:0/1198511323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5468003a60 0x7f5468003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5483200640 1 --2- 172.21.15.78:0/1198511323 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f54840c9590 0x7f5468005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481e00640 1 --2- 172.21.15.78:0/1198511323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5468004810 0x7f5468004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5482800640 1 -- 172.21.15.78:0/1198511323 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f54840c9590 msgr2=0x7f5468005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5482800640 1 --2- 172.21.15.78:0/1198511323 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f54840c9590 0x7f5468005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5482800640 1 -- 172.21.15.78:0/1198511323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5468004810 msgr2=0x7f5468004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5482800640 1 --2- 172.21.15.78:0/1198511323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5468004810 0x7f5468004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5482800640 1 -- 172.21.15.78:0/1198511323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5468003530 con 0x7f5468003a60 2024-05-21T14:43:48.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.021+0000 7f5481e00640 1 --2- 172.21.15.78:0/1198511323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5468004810 0x7f5468004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.025+0000 7f5482800640 1 --2- 172.21.15.78:0/1198511323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5468003a60 0x7f5468003ed0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5474009cb0 tx=0x7f547401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dfce2fe93427b20 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.025+0000 7f5481400640 1 -- 172.21.15.78:0/1198511323 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54740b2070 con 0x7f5468003a60 2024-05-21T14:43:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.025+0000 7f5481400640 1 -- 172.21.15.78:0/1198511323 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54740a5870 con 0x7f5468003a60 2024-05-21T14:43:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.025+0000 7f5481400640 1 -- 172.21.15.78:0/1198511323 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474009880 con 0x7f5468003a60 2024-05-21T14:43:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.025+0000 7f5489400640 1 -- 172.21.15.78:0/1198511323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5468003a60 msgr2=0x7f5468003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.025+0000 7f5489400640 1 --2- 172.21.15.78:0/1198511323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5468003a60 0x7f5468003ed0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5474009cb0 tx=0x7f547401ccc0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.025+0000 7f5483200640 1 -- 172.21.15.78:0/1198511323 reap_dead start 2024-05-21T14:43:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.025+0000 7f5489400640 1 -- 172.21.15.78:0/1198511323 shutdown_connections 2024-05-21T14:43:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.025+0000 7f5489400640 1 -- 172.21.15.78:0/1198511323 >> 172.21.15.78:0/1198511323 conn(0x7f5484071950 msgr2=0x7f54840cec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.025+0000 7f5489400640 1 -- 172.21.15.78:0/1198511323 shutdown_connections 2024-05-21T14:43:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.025+0000 7f5489400640 1 -- 172.21.15.78:0/1198511323 wait complete. 2024-05-21T14:43:48.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.029+0000 7f5489400640 1 Processor -- start 2024-05-21T14:43:48.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.029+0000 7f5489400640 1 -- start start 2024-05-21T14:43:48.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.029+0000 7f5489400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5468003a60 0x7f54840cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.029+0000 7f5489400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54840c8a00 0x7f54840ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.029+0000 7f5489400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f548415a9e0 0x7f54840ced70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.029+0000 7f5489400640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f548415bd20 con 0x7f54840c8a00 2024-05-21T14:43:48.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.029+0000 7f5489400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f54840cb1a0 con 0x7f548415a9e0 2024-05-21T14:43:48.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.029+0000 7f5489400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f548415fec0 con 0x7f5468003a60 2024-05-21T14:43:48.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.029+0000 7f5481e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54840c8a00 0x7f54840ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.029+0000 7f5481e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54840c8a00 0x7f54840ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42664/0 (socket says 172.21.15.78:42664) 2024-05-21T14:43:48.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.029+0000 7f5481e00640 1 -- 172.21.15.78:0/1224936427 learned_addr learned my addr 172.21.15.78:0/1224936427 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:48.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.029+0000 7f5482800640 1 --2- 172.21.15.78:0/1224936427 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5468003a60 0x7f54840cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.029+0000 7f5483200640 1 --2- 172.21.15.78:0/1224936427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f548415a9e0 0x7f54840ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.033+0000 7f5481e00640 1 -- 172.21.15.78:0/1224936427 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5468003a60 msgr2=0x7f54840cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:48.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.033+0000 7f5481e00640 1 --2- 172.21.15.78:0/1224936427 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5468003a60 0x7f54840cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.033+0000 7f5481e00640 1 -- 172.21.15.78:0/1224936427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f548415a9e0 msgr2=0x7f54840ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:48.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.033+0000 7f5481e00640 1 --2- 172.21.15.78:0/1224936427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f548415a9e0 0x7f54840ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.033+0000 7f5481e00640 1 -- 172.21.15.78:0/1224936427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54840ce450 con 0x7f54840c8a00 2024-05-21T14:43:48.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.033+0000 7f5481e00640 1 --2- 172.21.15.78:0/1224936427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54840c8a00 0x7f54840ce830 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5470011820 tx=0x7f5470011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:48.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.033+0000 7f547aa00640 1 -- 172.21.15.78:0/1224936427 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547000fbd0 con 0x7f54840c8a00 2024-05-21T14:43:48.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.033+0000 7f547aa00640 1 -- 172.21.15.78:0/1224936427 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f547000fd70 con 0x7f54840c8a00 2024-05-21T14:43:48.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.033+0000 7f547aa00640 1 -- 172.21.15.78:0/1224936427 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54700156a0 con 0x7f54840c8a00 2024-05-21T14:43:48.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.033+0000 7f5489400640 1 -- 172.21.15.78:0/1224936427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54840ce240 con 0x7f54840c8a00 2024-05-21T14:43:48.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.033+0000 7f5489400640 1 -- 172.21.15.78:0/1224936427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54841566f0 con 0x7f54840c8a00 2024-05-21T14:43:48.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.033+0000 7f5489400640 1 -- 172.21.15.78:0/1224936427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f548404f730 con 0x7f54840c8a00 2024-05-21T14:43:48.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.033+0000 7f547aa00640 1 -- 172.21.15.78:0/1224936427 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5470015840 con 0x7f54840c8a00 2024-05-21T14:43:48.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.033+0000 7f547aa00640 1 --2- 172.21.15.78:0/1224936427 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f54640678c0 0x7f5464069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.033+0000 7f547aa00640 1 -- 172.21.15.78:0/1224936427 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5470086760 con 0x7f54840c8a00 2024-05-21T14:43:48.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.037+0000 7f5482800640 1 --2- 172.21.15.78:0/1224936427 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f54640678c0 0x7f5464069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.037+0000 7f5482800640 1 --2- 172.21.15.78:0/1224936427 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f54640678c0 0x7f5464069dd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f54740af000 tx=0x7f54740046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:48.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.041+0000 7f547aa00640 1 -- 172.21.15.78:0/1224936427 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f5470019030 con 0x7f54840c8a00 2024-05-21T14:43:48.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.193+0000 7f5489400640 1 -- 172.21.15.78:0/1224936427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f54840c8f40 con 0x7f54840c8a00 2024-05-21T14:43:48.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.193+0000 7f547aa00640 1 -- 172.21.15.78:0/1224936427 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f5470057200 con 0x7f54840c8a00 2024-05-21T14:43:48.202 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-05-21T14:43:48.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.197+0000 7f5489400640 1 -- 172.21.15.78:0/1224936427 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f54640678c0 msgr2=0x7f5464069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:48.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.197+0000 7f5489400640 1 --2- 172.21.15.78:0/1224936427 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f54640678c0 0x7f5464069dd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f54740af000 tx=0x7f54740046d0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.197+0000 7f5489400640 1 -- 172.21.15.78:0/1224936427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54840c8a00 msgr2=0x7f54840ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:48.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.197+0000 7f5489400640 1 --2- 172.21.15.78:0/1224936427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54840c8a00 0x7f54840ce830 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5470011820 tx=0x7f5470011c20 comp rx=0 tx=0).stop 2024-05-21T14:43:48.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.197+0000 7f5489400640 1 -- 172.21.15.78:0/1224936427 shutdown_connections 2024-05-21T14:43:48.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.197+0000 7f5489400640 1 --2- 172.21.15.78:0/1224936427 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f54640678c0 0x7f5464069dd0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.197+0000 7f5489400640 1 --2- 172.21.15.78:0/1224936427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f548415a9e0 0x7f54840ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.197+0000 7f5489400640 1 --2- 172.21.15.78:0/1224936427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54840c8a00 0x7f54840ce830 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.197+0000 7f5489400640 1 --2- 172.21.15.78:0/1224936427 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5468003a60 0x7f54840cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.197+0000 7f5489400640 1 -- 172.21.15.78:0/1224936427 >> 172.21.15.78:0/1224936427 conn(0x7f5484071950 msgr2=0x7f5484159980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:48.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.197+0000 7f5489400640 1 -- 172.21.15.78:0/1224936427 shutdown_connections 2024-05-21T14:43:48.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.197+0000 7f5489400640 1 -- 172.21.15.78:0/1224936427 wait complete. 2024-05-21T14:43:48.224 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T14:43:48.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.361+0000 7f83fe400640 1 Processor -- start 2024-05-21T14:43:48.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.361+0000 7f83fe400640 1 -- start start 2024-05-21T14:43:48.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.365+0000 7f83fe400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83f80c87b0 0x7f83f8151de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.365+0000 7f83fe400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83f806beb0 0x7f83f806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.365+0000 7f83fe400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83f8158110 con 0x7f83f815b930 2024-05-21T14:43:48.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.365+0000 7f83fe400640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f83f8158c90 con 0x7f83f806beb0 2024-05-21T14:43:48.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.365+0000 7f83fe400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f83f81583f0 con 0x7f83f80c87b0 2024-05-21T14:43:48.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.365+0000 7f83eea00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83f806beb0 0x7f83f806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.365+0000 7f83eea00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83f806beb0 0x7f83f806c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42672/0 (socket says 172.21.15.78:42672) 2024-05-21T14:43:48.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.365+0000 7f83eea00640 1 -- 172.21.15.78:0/2317388440 learned_addr learned my addr 172.21.15.78:0/2317388440 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:48.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.365+0000 7f83f7400640 1 --2- 172.21.15.78:0/2317388440 >> v2:172.21.15.84:3300/0 conn(0x7f83f80c87b0 0x7f83f8151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.365+0000 7f83eea00640 1 -- 172.21.15.78:0/2317388440 >> v2:172.21.15.84:3300/0 conn(0x7f83f80c87b0 msgr2=0x7f83f8151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:48.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.365+0000 7f83eea00640 1 --2- 172.21.15.78:0/2317388440 >> v2:172.21.15.84:3300/0 conn(0x7f83f80c87b0 0x7f83f8151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.365+0000 7f83eea00640 1 -- 172.21.15.78:0/2317388440 >> v1:172.21.15.84:6789/0 conn(0x7f83f815b930 legacy=0x7f83f80c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:48.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.365+0000 7f83eea00640 1 -- 172.21.15.78:0/2317388440 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f81586d0 con 0x7f83f806beb0 2024-05-21T14:43:48.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.369+0000 7f83eea00640 1 --2- 172.21.15.78:0/2317388440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f806beb0 0x7f83f806c2c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f83f80c9260 tx=0x7f83e001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e13860bef5ae26 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:48.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.369+0000 7f83f6a00640 1 -- 172.21.15.78:0/2317388440 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e00b0070 con 0x7f83f806beb0 2024-05-21T14:43:48.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.369+0000 7f83f6a00640 1 -- 172.21.15.78:0/2317388440 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e00ab600 con 0x7f83f806beb0 2024-05-21T14:43:48.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.369+0000 7f83f6a00640 1 -- 172.21.15.78:0/2317388440 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e00ab9d0 con 0x7f83f806beb0 2024-05-21T14:43:48.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.369+0000 7f83fe400640 1 -- 172.21.15.78:0/2317388440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f806beb0 msgr2=0x7f83f806c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:48.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.369+0000 7f83fe400640 1 --2- 172.21.15.78:0/2317388440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f806beb0 0x7f83f806c2c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f83f80c9260 tx=0x7f83e001c490 comp rx=0 tx=0).stop 2024-05-21T14:43:48.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.369+0000 7f83fe400640 1 -- 172.21.15.78:0/2317388440 shutdown_connections 2024-05-21T14:43:48.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.369+0000 7f83fe400640 1 --2- 172.21.15.78:0/2317388440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f806beb0 0x7f83f806c2c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.369+0000 7f83fe400640 1 --2- 172.21.15.78:0/2317388440 >> v2:172.21.15.84:3300/0 conn(0x7f83f80c87b0 0x7f83f8151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.369+0000 7f83fe400640 1 -- 172.21.15.78:0/2317388440 >> 172.21.15.78:0/2317388440 conn(0x7f83f80c9380 msgr2=0x7f83f80c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:48.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.369+0000 7f83fe400640 1 -- 172.21.15.78:0/2317388440 shutdown_connections 2024-05-21T14:43:48.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.369+0000 7f83fe400640 1 -- 172.21.15.78:0/2317388440 wait complete. 2024-05-21T14:43:48.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83fe400640 1 Processor -- start 2024-05-21T14:43:48.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83fe400640 1 -- start start 2024-05-21T14:43:48.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83fe400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f806beb0 0x7f83f8139700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83fe400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f83f80c87b0 0x7f83f813aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83fe400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83f815b930 0x7f83f813b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83fe400640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f83f8157e70 con 0x7f83f806beb0 2024-05-21T14:43:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83fe400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f83f8157cf0 con 0x7f83f815b930 2024-05-21T14:43:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83fe400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f83f80c8bc0 con 0x7f83f80c87b0 2024-05-21T14:43:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83f7400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f806beb0 0x7f83f8139700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83f7400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f806beb0 0x7f83f8139700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42682/0 (socket says 172.21.15.78:42682) 2024-05-21T14:43:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83f7400640 1 -- 172.21.15.78:0/1171638921 learned_addr learned my addr 172.21.15.78:0/1171638921 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83eea00640 1 --2- 172.21.15.78:0/1171638921 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f83f80c87b0 0x7f83f813aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83f7e00640 1 --2- 172.21.15.78:0/1171638921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83f815b930 0x7f83f813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83f7400640 1 -- 172.21.15.78:0/1171638921 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f83f80c87b0 msgr2=0x7f83f813aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83f7400640 1 --2- 172.21.15.78:0/1171638921 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f83f80c87b0 0x7f83f813aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83f7400640 1 -- 172.21.15.78:0/1171638921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83f815b930 msgr2=0x7f83f813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83f7400640 1 --2- 172.21.15.78:0/1171638921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83f815b930 0x7f83f813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83f7400640 1 -- 172.21.15.78:0/1171638921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f8139c40 con 0x7f83f806beb0 2024-05-21T14:43:48.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83f7400640 1 --2- 172.21.15.78:0/1171638921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f806beb0 0x7f83f8139700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f83e800d620 tx=0x7f83e800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:48.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83efe00640 1 -- 172.21.15.78:0/1171638921 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e800b620 con 0x7f83f806beb0 2024-05-21T14:43:48.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83efe00640 1 -- 172.21.15.78:0/1171638921 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e8019070 con 0x7f83f806beb0 2024-05-21T14:43:48.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83efe00640 1 -- 172.21.15.78:0/1171638921 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e800b9e0 con 0x7f83f806beb0 2024-05-21T14:43:48.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83fe400640 1 -- 172.21.15.78:0/1171638921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f813e360 con 0x7f83f806beb0 2024-05-21T14:43:48.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.373+0000 7f83fe400640 1 -- 172.21.15.78:0/1171638921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f813c7d0 con 0x7f83f806beb0 2024-05-21T14:43:48.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.377+0000 7f83fe400640 1 -- 172.21.15.78:0/1171638921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83f804f730 con 0x7f83f806beb0 2024-05-21T14:43:48.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.377+0000 7f83efe00640 1 -- 172.21.15.78:0/1171638921 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f83e800bb80 con 0x7f83f806beb0 2024-05-21T14:43:48.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.377+0000 7f83efe00640 1 --2- 172.21.15.78:0/1171638921 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f83d40678f0 0x7f83d4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.377+0000 7f83efe00640 1 -- 172.21.15.78:0/1171638921 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f83e8085f90 con 0x7f83f806beb0 2024-05-21T14:43:48.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.377+0000 7f83eea00640 1 --2- 172.21.15.78:0/1171638921 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f83d40678f0 0x7f83d4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.377+0000 7f83eea00640 1 --2- 172.21.15.78:0/1171638921 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f83d40678f0 0x7f83d4069e00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f83e00ad000 tx=0x7f83e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:48.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.381+0000 7f83efe00640 1 -- 172.21.15.78:0/1171638921 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f83e8056470 con 0x7f83f806beb0 2024-05-21T14:43:48.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.569+0000 7f83fe400640 1 -- 172.21.15.78:0/1171638921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83f81516a0 con 0x7f83f806beb0 2024-05-21T14:43:48.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.569+0000 7f83efe00640 1 -- 172.21.15.78:0/1171638921 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6902 (secure 0 0 0) 0x7f83e805a770 con 0x7f83f806beb0 2024-05-21T14:43:48.579 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:48.579 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1952345794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1952345794},{"type":"v1","addr":"172.21.15.78:6833","nonce":1952345794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T14:43:18.985546+0000","modified":"2024-05-21T14:43:42.748742+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4321,"mds_1":4300,"mds_2":4297,"mds_3":4294,"mds_4":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":4,"incarnation":15,"state":"up:creating","state_seq":1,"addr":"172.21.15.78:6836/3517628193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3517628193},{"type":"v1","addr":"172.21.15.78:6836","nonce":3517628193}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":9,"addr":"172.21.15.84:6835/3155872080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3155872080},{"type":"v1","addr":"172.21.15.84:6835","nonce":3155872080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6838/1750816366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1750816366},{"type":"v1","addr":"172.21.15.84:6838","nonce":1750816366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6839/4232079477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6837","nonce":4232079477},{"type":"v1","addr":"172.21.15.84:6839","nonce":4232079477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6837/1924967428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1924967428},{"type":"v1","addr":"172.21.15.78:6837","nonce":1924967428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4321,4300,4297,4294]},"id":1}]} 2024-05-21T14:43:48.579 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 15 2024-05-21T14:43:48.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.573+0000 7f83fe400640 1 -- 172.21.15.78:0/1171638921 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f83d40678f0 msgr2=0x7f83d4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:48.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.573+0000 7f83fe400640 1 --2- 172.21.15.78:0/1171638921 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f83d40678f0 0x7f83d4069e00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f83e00ad000 tx=0x7f83e0008040 comp rx=0 tx=0).stop 2024-05-21T14:43:48.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.573+0000 7f83fe400640 1 -- 172.21.15.78:0/1171638921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f806beb0 msgr2=0x7f83f8139700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:48.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.573+0000 7f83fe400640 1 --2- 172.21.15.78:0/1171638921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f806beb0 0x7f83f8139700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f83e800d620 tx=0x7f83e800dae0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.573+0000 7f83fe400640 1 -- 172.21.15.78:0/1171638921 shutdown_connections 2024-05-21T14:43:48.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.573+0000 7f83fe400640 1 --2- 172.21.15.78:0/1171638921 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f83d40678f0 0x7f83d4069e00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.573+0000 7f83fe400640 1 --2- 172.21.15.78:0/1171638921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83f815b930 0x7f83f813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.573+0000 7f83fe400640 1 --2- 172.21.15.78:0/1171638921 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f83f80c87b0 0x7f83f813aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.573+0000 7f83fe400640 1 --2- 172.21.15.78:0/1171638921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f806beb0 0x7f83f8139700 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.573+0000 7f83fe400640 1 -- 172.21.15.78:0/1171638921 >> 172.21.15.78:0/1171638921 conn(0x7f83f80c9380 msgr2=0x7f83f8155d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:48.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.573+0000 7f83fe400640 1 -- 172.21.15.78:0/1171638921 shutdown_connections 2024-05-21T14:43:48.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.573+0000 7f83fe400640 1 -- 172.21.15.78:0/1171638921 wait complete. 2024-05-21T14:43:48.600 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:43:48.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa152200640 1 Processor -- start 2024-05-21T14:43:48.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa152200640 1 -- start start 2024-05-21T14:43:48.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa152200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa14c155ba0 0x7fa14c071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa152200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa14c0c9550 0x7fa14c073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa152200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa14c0c9960 0x7fa14c073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa152200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fa14c071180 con 0x7fa14c0c9550 2024-05-21T14:43:48.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa152200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa14c15bdc0 con 0x7fa14c0c9960 2024-05-21T14:43:48.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa152200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa14c0cf9f0 con 0x7fa14c155ba0 2024-05-21T14:43:48.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa142a00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa14c0c9550 0x7fa14c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa142a00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa14c0c9550 0x7fa14c073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42696/0 (socket says 172.21.15.78:42696) 2024-05-21T14:43:48.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa142a00640 1 -- 172.21.15.78:0/1765919029 learned_addr learned my addr 172.21.15.78:0/1765919029 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:48.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa14be00640 1 --2- 172.21.15.78:0/1765919029 >> v2:172.21.15.84:3300/0 conn(0x7fa14c0c9960 0x7fa14c073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa14b400640 1 --2- 172.21.15.78:0/1765919029 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa14c155ba0 0x7fa14c071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa142a00640 1 -- 172.21.15.78:0/1765919029 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa14c155ba0 msgr2=0x7fa14c071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:48.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa142a00640 1 --2- 172.21.15.78:0/1765919029 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa14c155ba0 0x7fa14c071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa142a00640 1 -- 172.21.15.78:0/1765919029 >> v2:172.21.15.84:3300/0 conn(0x7fa14c0c9960 msgr2=0x7fa14c073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:48.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa142a00640 1 --2- 172.21.15.78:0/1765919029 >> v2:172.21.15.84:3300/0 conn(0x7fa14c0c9960 0x7fa14c073ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.741+0000 7fa142a00640 1 -- 172.21.15.78:0/1765919029 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14c15c8b0 con 0x7fa14c0c9550 2024-05-21T14:43:48.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.745+0000 7fa142a00640 1 --2- 172.21.15.78:0/1765919029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0c9550 0x7fa14c073570 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa14c06ed70 tx=0x7fa13401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa14d3b3d2622ab server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:48.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.745+0000 7fa14aa00640 1 -- 172.21.15.78:0/1765919029 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1340b1070 con 0x7fa14c0c9550 2024-05-21T14:43:48.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.745+0000 7fa14aa00640 1 -- 172.21.15.78:0/1765919029 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1340ac630 con 0x7fa14c0c9550 2024-05-21T14:43:48.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.745+0000 7fa14aa00640 1 -- 172.21.15.78:0/1765919029 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1340a8050 con 0x7fa14c0c9550 2024-05-21T14:43:48.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.745+0000 7fa152200640 1 -- 172.21.15.78:0/1765919029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0c9550 msgr2=0x7fa14c073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:48.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.745+0000 7fa152200640 1 --2- 172.21.15.78:0/1765919029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0c9550 0x7fa14c073570 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa14c06ed70 tx=0x7fa13401c520 comp rx=0 tx=0).stop 2024-05-21T14:43:48.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.745+0000 7fa152200640 1 -- 172.21.15.78:0/1765919029 shutdown_connections 2024-05-21T14:43:48.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.745+0000 7fa152200640 1 --2- 172.21.15.78:0/1765919029 >> v2:172.21.15.84:3300/0 conn(0x7fa14c0c9960 0x7fa14c073ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.745+0000 7fa152200640 1 --2- 172.21.15.78:0/1765919029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0c9550 0x7fa14c073570 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.745+0000 7fa152200640 1 --2- 172.21.15.78:0/1765919029 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa14c155ba0 0x7fa14c071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.745+0000 7fa152200640 1 -- 172.21.15.78:0/1765919029 >> 172.21.15.78:0/1765919029 conn(0x7fa14c0752c0 msgr2=0x7fa14c0ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:48.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.745+0000 7fa152200640 1 -- 172.21.15.78:0/1765919029 shutdown_connections 2024-05-21T14:43:48.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.745+0000 7fa152200640 1 -- 172.21.15.78:0/1765919029 wait complete. 2024-05-21T14:43:48.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa152200640 1 Processor -- start 2024-05-21T14:43:48.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa152200640 1 -- start start 2024-05-21T14:43:48.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa152200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa14c0c9550 0x7fa14c0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa152200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0c9960 0x7fa14c156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa152200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa14c155ba0 0x7fa14c0c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa152200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa14c155fb0 con 0x7fa14c0c9960 2024-05-21T14:43:48.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa152200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa14c070e10 con 0x7fa14c0c9550 2024-05-21T14:43:48.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa152200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa14c0ca020 con 0x7fa14c155ba0 2024-05-21T14:43:48.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa142a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0c9960 0x7fa14c156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa142a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0c9960 0x7fa14c156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42698/0 (socket says 172.21.15.78:42698) 2024-05-21T14:43:48.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa142a00640 1 -- 172.21.15.78:0/166295400 learned_addr learned my addr 172.21.15.78:0/166295400 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:48.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa14be00640 1 --2- 172.21.15.78:0/166295400 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa14c155ba0 0x7fa14c0c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa14b400640 1 --2- 172.21.15.78:0/166295400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa14c0c9550 0x7fa14c0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa142a00640 1 -- 172.21.15.78:0/166295400 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa14c155ba0 msgr2=0x7fa14c0c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:48.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa142a00640 1 --2- 172.21.15.78:0/166295400 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa14c155ba0 0x7fa14c0c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa142a00640 1 -- 172.21.15.78:0/166295400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa14c0c9550 msgr2=0x7fa14c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:48.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa142a00640 1 --2- 172.21.15.78:0/166295400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa14c0c9550 0x7fa14c0c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa142a00640 1 -- 172.21.15.78:0/166295400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14c0c74e0 con 0x7fa14c0c9960 2024-05-21T14:43:48.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa14be00640 1 --2- 172.21.15.78:0/166295400 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa14c155ba0 0x7fa14c0c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:48.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa142a00640 1 --2- 172.21.15.78:0/166295400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0c9960 0x7fa14c156420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa134000c10 tx=0x7fa1340192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:48.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa143e00640 1 -- 172.21.15.78:0/166295400 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1340bc070 con 0x7fa14c0c9960 2024-05-21T14:43:48.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa143e00640 1 -- 172.21.15.78:0/166295400 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1340ab5e0 con 0x7fa14c0c9960 2024-05-21T14:43:48.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa152200640 1 -- 172.21.15.78:0/166295400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa14c0c7ed0 con 0x7fa14c0c9960 2024-05-21T14:43:48.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa143e00640 1 -- 172.21.15.78:0/166295400 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1340b1070 con 0x7fa14c0c9960 2024-05-21T14:43:48.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.749+0000 7fa152200640 1 -- 172.21.15.78:0/166295400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa14c153b80 con 0x7fa14c0c9960 2024-05-21T14:43:48.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.753+0000 7fa152200640 1 -- 172.21.15.78:0/166295400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa14c152b60 con 0x7fa14c0c9960 2024-05-21T14:43:48.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.753+0000 7fa143e00640 1 -- 172.21.15.78:0/166295400 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa1340bf070 con 0x7fa14c0c9960 2024-05-21T14:43:48.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.753+0000 7fa143e00640 1 --2- 172.21.15.78:0/166295400 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa1280678c0 0x7fa128069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:48.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.753+0000 7fa143e00640 1 -- 172.21.15.78:0/166295400 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa13411f7d0 con 0x7fa14c0c9960 2024-05-21T14:43:48.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.753+0000 7fa14b400640 1 --2- 172.21.15.78:0/166295400 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa1280678c0 0x7fa128069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:48.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.753+0000 7fa14b400640 1 --2- 172.21.15.78:0/166295400 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa1280678c0 0x7fa128069dd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa13c007940 tx=0x7fa13c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:48.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.757+0000 7fa143e00640 1 -- 172.21.15.78:0/166295400 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa134016110 con 0x7fa14c0c9960 2024-05-21T14:43:48.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.921+0000 7fa152200640 1 -- 172.21.15.78:0/166295400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa14c04f730 con 0x7fa14c0c9960 2024-05-21T14:43:48.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.921+0000 7fa143e00640 1 -- 172.21.15.78:0/166295400 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16537 (secure 0 0 0) 0x7fa1340efc20 con 0x7fa14c0c9960 2024-05-21T14:43:48.930 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:48.930 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:20.573644+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T14:43:17.088549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T14:43:18.012571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:43:48.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.925+0000 7fa152200640 1 -- 172.21.15.78:0/166295400 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa1280678c0 msgr2=0x7fa128069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:48.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.925+0000 7fa152200640 1 --2- 172.21.15.78:0/166295400 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa1280678c0 0x7fa128069dd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa13c007940 tx=0x7fa13c008040 comp rx=0 tx=0).stop 2024-05-21T14:43:48.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.925+0000 7fa152200640 1 -- 172.21.15.78:0/166295400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0c9960 msgr2=0x7fa14c156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:48.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.925+0000 7fa152200640 1 --2- 172.21.15.78:0/166295400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0c9960 0x7fa14c156420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa134000c10 tx=0x7fa1340192c0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.925+0000 7fa152200640 1 -- 172.21.15.78:0/166295400 shutdown_connections 2024-05-21T14:43:48.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.925+0000 7fa152200640 1 --2- 172.21.15.78:0/166295400 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa1280678c0 0x7fa128069dd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.925+0000 7fa152200640 1 --2- 172.21.15.78:0/166295400 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa14c155ba0 0x7fa14c0c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.925+0000 7fa152200640 1 --2- 172.21.15.78:0/166295400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0c9960 0x7fa14c156420 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.925+0000 7fa152200640 1 --2- 172.21.15.78:0/166295400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa14c0c9550 0x7fa14c0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:48.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.925+0000 7fa152200640 1 -- 172.21.15.78:0/166295400 >> 172.21.15.78:0/166295400 conn(0x7fa14c0752c0 msgr2=0x7fa14c155160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:48.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.925+0000 7fa152200640 1 -- 172.21.15.78:0/166295400 shutdown_connections 2024-05-21T14:43:48.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:48.925+0000 7fa152200640 1 -- 172.21.15.78:0/166295400 wait complete. 2024-05-21T14:43:48.951 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T14:43:49.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.093+0000 7f49e9200640 1 Processor -- start 2024-05-21T14:43:49.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.093+0000 7f49e9200640 1 -- start start 2024-05-21T14:43:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.093+0000 7f49e9200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49e415f940 0x7f49e415c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.093+0000 7f49e9200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49e406c010 0x7f49e406c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.093+0000 7f49e9200640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e40c9a30 con 0x7f49e4155a30 2024-05-21T14:43:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.093+0000 7f49e9200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f49e40ca290 con 0x7f49e406c010 2024-05-21T14:43:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.093+0000 7f49e9200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f49e415fd50 con 0x7f49e415f940 2024-05-21T14:43:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.093+0000 7f49dbe00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f49e4155a30 0x7f49e40c9320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39048/0 (socket says 172.21.15.78:39048) 2024-05-21T14:43:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.093+0000 7f49dbe00640 1 -- 172.21.15.78:0/120980991 learned_addr learned my addr 172.21.15.78:0/120980991 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.093+0000 7f49e3e00640 1 --2- 172.21.15.78:0/120980991 >> v2:172.21.15.84:3300/0 conn(0x7f49e406c010 0x7f49e406c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.093+0000 7f49e3400640 1 --2- 172.21.15.78:0/120980991 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49e415f940 0x7f49e415c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:49.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.097+0000 7f49e2a00640 1 -- 172.21.15.78:0/120980991 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2735180854 0 0) 0x7f49e40c9a30 con 0x7f49e4155a30 2024-05-21T14:43:49.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.097+0000 7f49e2a00640 1 -- 172.21.15.78:0/120980991 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49c8003530 con 0x7f49e4155a30 2024-05-21T14:43:49.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.097+0000 7f49e3e00640 1 -- 172.21.15.78:0/120980991 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49e415f940 msgr2=0x7f49e415c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:49.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.097+0000 7f49e3e00640 1 --2- 172.21.15.78:0/120980991 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49e415f940 0x7f49e415c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:49.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.097+0000 7f49e3e00640 1 -- 172.21.15.78:0/120980991 >> v1:172.21.15.78:6789/0 conn(0x7f49e4155a30 legacy=0x7f49e40c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:49.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.097+0000 7f49e3e00640 1 -- 172.21.15.78:0/120980991 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e40c8dc0 con 0x7f49e406c010 2024-05-21T14:43:49.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.097+0000 7f49e3e00640 1 --2- 172.21.15.78:0/120980991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e406c010 0x7f49e406c420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009d90 tx=0x7f49dc01f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d782930b1d008fba server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:49.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.097+0000 7f49e2a00640 1 -- 172.21.15.78:0/120980991 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0b4070 con 0x7f49e406c010 2024-05-21T14:43:49.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.097+0000 7f49e2a00640 1 -- 172.21.15.78:0/120980991 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc0af600 con 0x7f49e406c010 2024-05-21T14:43:49.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.097+0000 7f49e2a00640 1 -- 172.21.15.78:0/120980991 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0af9b0 con 0x7f49e406c010 2024-05-21T14:43:49.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.101+0000 7f49e9200640 1 -- 172.21.15.78:0/120980991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e406c010 msgr2=0x7f49e406c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:49.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.101+0000 7f49e9200640 1 --2- 172.21.15.78:0/120980991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e406c010 0x7f49e406c420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009d90 tx=0x7f49dc01f150 comp rx=0 tx=0).stop 2024-05-21T14:43:49.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.101+0000 7f49e9200640 1 -- 172.21.15.78:0/120980991 shutdown_connections 2024-05-21T14:43:49.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.101+0000 7f49e9200640 1 --2- 172.21.15.78:0/120980991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e406c010 0x7f49e406c420 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:49.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.101+0000 7f49e9200640 1 --2- 172.21.15.78:0/120980991 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49e415f940 0x7f49e415c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:49.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.101+0000 7f49e9200640 1 -- 172.21.15.78:0/120980991 >> 172.21.15.78:0/120980991 conn(0x7f49e406dff0 msgr2=0x7f49e40ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:49.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.101+0000 7f49e9200640 1 -- 172.21.15.78:0/120980991 shutdown_connections 2024-05-21T14:43:49.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.101+0000 7f49e9200640 1 -- 172.21.15.78:0/120980991 wait complete. 2024-05-21T14:43:49.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.101+0000 7f49e9200640 1 Processor -- start 2024-05-21T14:43:49.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.101+0000 7f49e9200640 1 -- start start 2024-05-21T14:43:49.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e9200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49e406c010 0x7f49e415db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:49.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e4155a30 0x7f49e4153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:49.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e9200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49e415f940 0x7f49e4156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:49.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e9200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f49e415ee60 con 0x7f49e406c010 2024-05-21T14:43:49.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e9200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f49e40c8ae0 con 0x7f49e4155a30 2024-05-21T14:43:49.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e9200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f49e415f140 con 0x7f49e415f940 2024-05-21T14:43:49.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e3400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49e406c010 0x7f49e415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:49.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e3400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49e406c010 0x7f49e415db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42714/0 (socket says 172.21.15.78:42714) 2024-05-21T14:43:49.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e3400640 1 -- 172.21.15.78:0/1849327519 learned_addr learned my addr 172.21.15.78:0/1849327519 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:49.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49dbe00640 1 --2- 172.21.15.78:0/1849327519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e4155a30 0x7f49e4153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:49.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e3e00640 1 --2- 172.21.15.78:0/1849327519 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49e415f940 0x7f49e4156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:49.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e3400640 1 -- 172.21.15.78:0/1849327519 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49e415f940 msgr2=0x7f49e4156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:49.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e3400640 1 --2- 172.21.15.78:0/1849327519 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49e415f940 0x7f49e4156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:49.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e3400640 1 -- 172.21.15.78:0/1849327519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e4155a30 msgr2=0x7f49e4153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:49.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e3400640 1 --2- 172.21.15.78:0/1849327519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e4155a30 0x7f49e4153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:49.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e3400640 1 -- 172.21.15.78:0/1849327519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e415e070 con 0x7f49e406c010 2024-05-21T14:43:49.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e3400640 1 --2- 172.21.15.78:0/1849327519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49e406c010 0x7f49e415db30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f49d400e8a0 tx=0x7f49d400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:49.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49db400640 1 -- 172.21.15.78:0/1849327519 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d4017070 con 0x7f49e406c010 2024-05-21T14:43:49.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49db400640 1 -- 172.21.15.78:0/1849327519 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d400c940 con 0x7f49e406c010 2024-05-21T14:43:49.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e9200640 1 -- 172.21.15.78:0/1849327519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e40c7160 con 0x7f49e406c010 2024-05-21T14:43:49.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49db400640 1 -- 172.21.15.78:0/1849327519 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d400ccf0 con 0x7f49e406c010 2024-05-21T14:43:49.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e9200640 1 -- 172.21.15.78:0/1849327519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e40c7420 con 0x7f49e406c010 2024-05-21T14:43:49.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49e9200640 1 -- 172.21.15.78:0/1849327519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e4069f30 con 0x7f49e406c010 2024-05-21T14:43:49.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.105+0000 7f49db400640 1 -- 172.21.15.78:0/1849327519 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f49d401a070 con 0x7f49e406c010 2024-05-21T14:43:49.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.109+0000 7f49db400640 1 --2- 172.21.15.78:0/1849327519 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f49c00678f0 0x7f49c0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:49.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.109+0000 7f49db400640 1 -- 172.21.15.78:0/1849327519 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f49d4085ef0 con 0x7f49e406c010 2024-05-21T14:43:49.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.109+0000 7f49dbe00640 1 --2- 172.21.15.78:0/1849327519 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f49c00678f0 0x7f49c0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:49.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.109+0000 7f49dbe00640 1 --2- 172.21.15.78:0/1849327519 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f49c00678f0 0x7f49c0069e00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f49e40c5850 tx=0x7f49cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:49.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.113+0000 7f49db400640 1 -- 172.21.15.78:0/1849327519 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f49d4056a20 con 0x7f49e406c010 2024-05-21T14:43:49.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.305+0000 7f49e9200640 1 -- 172.21.15.78:0/1849327519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49e406bbe0 con 0x7f49e406c010 2024-05-21T14:43:49.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.305+0000 7f49db400640 1 -- 172.21.15.78:0/1849327519 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6906 (secure 0 0 0) 0x7f49d4056320 con 0x7f49e406c010 2024-05-21T14:43:49.313 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:49.313 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1952345794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1952345794},{"type":"v1","addr":"172.21.15.78:6833","nonce":1952345794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T14:43:18.985546+0000","modified":"2024-05-21T14:43:48.761495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4321,"mds_1":4300,"mds_2":4297,"mds_3":4294,"mds_4":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6836/3517628193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3517628193},{"type":"v1","addr":"172.21.15.78:6836","nonce":3517628193}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":9,"addr":"172.21.15.84:6835/3155872080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3155872080},{"type":"v1","addr":"172.21.15.84:6835","nonce":3155872080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6838/1750816366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1750816366},{"type":"v1","addr":"172.21.15.84:6838","nonce":1750816366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6839/4232079477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6837","nonce":4232079477},{"type":"v1","addr":"172.21.15.84:6839","nonce":4232079477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6837/1924967428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1924967428},{"type":"v1","addr":"172.21.15.78:6837","nonce":1924967428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4272,4294,4297,4300,4321]},"id":1}]} 2024-05-21T14:43:49.314 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 16 2024-05-21T14:43:49.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.305+0000 7f49e9200640 1 -- 172.21.15.78:0/1849327519 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f49c00678f0 msgr2=0x7f49c0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:49.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.305+0000 7f49e9200640 1 --2- 172.21.15.78:0/1849327519 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f49c00678f0 0x7f49c0069e00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f49e40c5850 tx=0x7f49cc009040 comp rx=0 tx=0).stop 2024-05-21T14:43:49.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.305+0000 7f49e9200640 1 -- 172.21.15.78:0/1849327519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49e406c010 msgr2=0x7f49e415db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:49.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.305+0000 7f49e9200640 1 --2- 172.21.15.78:0/1849327519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49e406c010 0x7f49e415db30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f49d400e8a0 tx=0x7f49d400eca0 comp rx=0 tx=0).stop 2024-05-21T14:43:49.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.305+0000 7f49e9200640 1 -- 172.21.15.78:0/1849327519 shutdown_connections 2024-05-21T14:43:49.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.305+0000 7f49e9200640 1 --2- 172.21.15.78:0/1849327519 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f49c00678f0 0x7f49c0069e00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:49.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.305+0000 7f49e9200640 1 --2- 172.21.15.78:0/1849327519 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49e415f940 0x7f49e4156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:49.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.305+0000 7f49e9200640 1 --2- 172.21.15.78:0/1849327519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e4155a30 0x7f49e4153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:49.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.305+0000 7f49e9200640 1 --2- 172.21.15.78:0/1849327519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49e406c010 0x7f49e415db30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:49.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.305+0000 7f49e9200640 1 -- 172.21.15.78:0/1849327519 >> 172.21.15.78:0/1849327519 conn(0x7f49e406dff0 msgr2=0x7f49e40cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:49.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.309+0000 7f49e9200640 1 -- 172.21.15.78:0/1849327519 shutdown_connections 2024-05-21T14:43:49.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:49.309+0000 7f49e9200640 1 -- 172.21.15.78:0/1849327519 wait complete. 2024-05-21T14:43:49.940 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-21T14:43:18.985546+0000', 'modified': '2024-05-21T14:43:48.761495+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4321, 'mds_1': 4300, 'mds_2': 4297, 'mds_3': 4294, 'mds_4': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'c', 'rank': 4, 'incarnation': 15, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.78:6836/3517628193', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 3517628193}, {'type': 'v1', 'addr': '172.21.15.78:6836', 'nonce': 3517628193}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4294': {'gid': 4294, 'name': 'f', 'rank': 3, 'incarnation': 13, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.84:6835/3155872080', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 3155872080}, {'type': 'v1', 'addr': '172.21.15.84:6835', 'nonce': 3155872080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4297': {'gid': 4297, 'name': 'b', 'rank': 2, 'incarnation': 11, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.84:6838/1750816366', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 1750816366}, {'type': 'v1', 'addr': '172.21.15.84:6838', 'nonce': 1750816366}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4300': {'gid': 4300, 'name': 'd', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.84:6839/4232079477', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6837', 'nonce': 4232079477}, {'type': 'v1', 'addr': '172.21.15.84:6839', 'nonce': 4232079477}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4321': {'gid': 4321, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.78:6837/1924967428', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6835', 'nonce': 1924967428}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 1924967428}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4321, 'qdb_cluster': [4272, 4294, 4297, 4300, 4321]} 2024-05-21T14:43:49.940 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-21T14:43:49.940 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-21T14:43:50.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.081+0000 7f8518c00640 1 Processor -- start 2024-05-21T14:43:50.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.081+0000 7f8518c00640 1 -- start start 2024-05-21T14:43:50.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.081+0000 7f8518c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f85140c7f90 0x7f85141538d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:50.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.081+0000 7f8518c00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f85140c6540 0x7f85140735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.081+0000 7f8518c00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85140c7240 con 0x7f85140c5c30 2024-05-21T14:43:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.081+0000 7f8518c00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f8514153e10 con 0x7f85140c6540 2024-05-21T14:43:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.081+0000 7f8518c00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f85140c4370 con 0x7f85140c7f90 2024-05-21T14:43:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.081+0000 7f8511e00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f85140c5c30 0x7f851415cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39064/0 (socket says 172.21.15.78:39064) 2024-05-21T14:43:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.081+0000 7f8511e00640 1 -- 172.21.15.78:0/407611733 learned_addr learned my addr 172.21.15.78:0/407611733 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.081+0000 7f8512800640 1 --2- 172.21.15.78:0/407611733 >> v2:172.21.15.78:3300/0 conn(0x7f85140c6540 0x7f85140735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.081+0000 7f8511400640 1 --2- 172.21.15.78:0/407611733 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f85140c7f90 0x7f85141538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.081+0000 7f8510a00640 1 -- 172.21.15.78:0/407611733 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3180912694 0 0) 0x7f85140c7240 con 0x7f85140c5c30 2024-05-21T14:43:50.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.081+0000 7f8510a00640 1 -- 172.21.15.78:0/407611733 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84f8003530 con 0x7f85140c5c30 2024-05-21T14:43:50.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.081+0000 7f8512800640 1 -- 172.21.15.78:0/407611733 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f85140c7f90 msgr2=0x7f85141538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:50.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.081+0000 7f8512800640 1 --2- 172.21.15.78:0/407611733 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f85140c7f90 0x7f85141538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:50.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.081+0000 7f8512800640 1 -- 172.21.15.78:0/407611733 >> v1:172.21.15.78:6789/0 conn(0x7f85140c5c30 legacy=0x7f851415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:50.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.081+0000 7f8512800640 1 -- 172.21.15.78:0/407611733 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85140c74e0 con 0x7f85140c6540 2024-05-21T14:43:50.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.085+0000 7f8512800640 1 --2- 172.21.15.78:0/407611733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85140c6540 0x7f85140735e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f850c009d90 tx=0x7f850c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68dc73a31f20364 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:50.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.085+0000 7f8510a00640 1 -- 172.21.15.78:0/407611733 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c0b2070 con 0x7f85140c6540 2024-05-21T14:43:50.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.085+0000 7f8510a00640 1 -- 172.21.15.78:0/407611733 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f850c0a5830 con 0x7f85140c6540 2024-05-21T14:43:50.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.085+0000 7f8510a00640 1 -- 172.21.15.78:0/407611733 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c0a5be0 con 0x7f85140c6540 2024-05-21T14:43:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.085+0000 7f8518c00640 1 -- 172.21.15.78:0/407611733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85140c6540 msgr2=0x7f85140735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.085+0000 7f8518c00640 1 --2- 172.21.15.78:0/407611733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85140c6540 0x7f85140735e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f850c009d90 tx=0x7f850c01c970 comp rx=0 tx=0).stop 2024-05-21T14:43:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.085+0000 7f8518c00640 1 -- 172.21.15.78:0/407611733 shutdown_connections 2024-05-21T14:43:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.085+0000 7f8518c00640 1 --2- 172.21.15.78:0/407611733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85140c6540 0x7f85140735e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.085+0000 7f8518c00640 1 --2- 172.21.15.78:0/407611733 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f85140c7f90 0x7f85141538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.085+0000 7f8518c00640 1 -- 172.21.15.78:0/407611733 >> 172.21.15.78:0/407611733 conn(0x7f85140cd1e0 msgr2=0x7f85140c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.089+0000 7f8518c00640 1 -- 172.21.15.78:0/407611733 shutdown_connections 2024-05-21T14:43:50.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.089+0000 7f8518c00640 1 -- 172.21.15.78:0/407611733 wait complete. 2024-05-21T14:43:50.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.089+0000 7f8518c00640 1 Processor -- start 2024-05-21T14:43:50.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.089+0000 7f8518c00640 1 -- start start 2024-05-21T14:43:50.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.089+0000 7f8518c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f85140c5c30 0x7f85141f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:50.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.089+0000 7f8518c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85140c6540 0x7f85141635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:50.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.089+0000 7f8518c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85140c7f90 0x7f851414a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:50.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.089+0000 7f8518c00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f85141669c0 con 0x7f85140c6540 2024-05-21T14:43:50.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.089+0000 7f8518c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8514166840 con 0x7f85140c7f90 2024-05-21T14:43:50.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.089+0000 7f8518c00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8514166b40 con 0x7f85140c5c30 2024-05-21T14:43:50.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.089+0000 7f8511400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85140c6540 0x7f85141635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:50.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.093+0000 7f8511400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85140c6540 0x7f85141635d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42734/0 (socket says 172.21.15.78:42734) 2024-05-21T14:43:50.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.093+0000 7f8511400640 1 -- 172.21.15.78:0/1850405620 learned_addr learned my addr 172.21.15.78:0/1850405620 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:50.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.093+0000 7f8511e00640 1 --2- 172.21.15.78:0/1850405620 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f85140c5c30 0x7f85141f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:50.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.093+0000 7f8512800640 1 --2- 172.21.15.78:0/1850405620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85140c7f90 0x7f851414a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:50.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.093+0000 7f8511400640 1 -- 172.21.15.78:0/1850405620 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f85140c5c30 msgr2=0x7f85141f51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:50.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.093+0000 7f8511400640 1 --2- 172.21.15.78:0/1850405620 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f85140c5c30 0x7f85141f51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:50.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.093+0000 7f8511400640 1 -- 172.21.15.78:0/1850405620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85140c7f90 msgr2=0x7f851414a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:50.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.093+0000 7f8511400640 1 --2- 172.21.15.78:0/1850405620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85140c7f90 0x7f851414a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:50.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.093+0000 7f8511400640 1 -- 172.21.15.78:0/1850405620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85141543f0 con 0x7f85140c6540 2024-05-21T14:43:50.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.093+0000 7f8511400640 1 --2- 172.21.15.78:0/1850405620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85140c6540 0x7f85141635d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f850000e870 tx=0x7f850000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:50.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.093+0000 7f850a000640 1 -- 172.21.15.78:0/1850405620 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500017070 con 0x7f85140c6540 2024-05-21T14:43:50.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.093+0000 7f850a000640 1 -- 172.21.15.78:0/1850405620 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f850000c940 con 0x7f85140c6540 2024-05-21T14:43:50.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.093+0000 7f850a000640 1 -- 172.21.15.78:0/1850405620 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850000cd30 con 0x7f85140c6540 2024-05-21T14:43:50.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.093+0000 7f8518c00640 1 -- 172.21.15.78:0/1850405620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8514162530 con 0x7f85140c6540 2024-05-21T14:43:50.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.093+0000 7f8518c00640 1 -- 172.21.15.78:0/1850405620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8514162810 con 0x7f85140c6540 2024-05-21T14:43:50.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.093+0000 7f850a000640 1 -- 172.21.15.78:0/1850405620 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f850001a070 con 0x7f85140c6540 2024-05-21T14:43:50.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.097+0000 7f850a000640 1 --2- 172.21.15.78:0/1850405620 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f84f40678c0 0x7f84f4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:50.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.097+0000 7f850a000640 1 -- 172.21.15.78:0/1850405620 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8500085f90 con 0x7f85140c6540 2024-05-21T14:43:50.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.097+0000 7f8511e00640 1 --2- 172.21.15.78:0/1850405620 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f84f40678c0 0x7f84f4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:50.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.097+0000 7f8511e00640 1 --2- 172.21.15.78:0/1850405620 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f84f40678c0 0x7f84f4069dd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8504007fd0 tx=0x7f8504000bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:50.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.097+0000 7f8520204000 1 Processor -- start 2024-05-21T14:43:50.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.097+0000 7f8520204000 1 -- start start 2024-05-21T14:43:50.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8520204000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b877960 0x56116b9d7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:50.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8520204000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b86ae60 0x56116b9dc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:50.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8520204000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b46c280 0x56116b9dc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:50.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8520204000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56116b7e8c40 con 0x56116b86ae60 2024-05-21T14:43:50.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8520204000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56116b785aa0 con 0x56116b877960 2024-05-21T14:43:50.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8520204000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x56116b7e4c00 con 0x56116b46c280 2024-05-21T14:43:50.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8511400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b86ae60 0x56116b9dc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:50.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8511400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b86ae60 0x56116b9dc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42736/0 (socket says 172.21.15.78:42736) 2024-05-21T14:43:50.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8511400640 1 -- 172.21.15.78:0/2805275737 learned_addr learned my addr 172.21.15.78:0/2805275737 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:50.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8512800640 1 --2- 172.21.15.78:0/2805275737 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b46c280 0x56116b9dc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:50.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8511e00640 1 --2- 172.21.15.78:0/2805275737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b877960 0x56116b9d7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:50.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8511400640 1 -- 172.21.15.78:0/2805275737 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b46c280 msgr2=0x56116b9dc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:50.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8511400640 1 --2- 172.21.15.78:0/2805275737 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b46c280 0x56116b9dc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:50.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8511400640 1 -- 172.21.15.78:0/2805275737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b877960 msgr2=0x56116b9d7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:50.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8511400640 1 --2- 172.21.15.78:0/2805275737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b877960 0x56116b9d7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:50.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8511400640 1 -- 172.21.15.78:0/2805275737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56116b76fb40 con 0x56116b86ae60 2024-05-21T14:43:50.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8511400640 1 --2- 172.21.15.78:0/2805275737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b86ae60 0x56116b9dc300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f850005e9e0 tx=0x7f8500055fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b08c942cf89e0f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:50.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f84fe600640 1 -- 172.21.15.78:0/2805275737 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850006e020 con 0x56116b86ae60 2024-05-21T14:43:50.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f84fe600640 1 -- 172.21.15.78:0/2805275737 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f850005ef10 con 0x56116b86ae60 2024-05-21T14:43:50.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f84fe600640 1 -- 172.21.15.78:0/2805275737 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500021070 con 0x56116b86ae60 2024-05-21T14:43:50.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8520204000 1 -- 172.21.15.78:0/2805275737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b86ae60 msgr2=0x56116b9dc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:50.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8520204000 1 --2- 172.21.15.78:0/2805275737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b86ae60 0x56116b9dc300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f850005e9e0 tx=0x7f8500055fc0 comp rx=0 tx=0).stop 2024-05-21T14:43:50.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8520204000 1 -- 172.21.15.78:0/2805275737 shutdown_connections 2024-05-21T14:43:50.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8520204000 1 --2- 172.21.15.78:0/2805275737 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b46c280 0x56116b9dc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:50.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8520204000 1 --2- 172.21.15.78:0/2805275737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b86ae60 0x56116b9dc300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:50.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8520204000 1 --2- 172.21.15.78:0/2805275737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b877960 0x56116b9d7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:50.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8520204000 1 -- 172.21.15.78:0/2805275737 >> 172.21.15.78:0/2805275737 conn(0x56116b8b54e0 msgr2=0x56116b9da0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:50.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8520204000 1 -- 172.21.15.78:0/2805275737 shutdown_connections 2024-05-21T14:43:50.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.101+0000 7f8520204000 1 -- 172.21.15.78:0/2805275737 wait complete. 2024-05-21T14:43:50.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.105+0000 7f8520204000 1 -- start start 2024-05-21T14:43:50.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.105+0000 7f8520204000 1 Processor -- start 2024-05-21T14:43:50.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.105+0000 7f8520204000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b46c280 0x56116b9d6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:50.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.105+0000 7f8520204000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b86ae60 0x56116b9d6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:50.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.105+0000 7f8520204000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b877960 0x56116b9e15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:50.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.105+0000 7f8520204000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56116b770910 con 0x56116b86ae60 2024-05-21T14:43:50.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.105+0000 7f8520204000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56116b7a6020 con 0x56116b877960 2024-05-21T14:43:50.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.105+0000 7f8520204000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x56116b7b0940 con 0x56116b46c280 2024-05-21T14:43:50.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.105+0000 7f8520204000 10 client.0 _ll_register_callbacks cb 0x56116b986ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T14:43:50.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8512800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b877960 0x56116b9e15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:50.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8512800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b877960 0x56116b9e15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:55004/0 (socket says 172.21.15.78:55004) 2024-05-21T14:43:50.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8512800640 1 -- 172.21.15.78:0/1268268732 learned_addr learned my addr 172.21.15.78:0/1268268732 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:50.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8511400640 1 --2- 172.21.15.78:0/1268268732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b86ae60 0x56116b9d6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:50.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8511e00640 1 --2- 172.21.15.78:0/1268268732 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b46c280 0x56116b9d6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:50.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8511400640 1 -- 172.21.15.78:0/1268268732 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b46c280 msgr2=0x56116b9d6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:50.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8511400640 1 --2- 172.21.15.78:0/1268268732 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b46c280 0x56116b9d6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:50.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8511400640 1 -- 172.21.15.78:0/1268268732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b877960 msgr2=0x56116b9e15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:50.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8511400640 1 --2- 172.21.15.78:0/1268268732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b877960 0x56116b9e15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:50.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8511400640 1 -- 172.21.15.78:0/1268268732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56116b770ea0 con 0x56116b86ae60 2024-05-21T14:43:50.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8512800640 1 --2- 172.21.15.78:0/1268268732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b877960 0x56116b9e15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:43:50.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8511400640 1 --2- 172.21.15.78:0/1268268732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b86ae60 0x56116b9d6950 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f850000e840 tx=0x7f850001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69dc817ef003208b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:50.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f84f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-05-21T14:43:50.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f84f2a00640 1 -- 172.21.15.78:0/1268268732 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850006e070 con 0x56116b86ae60 2024-05-21T14:43:50.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8520204000 1 -- 172.21.15.78:0/1268268732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f850005ef10 con 0x56116b86ae60 2024-05-21T14:43:50.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f84f2a00640 1 -- 172.21.15.78:0/1268268732 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f85000546d0 con 0x56116b86ae60 2024-05-21T14:43:50.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f84f2a00640 1 -- 172.21.15.78:0/1268268732 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f850005a170 con 0x56116b86ae60 2024-05-21T14:43:50.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8520204000 10 client.4686 fetch_fsmap learned FSMap version 16 2024-05-21T14:43:50.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8520204000 1 -- 172.21.15.78:0/1268268732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x56116b7b5780 con 0x56116b86ae60 2024-05-21T14:43:50.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f84f2a00640 1 -- 172.21.15.78:0/1268268732 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f850005ef10 con 0x56116b86ae60 2024-05-21T14:43:50.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f84f2a00640 1 -- 172.21.15.78:0/1268268732 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f85000557a0 con 0x56116b86ae60 2024-05-21T14:43:50.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8520204000 10 client.4686 fetch_fsmap finished waiting for FSMap version 16 2024-05-21T14:43:50.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8520204000 10 client.4686 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-21T14:43:50.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8520204000 20 client.4686 populate_metadata read hostname 'smithi078' 2024-05-21T14:43:50.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8520204000 1 --2- 172.21.15.78:0/1268268732 >> [v2:172.21.15.78:6834/3517628193,v1:172.21.15.78:6836/3517628193] conn(0x56116b4907d0 0x56116b9e22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:50.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8520204000 4 client.4686 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T14:43:50.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8520204000 1 -- 172.21.15.78:0/1268268732 --> [v2:172.21.15.78:6834/3517628193,v1:172.21.15.78:6836/3517628193] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56116b783ad0 con 0x56116b4907d0 2024-05-21T14:43:50.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8511e00640 1 --2- 172.21.15.78:0/1268268732 >> [v2:172.21.15.78:6834/3517628193,v1:172.21.15.78:6836/3517628193] conn(0x56116b4907d0 0x56116b9e22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:50.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f8511e00640 1 --2- 172.21.15.78:0/1268268732 >> [v2:172.21.15.78:6834/3517628193,v1:172.21.15.78:6836/3517628193] conn(0x56116b4907d0 0x56116b9e22f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f98bb923222480df server_cookie=75a412e4f71a661c in_seq=0 out_seq=0 2024-05-21T14:43:50.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:50.109+0000 7f84f2a00640 10 client.4686 ms_handle_connect on v2:172.21.15.78:6834/3517628193 2024-05-21T14:43:53.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.772+0000 7f84f2a00640 1 -- 172.21.15.78:0/1268268732 <== mds.4 v2:172.21.15.78:6834/3517628193 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56116b783ad0 con 0x56116b4907d0 2024-05-21T14:43:53.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.772+0000 7f84f2a00640 10 client.4686 handle_command_reply: tid=0 2024-05-21T14:43:53.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.772+0000 7f8520204000 1 client.4686 shutdown 2024-05-21T14:43:53.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.772+0000 7f8520204000 1 -- 172.21.15.78:0/1268268732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b86ae60 msgr2=0x56116b9d6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:53.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.772+0000 7f8520204000 1 --2- 172.21.15.78:0/1268268732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b86ae60 0x56116b9d6950 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f850000e840 tx=0x7f850001e040 comp rx=0 tx=0).stop 2024-05-21T14:43:53.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.772+0000 7f8520204000 1 -- 172.21.15.78:0/1268268732 shutdown_connections 2024-05-21T14:43:53.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.772+0000 7f8520204000 1 --2- 172.21.15.78:0/1268268732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b877960 0x56116b9e15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.772+0000 7f8520204000 1 --2- 172.21.15.78:0/1268268732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b86ae60 0x56116b9d6950 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.772+0000 7f8520204000 1 --2- 172.21.15.78:0/1268268732 >> [v2:172.21.15.78:6834/3517628193,v1:172.21.15.78:6836/3517628193] conn(0x56116b4907d0 0x56116b9e22f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.772+0000 7f8520204000 1 --2- 172.21.15.78:0/1268268732 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b46c280 0x56116b9d6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.772+0000 7f8520204000 1 -- 172.21.15.78:0/1268268732 >> 172.21.15.78:0/1268268732 conn(0x56116b8b54e0 msgr2=0x56116b9a1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:53.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.772+0000 7f84f2a00640 0 client.4686 ms_handle_reset on v2:172.21.15.78:6834/3517628193 2024-05-21T14:43:53.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.772+0000 7f8520204000 1 -- 172.21.15.78:0/1268268732 shutdown_connections 2024-05-21T14:43:53.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.772+0000 7f8520204000 1 -- 172.21.15.78:0/1268268732 wait complete. 2024-05-21T14:43:53.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.772+0000 7f8520204000 20 client.4686 trim_cache size 0 max 16384 2024-05-21T14:43:53.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.792+0000 7f8520204000 1 Processor -- start 2024-05-21T14:43:53.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.792+0000 7f8520204000 1 -- start start 2024-05-21T14:43:53.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.792+0000 7f8520204000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b46c280 0x56116b9e04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.792+0000 7f8520204000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b86ae60 0x56116b9e0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.792+0000 7f8520204000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b877960 0x56116b9ec5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.792+0000 7f8520204000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56116b7ed270 con 0x56116b46c280 2024-05-21T14:43:53.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.792+0000 7f8520204000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56116b770910 con 0x56116b86ae60 2024-05-21T14:43:53.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.792+0000 7f8520204000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x56116b7b0940 con 0x56116b877960 2024-05-21T14:43:53.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8511e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b46c280 0x56116b9e04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8511e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b46c280 0x56116b9e04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35152/0 (socket says 172.21.15.78:35152) 2024-05-21T14:43:53.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8511e00640 1 -- 172.21.15.78:0/776391806 learned_addr learned my addr 172.21.15.78:0/776391806 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:53.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8511400640 1 --2- 172.21.15.78:0/776391806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b86ae60 0x56116b9e0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8512800640 1 --2- 172.21.15.78:0/776391806 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b877960 0x56116b9ec5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8511e00640 1 -- 172.21.15.78:0/776391806 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b877960 msgr2=0x56116b9ec5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:53.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8511e00640 1 --2- 172.21.15.78:0/776391806 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b877960 0x56116b9ec5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8511e00640 1 -- 172.21.15.78:0/776391806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b86ae60 msgr2=0x56116b9e0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:53.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8511e00640 1 --2- 172.21.15.78:0/776391806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b86ae60 0x56116b9e0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8511e00640 1 -- 172.21.15.78:0/776391806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56116b841d30 con 0x56116b46c280 2024-05-21T14:43:53.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8511e00640 1 --2- 172.21.15.78:0/776391806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b46c280 0x56116b9e04f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f85140c7410 tx=0x7f8504012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3398f848317b2f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:53.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f84fdc00640 1 -- 172.21.15.78:0/776391806 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504028290 con 0x56116b46c280 2024-05-21T14:43:53.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f84fdc00640 1 -- 172.21.15.78:0/776391806 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8504028430 con 0x56116b46c280 2024-05-21T14:43:53.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f84fdc00640 1 -- 172.21.15.78:0/776391806 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85040287e0 con 0x56116b46c280 2024-05-21T14:43:53.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8520204000 1 -- 172.21.15.78:0/776391806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b46c280 msgr2=0x56116b9e04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:53.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8520204000 1 --2- 172.21.15.78:0/776391806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b46c280 0x56116b9e04f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f85140c7410 tx=0x7f8504012000 comp rx=0 tx=0).stop 2024-05-21T14:43:53.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8520204000 1 -- 172.21.15.78:0/776391806 shutdown_connections 2024-05-21T14:43:53.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8520204000 1 --2- 172.21.15.78:0/776391806 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b877960 0x56116b9ec5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8520204000 1 --2- 172.21.15.78:0/776391806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b86ae60 0x56116b9e0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8520204000 1 --2- 172.21.15.78:0/776391806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b46c280 0x56116b9e04f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8520204000 1 -- 172.21.15.78:0/776391806 >> 172.21.15.78:0/776391806 conn(0x56116b8b54e0 msgr2=0x56116b9dfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:53.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8520204000 1 -- 172.21.15.78:0/776391806 shutdown_connections 2024-05-21T14:43:53.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8520204000 1 -- 172.21.15.78:0/776391806 wait complete. 2024-05-21T14:43:53.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8520204000 1 -- start start 2024-05-21T14:43:53.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.796+0000 7f8520204000 1 Processor -- start 2024-05-21T14:43:53.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b46c280 0x56116b9f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b86ae60 0x56116b9f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b877960 0x56116b9f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56116b78e830 con 0x56116b877960 2024-05-21T14:43:53.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56116b7e7f50 con 0x56116b46c280 2024-05-21T14:43:53.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x56116b7807d0 con 0x56116b86ae60 2024-05-21T14:43:53.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 10 client.0 _ll_register_callbacks cb 0x7f8500055e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T14:43:53.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8512800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b877960 0x56116b9f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8512800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b877960 0x56116b9f54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35164/0 (socket says 172.21.15.78:35164) 2024-05-21T14:43:53.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8512800640 1 -- 172.21.15.78:0/2504310627 learned_addr learned my addr 172.21.15.78:0/2504310627 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:53.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8511e00640 1 --2- 172.21.15.78:0/2504310627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b46c280 0x56116b9f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8511400640 1 --2- 172.21.15.78:0/2504310627 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b86ae60 0x56116b9f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8512800640 1 -- 172.21.15.78:0/2504310627 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b86ae60 msgr2=0x56116b9f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:53.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8512800640 1 --2- 172.21.15.78:0/2504310627 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b86ae60 0x56116b9f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8512800640 1 -- 172.21.15.78:0/2504310627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b46c280 msgr2=0x56116b9f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:53.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8512800640 1 --2- 172.21.15.78:0/2504310627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b46c280 0x56116b9f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8512800640 1 -- 172.21.15.78:0/2504310627 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56116b777b80 con 0x56116b877960 2024-05-21T14:43:53.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8511e00640 1 --2- 172.21.15.78:0/2504310627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b46c280 0x56116b9f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:53.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8512800640 1 --2- 172.21.15.78:0/2504310627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b877960 0x56116b9f54f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f850c098350 tx=0x7f850c004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e148ead0ef404afd server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:53.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f84f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-05-21T14:43:53.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f84f2a00640 1 -- 172.21.15.78:0/2504310627 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c0b2040 con 0x56116b877960 2024-05-21T14:43:53.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f84f2a00640 1 -- 172.21.15.78:0/2504310627 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f850c0c5ad0 con 0x56116b877960 2024-05-21T14:43:53.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 -- 172.21.15.78:0/2504310627 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8504028430 con 0x56116b877960 2024-05-21T14:43:53.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f84f2a00640 1 -- 172.21.15.78:0/2504310627 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f850c0c5cd0 con 0x56116b877960 2024-05-21T14:43:53.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 10 client.4692 fetch_fsmap learned FSMap version 16 2024-05-21T14:43:53.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 -- 172.21.15.78:0/2504310627 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x56116b78eef0 con 0x56116b877960 2024-05-21T14:43:53.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f84f2a00640 1 -- 172.21.15.78:0/2504310627 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8504028430 con 0x56116b877960 2024-05-21T14:43:53.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f84f2a00640 1 -- 172.21.15.78:0/2504310627 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f850c0c5020 con 0x56116b877960 2024-05-21T14:43:53.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 10 client.4692 fetch_fsmap finished waiting for FSMap version 16 2024-05-21T14:43:53.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 10 client.4692 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-21T14:43:53.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 20 client.4692 populate_metadata read hostname 'smithi078' 2024-05-21T14:43:53.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 --2- 172.21.15.78:0/2504310627 >> [v2:172.21.15.78:6834/3517628193,v1:172.21.15.78:6836/3517628193] conn(0x56116b47e830 0x56116b9f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 4 client.4692 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T14:43:53.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 -- 172.21.15.78:0/2504310627 --> [v2:172.21.15.78:6834/3517628193,v1:172.21.15.78:6836/3517628193] -- command(tid 0: {"prefix": "status"}) -- 0x56116b7f6370 con 0x56116b47e830 2024-05-21T14:43:53.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8511e00640 1 --2- 172.21.15.78:0/2504310627 >> [v2:172.21.15.78:6834/3517628193,v1:172.21.15.78:6836/3517628193] conn(0x56116b47e830 0x56116b9f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f84f2a00640 10 client.4692 ms_handle_connect on v2:172.21.15.78:6834/3517628193 2024-05-21T14:43:53.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8511e00640 1 --2- 172.21.15.78:0/2504310627 >> [v2:172.21.15.78:6834/3517628193,v1:172.21.15.78:6836/3517628193] conn(0x56116b47e830 0x56116b9f5e80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=431fd2ba30096337 server_cookie=4a040b0576d0945 in_seq=0 out_seq=0 2024-05-21T14:43:53.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f84f2a00640 1 -- 172.21.15.78:0/2504310627 <== mds.4 v2:172.21.15.78:6834/3517628193 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x56116b7f6370 con 0x56116b47e830 2024-05-21T14:43:53.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f84f2a00640 10 client.4692 handle_command_reply: tid=0 2024-05-21T14:43:53.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 client.4692 shutdown 2024-05-21T14:43:53.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 -- 172.21.15.78:0/2504310627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b877960 msgr2=0x56116b9f54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:53.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 --2- 172.21.15.78:0/2504310627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b877960 0x56116b9f54f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f850c098350 tx=0x7f850c004a50 comp rx=0 tx=0).stop 2024-05-21T14:43:53.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 -- 172.21.15.78:0/2504310627 shutdown_connections 2024-05-21T14:43:53.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 --2- 172.21.15.78:0/2504310627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56116b877960 0x56116b9f54f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 --2- 172.21.15.78:0/2504310627 >> [v2:172.21.15.78:6834/3517628193,v1:172.21.15.78:6836/3517628193] conn(0x56116b47e830 0x56116b9f5e80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 --2- 172.21.15.78:0/2504310627 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56116b86ae60 0x56116b9f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 --2- 172.21.15.78:0/2504310627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56116b46c280 0x56116b9f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f8520204000 1 -- 172.21.15.78:0/2504310627 >> 172.21.15.78:0/2504310627 conn(0x56116b8b54e0 msgr2=0x56116b9e0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:53.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.800+0000 7f84f2a00640 0 client.4692 ms_handle_reset on v2:172.21.15.78:6834/3517628193 2024-05-21T14:43:53.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.804+0000 7f8520204000 1 -- 172.21.15.78:0/2504310627 shutdown_connections 2024-05-21T14:43:53.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.804+0000 7f8520204000 1 -- 172.21.15.78:0/2504310627 wait complete. 2024-05-21T14:43:53.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.804+0000 7f8520204000 20 client.4692 trim_cache size 0 max 16384 2024-05-21T14:43:53.815 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-05-21T14:43:53.815 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa", 2024-05-21T14:43:53.815 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 4, 2024-05-21T14:43:53.815 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4272, 2024-05-21T14:43:53.815 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-05-21T14:43:53.815 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-05-21T14:43:53.815 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-05-21T14:43:53.815 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 11.05052356, 2024-05-21T14:43:53.815 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 16, 2024-05-21T14:43:53.815 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 23, 2024-05-21T14:43:53.815 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 23, 2024-05-21T14:43:53.815 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 41.488891996 2024-05-21T14:43:53.815 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-05-21T14:43:53.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.804+0000 7f8518c00640 1 -- 172.21.15.78:0/1850405620 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f84f40678c0 msgr2=0x7f84f4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:53.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.804+0000 7f8518c00640 1 --2- 172.21.15.78:0/1850405620 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f84f40678c0 0x7f84f4069dd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8504007fd0 tx=0x7f8504000bd0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.804+0000 7f8518c00640 1 -- 172.21.15.78:0/1850405620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85140c6540 msgr2=0x7f85141635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:53.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.804+0000 7f8518c00640 1 --2- 172.21.15.78:0/1850405620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85140c6540 0x7f85141635d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f850000e870 tx=0x7f850000ec70 comp rx=0 tx=0).stop 2024-05-21T14:43:53.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.804+0000 7f8518c00640 1 -- 172.21.15.78:0/1850405620 shutdown_connections 2024-05-21T14:43:53.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.804+0000 7f8518c00640 1 --2- 172.21.15.78:0/1850405620 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f84f40678c0 0x7f84f4069dd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.804+0000 7f8518c00640 1 --2- 172.21.15.78:0/1850405620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85140c7f90 0x7f851414a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.804+0000 7f8518c00640 1 --2- 172.21.15.78:0/1850405620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85140c6540 0x7f85141635d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.804+0000 7f8518c00640 1 --2- 172.21.15.78:0/1850405620 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f85140c5c30 0x7f85141f51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.804+0000 7f8518c00640 1 -- 172.21.15.78:0/1850405620 >> 172.21.15.78:0/1850405620 conn(0x7f85140cd1e0 msgr2=0x7f851414e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:53.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.804+0000 7f8518c00640 1 -- 172.21.15.78:0/1850405620 shutdown_connections 2024-05-21T14:43:53.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.804+0000 7f8518c00640 1 -- 172.21.15.78:0/1850405620 wait complete. 2024-05-21T14:43:53.831 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-05-21T14:43:53.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.968+0000 7fadd3000640 1 Processor -- start 2024-05-21T14:43:53.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.968+0000 7fadd3000640 1 -- start start 2024-05-21T14:43:53.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadd3000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fadcc1538d0 0x7fadcc0735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadd3000640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadcc0c7240 con 0x7fadcc0c7f90 2024-05-21T14:43:53.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadd3000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadcc0c6c50 con 0x7fadcc0c5c30 2024-05-21T14:43:53.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadd3000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fadcc0c4370 con 0x7fadcc1538d0 2024-05-21T14:43:53.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcb400640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fadcc0c7f90 0x7fadcc0c6540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36980/0 (socket says 172.21.15.78:36980) 2024-05-21T14:43:53.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcb400640 1 -- 172.21.15.78:0/2357433783 learned_addr learned my addr 172.21.15.78:0/2357433783 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:53.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadd1000640 1 --2- 172.21.15.78:0/2357433783 >> v2:172.21.15.84:3300/0 conn(0x7fadcc1538d0 0x7fadcc0735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcaa00640 1 -- 172.21.15.78:0/2357433783 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 604206171 0 0) 0x7fadcc0c7240 con 0x7fadcc0c7f90 2024-05-21T14:43:53.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcaa00640 1 -- 172.21.15.78:0/2357433783 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadb0003530 con 0x7fadcc0c7f90 2024-05-21T14:43:53.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcaa00640 1 -- 172.21.15.78:0/2357433783 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 659547475 0 0) 0x7fadb0003530 con 0x7fadcc0c7f90 2024-05-21T14:43:53.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcaa00640 1 -- 172.21.15.78:0/2357433783 >> v2:172.21.15.84:3300/0 conn(0x7fadcc1538d0 msgr2=0x7fadcc0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:53.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcaa00640 1 --2- 172.21.15.78:0/2357433783 >> v2:172.21.15.84:3300/0 conn(0x7fadcc1538d0 0x7fadcc0735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcaa00640 1 -- 172.21.15.78:0/2357433783 >> v1:172.21.15.84:6789/0 conn(0x7fadcc0c5c30 legacy=0x7fadcc15cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:53.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcaa00640 1 -- 172.21.15.78:0/2357433783 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc0c74e0 con 0x7fadcc0c7f90 2024-05-21T14:43:53.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcaa00640 1 -- 172.21.15.78:0/2357433783 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7fadb8001680 con 0x7fadcc0c7f90 2024-05-21T14:43:53.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcaa00640 1 -- 172.21.15.78:0/2357433783 >> v1:172.21.15.78:6789/0 conn(0x7fadcc0c7f90 legacy=0x7fadcc0c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:53.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcaa00640 1 --2- 172.21.15.78:0/2357433783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb0003a30 0x7fadb0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcaa00640 1 --2- 172.21.15.78:0/2357433783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb0004810 0x7fadb0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcaa00640 1 --2- 172.21.15.78:0/2357433783 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fadb0005280 0x7fadb000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcaa00640 1 -- 172.21.15.78:0/2357433783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc0c4370 con 0x7fadb0004810 2024-05-21T14:43:53.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcaa00640 1 -- 172.21.15.78:0/2357433783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fadb000c1f0 con 0x7fadb0003a30 2024-05-21T14:43:53.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcaa00640 1 -- 172.21.15.78:0/2357433783 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fadb000c3f0 con 0x7fadb0005280 2024-05-21T14:43:53.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcb400640 1 --2- 172.21.15.78:0/2357433783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb0004810 0x7fadb0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcbe00640 1 --2- 172.21.15.78:0/2357433783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb0003a30 0x7fadb0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadd1000640 1 --2- 172.21.15.78:0/2357433783 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fadb0005280 0x7fadb000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcb400640 1 -- 172.21.15.78:0/2357433783 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fadb0005280 msgr2=0x7fadb000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:53.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcb400640 1 --2- 172.21.15.78:0/2357433783 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fadb0005280 0x7fadb000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcb400640 1 -- 172.21.15.78:0/2357433783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb0003a30 msgr2=0x7fadb0003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:53.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcb400640 1 --2- 172.21.15.78:0/2357433783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb0003a30 0x7fadb0003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcb400640 1 -- 172.21.15.78:0/2357433783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb0003530 con 0x7fadb0004810 2024-05-21T14:43:53.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadd1000640 1 -- 172.21.15.78:0/2357433783 reap_dead start 2024-05-21T14:43:53.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.972+0000 7fadcbe00640 1 --2- 172.21.15.78:0/2357433783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb0003a30 0x7fadb0003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:53.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.976+0000 7fadcb400640 1 --2- 172.21.15.78:0/2357433783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb0004810 0x7fadb0004c20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fadb800c190 tx=0x7fadb801f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ab8296739cf4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:53.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.976+0000 7fadcaa00640 1 -- 172.21.15.78:0/2357433783 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8007d00 con 0x7fadb0004810 2024-05-21T14:43:53.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.976+0000 7fadcaa00640 1 -- 172.21.15.78:0/2357433783 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb8005b00 con 0x7fadb0004810 2024-05-21T14:43:53.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.976+0000 7fadcaa00640 1 -- 172.21.15.78:0/2357433783 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8007070 con 0x7fadb0004810 2024-05-21T14:43:53.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.976+0000 7fadd3000640 1 -- 172.21.15.78:0/2357433783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb0004810 msgr2=0x7fadb0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:53.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.976+0000 7fadd3000640 1 --2- 172.21.15.78:0/2357433783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb0004810 0x7fadb0004c20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fadb800c190 tx=0x7fadb801f310 comp rx=0 tx=0).stop 2024-05-21T14:43:53.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.976+0000 7fadd3000640 1 -- 172.21.15.78:0/2357433783 shutdown_connections 2024-05-21T14:43:53.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.976+0000 7fadd3000640 1 --2- 172.21.15.78:0/2357433783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb0004810 0x7fadb0004c20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.976+0000 7fadd3000640 1 -- 172.21.15.78:0/2357433783 >> 172.21.15.78:0/2357433783 conn(0x7fadcc0cd1e0 msgr2=0x7fadcc0c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:53.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.976+0000 7fadd3000640 1 -- 172.21.15.78:0/2357433783 shutdown_connections 2024-05-21T14:43:53.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.976+0000 7fadd3000640 1 -- 172.21.15.78:0/2357433783 wait complete. 2024-05-21T14:43:53.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadd3000640 1 Processor -- start 2024-05-21T14:43:53.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadd3000640 1 -- start start 2024-05-21T14:43:53.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadd3000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb0004810 0x7fadcc1551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadd3000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadcc1522c0 0x7fadcc158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadd3000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fadcc1526d0 0x7fadcc159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadd3000640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc0c48a0 con 0x7fadcc1522c0 2024-05-21T14:43:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadd3000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc0c45c0 con 0x7fadb0004810 2024-05-21T14:43:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadd3000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc153ce0 con 0x7fadcc1526d0 2024-05-21T14:43:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadcb400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadcc1522c0 0x7fadcc158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadcb400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadcc1522c0 0x7fadcc158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35180/0 (socket says 172.21.15.78:35180) 2024-05-21T14:43:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadcb400640 1 -- 172.21.15.78:0/1290890701 learned_addr learned my addr 172.21.15.78:0/1290890701 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadcbe00640 1 --2- 172.21.15.78:0/1290890701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb0004810 0x7fadcc1551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadd1000640 1 --2- 172.21.15.78:0/1290890701 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fadcc1526d0 0x7fadcc159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadcb400640 1 -- 172.21.15.78:0/1290890701 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fadcc1526d0 msgr2=0x7fadcc159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadcb400640 1 --2- 172.21.15.78:0/1290890701 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fadcc1526d0 0x7fadcc159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadcb400640 1 -- 172.21.15.78:0/1290890701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb0004810 msgr2=0x7fadcc1551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadcb400640 1 --2- 172.21.15.78:0/1290890701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb0004810 0x7fadcc1551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadcb400640 1 -- 172.21.15.78:0/1290890701 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc1556f0 con 0x7fadcc1522c0 2024-05-21T14:43:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadd1000640 1 --2- 172.21.15.78:0/1290890701 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fadcc1526d0 0x7fadcc159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadcb400640 1 --2- 172.21.15.78:0/1290890701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadcc1522c0 0x7fadcc158b50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fadb801f140 tx=0x7fadb0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadc3e00640 1 -- 172.21.15.78:0/1290890701 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8001c40 con 0x7fadcc1522c0 2024-05-21T14:43:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadc3e00640 1 -- 172.21.15.78:0/1290890701 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb8000ee0 con 0x7fadcc1522c0 2024-05-21T14:43:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadc3e00640 1 -- 172.21.15.78:0/1290890701 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8007d00 con 0x7fadcc1522c0 2024-05-21T14:43:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadd3000640 1 -- 172.21.15.78:0/1290890701 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc155900 con 0x7fadcc1522c0 2024-05-21T14:43:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.980+0000 7fadd3000640 1 -- 172.21.15.78:0/1290890701 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc1543f0 con 0x7fadcc1522c0 2024-05-21T14:43:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.984+0000 7fadc3e00640 1 -- 172.21.15.78:0/1290890701 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fadb8001480 con 0x7fadcc1522c0 2024-05-21T14:43:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.984+0000 7fadc3e00640 1 --2- 172.21.15.78:0/1290890701 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fadac0678c0 0x7fadac069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.984+0000 7fadc3e00640 1 -- 172.21.15.78:0/1290890701 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fadb8122ea0 con 0x7fadcc1522c0 2024-05-21T14:43:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.984+0000 7fadda734000 1 Processor -- start 2024-05-21T14:43:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.984+0000 7fadda734000 1 -- start start 2024-05-21T14:43:53.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.984+0000 7fadcbe00640 1 --2- 172.21.15.78:0/1290890701 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fadac0678c0 0x7fadac069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadcbe00640 1 --2- 172.21.15.78:0/1290890701 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fadac0678c0 0x7fadac069dd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fadbc000c10 tx=0x7fadbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadda734000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61550960 0x556c616b0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadda734000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61543e60 0x556c616b5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadda734000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61145280 0x556c616b5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadda734000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556c614c1c40 con 0x556c61543e60 2024-05-21T14:43:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadda734000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556c6145eaa0 con 0x556c61145280 2024-05-21T14:43:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadda734000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x556c614bdc00 con 0x556c61550960 2024-05-21T14:43:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadcb400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61543e60 0x556c616b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadcb400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61543e60 0x556c616b5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35182/0 (socket says 172.21.15.78:35182) 2024-05-21T14:43:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadcb400640 1 -- 172.21.15.78:0/1585204447 learned_addr learned my addr 172.21.15.78:0/1585204447 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadcbe00640 1 --2- 172.21.15.78:0/1585204447 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61550960 0x556c616b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadd1000640 1 --2- 172.21.15.78:0/1585204447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61145280 0x556c616b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadcb400640 1 -- 172.21.15.78:0/1585204447 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61550960 msgr2=0x556c616b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadcb400640 1 --2- 172.21.15.78:0/1585204447 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61550960 0x556c616b0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadcb400640 1 -- 172.21.15.78:0/1585204447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61145280 msgr2=0x556c616b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadcb400640 1 --2- 172.21.15.78:0/1585204447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61145280 0x556c616b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadcb400640 1 -- 172.21.15.78:0/1585204447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c61448b40 con 0x556c61543e60 2024-05-21T14:43:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadd1000640 1 --2- 172.21.15.78:0/1585204447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61145280 0x556c616b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:43:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadcb400640 1 --2- 172.21.15.78:0/1585204447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61543e60 0x556c616b5300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fadb801fbb0 tx=0x7fadb80f3270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cd28e6d13d186d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadc0c00640 1 -- 172.21.15.78:0/1585204447 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb80c0050 con 0x556c61543e60 2024-05-21T14:43:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadc0c00640 1 -- 172.21.15.78:0/1585204447 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb80f1250 con 0x556c61543e60 2024-05-21T14:43:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadc0c00640 1 -- 172.21.15.78:0/1585204447 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb80ef820 con 0x556c61543e60 2024-05-21T14:43:53.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadda734000 1 -- 172.21.15.78:0/1585204447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61543e60 msgr2=0x556c616b5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadda734000 1 --2- 172.21.15.78:0/1585204447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61543e60 0x556c616b5300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fadb801fbb0 tx=0x7fadb80f3270 comp rx=0 tx=0).stop 2024-05-21T14:43:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadda734000 1 -- 172.21.15.78:0/1585204447 shutdown_connections 2024-05-21T14:43:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadda734000 1 --2- 172.21.15.78:0/1585204447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61145280 0x556c616b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadda734000 1 --2- 172.21.15.78:0/1585204447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61543e60 0x556c616b5300 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadda734000 1 --2- 172.21.15.78:0/1585204447 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61550960 0x556c616b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadda734000 1 -- 172.21.15.78:0/1585204447 >> 172.21.15.78:0/1585204447 conn(0x556c6158e4e0 msgr2=0x556c616b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadda734000 1 -- 172.21.15.78:0/1585204447 shutdown_connections 2024-05-21T14:43:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadda734000 1 -- 172.21.15.78:0/1585204447 wait complete. 2024-05-21T14:43:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.988+0000 7fadda734000 1 -- start start 2024-05-21T14:43:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadda734000 1 Processor -- start 2024-05-21T14:43:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadda734000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61145280 0x556c61675110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadda734000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61543e60 0x556c61675650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadda734000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61550960 0x556c61675b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadda734000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556c61449910 con 0x556c61145280 2024-05-21T14:43:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadda734000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556c6147f020 con 0x556c61550960 2024-05-21T14:43:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadda734000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x556c614c1c40 con 0x556c61543e60 2024-05-21T14:43:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadda734000 10 client.0 _ll_register_callbacks cb 0x556c6165fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T14:43:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadcbe00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61145280 0x556c61675110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadcbe00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61145280 0x556c61675110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35186/0 (socket says 172.21.15.78:35186) 2024-05-21T14:43:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadcbe00640 1 -- 172.21.15.78:0/830652140 learned_addr learned my addr 172.21.15.78:0/830652140 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadcb400640 1 --2- 172.21.15.78:0/830652140 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61543e60 0x556c61675650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadd1000640 1 --2- 172.21.15.78:0/830652140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61550960 0x556c61675b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadcbe00640 1 -- 172.21.15.78:0/830652140 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61543e60 msgr2=0x556c61675650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadcbe00640 1 --2- 172.21.15.78:0/830652140 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61543e60 0x556c61675650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadcbe00640 1 -- 172.21.15.78:0/830652140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61550960 msgr2=0x556c61675b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadcbe00640 1 --2- 172.21.15.78:0/830652140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61550960 0x556c61675b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadcbe00640 1 -- 172.21.15.78:0/830652140 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c61449ea0 con 0x556c61145280 2024-05-21T14:43:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadd1000640 1 --2- 172.21.15.78:0/830652140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61550960 0x556c61675b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:43:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadcbe00640 1 --2- 172.21.15.78:0/830652140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61145280 0x556c61675110 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fadbc015480 tx=0x7fadbc001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245c8b4a5e07c9fc server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadb5600640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-05-21T14:43:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadb5600640 1 -- 172.21.15.78:0/830652140 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc026020 con 0x556c61145280 2024-05-21T14:43:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadb5600640 1 -- 172.21.15.78:0/830652140 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fadbc022640 con 0x556c61145280 2024-05-21T14:43:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadda734000 1 -- 172.21.15.78:0/830652140 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadb80f1250 con 0x556c61145280 2024-05-21T14:43:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadb5600640 1 -- 172.21.15.78:0/830652140 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fadbc030050 con 0x556c61145280 2024-05-21T14:43:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadda734000 10 client.4704 fetch_fsmap learned FSMap version 16 2024-05-21T14:43:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadda734000 1 -- 172.21.15.78:0/830652140 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x556c6148e780 con 0x556c61145280 2024-05-21T14:43:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadb5600640 1 -- 172.21.15.78:0/830652140 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb80f1250 con 0x556c61145280 2024-05-21T14:43:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadb5600640 1 -- 172.21.15.78:0/830652140 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7fadbc033020 con 0x556c61145280 2024-05-21T14:43:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadda734000 10 client.4704 fetch_fsmap finished waiting for FSMap version 16 2024-05-21T14:43:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadda734000 10 client.4704 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-21T14:43:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadda734000 20 client.4704 populate_metadata read hostname 'smithi078' 2024-05-21T14:43:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadda734000 1 --2- 172.21.15.78:0/830652140 >> [v2:172.21.15.84:6834/3155872080,v1:172.21.15.84:6835/3155872080] conn(0x556c611697d0 0x556c616c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadda734000 4 client.4704 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T14:43:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.992+0000 7fadda734000 1 -- 172.21.15.78:0/830652140 --> [v2:172.21.15.84:6834/3155872080,v1:172.21.15.84:6835/3155872080] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c6145cad0 con 0x556c611697d0 2024-05-21T14:43:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.996+0000 7fadcb400640 1 --2- 172.21.15.78:0/830652140 >> [v2:172.21.15.84:6834/3155872080,v1:172.21.15.84:6835/3155872080] conn(0x556c611697d0 0x556c616c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.996+0000 7fadcb400640 1 --2- 172.21.15.78:0/830652140 >> [v2:172.21.15.84:6834/3155872080,v1:172.21.15.84:6835/3155872080] conn(0x556c611697d0 0x556c616c9d60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=54cecd73d6eb1d1f server_cookie=9ddcb557929ae0e9 in_seq=0 out_seq=0 2024-05-21T14:43:54.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:53.996+0000 7fadb5600640 10 client.4704 ms_handle_connect on v2:172.21.15.84:6834/3155872080 2024-05-21T14:43:54.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.312+0000 7fadb5600640 1 -- 172.21.15.78:0/830652140 <== mds.3 v2:172.21.15.84:6834/3155872080 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556c6145cad0 con 0x556c611697d0 2024-05-21T14:43:54.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.312+0000 7fadb5600640 10 client.4704 handle_command_reply: tid=0 2024-05-21T14:43:54.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.312+0000 7fadda734000 1 client.4704 shutdown 2024-05-21T14:43:54.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.312+0000 7fadda734000 1 -- 172.21.15.78:0/830652140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61145280 msgr2=0x556c61675110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.312+0000 7fadda734000 1 --2- 172.21.15.78:0/830652140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61145280 0x556c61675110 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fadbc015480 tx=0x7fadbc001130 comp rx=0 tx=0).stop 2024-05-21T14:43:54.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.312+0000 7fadda734000 1 -- 172.21.15.78:0/830652140 shutdown_connections 2024-05-21T14:43:54.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.312+0000 7fadda734000 1 --2- 172.21.15.78:0/830652140 >> [v2:172.21.15.84:6834/3155872080,v1:172.21.15.84:6835/3155872080] conn(0x556c611697d0 0x556c616c9d60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.312+0000 7fadda734000 1 --2- 172.21.15.78:0/830652140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61550960 0x556c61675b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.312+0000 7fadda734000 1 --2- 172.21.15.78:0/830652140 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61543e60 0x556c61675650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.312+0000 7fadda734000 1 --2- 172.21.15.78:0/830652140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61145280 0x556c61675110 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.312+0000 7fadda734000 1 -- 172.21.15.78:0/830652140 >> 172.21.15.78:0/830652140 conn(0x556c6158e4e0 msgr2=0x556c616b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.312+0000 7fadb5600640 0 client.4704 ms_handle_reset on v2:172.21.15.84:6834/3155872080 2024-05-21T14:43:54.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.312+0000 7fadda734000 1 -- 172.21.15.78:0/830652140 shutdown_connections 2024-05-21T14:43:54.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.312+0000 7fadda734000 1 -- 172.21.15.78:0/830652140 wait complete. 2024-05-21T14:43:54.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.312+0000 7fadda734000 20 client.4704 trim_cache size 0 max 16384 2024-05-21T14:43:54.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.332+0000 7fadda734000 1 Processor -- start 2024-05-21T14:43:54.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.332+0000 7fadda734000 1 -- start start 2024-05-21T14:43:54.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.332+0000 7fadda734000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61543e60 0x556c61728010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.332+0000 7fadda734000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61550960 0x556c61728550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.332+0000 7fadda734000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61182e80 0x556c61728a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.332+0000 7fadda734000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc14b2f0 con 0x556c61182e80 2024-05-21T14:43:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.332+0000 7fadda734000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556c61489940 con 0x556c61543e60 2024-05-21T14:43:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.332+0000 7fadda734000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x556c614597d0 con 0x556c61550960 2024-05-21T14:43:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.332+0000 7fadd1000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61182e80 0x556c61728a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.332+0000 7fadd1000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61182e80 0x556c61728a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35202/0 (socket says 172.21.15.78:35202) 2024-05-21T14:43:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.332+0000 7fadd1000640 1 -- 172.21.15.78:0/3360887728 learned_addr learned my addr 172.21.15.78:0/3360887728 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.332+0000 7fadcb400640 1 --2- 172.21.15.78:0/3360887728 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61550960 0x556c61728550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.332+0000 7fadcbe00640 1 --2- 172.21.15.78:0/3360887728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61543e60 0x556c61728010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadd1000640 1 -- 172.21.15.78:0/3360887728 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61550960 msgr2=0x556c61728550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadd1000640 1 --2- 172.21.15.78:0/3360887728 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61550960 0x556c61728550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadd1000640 1 -- 172.21.15.78:0/3360887728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61543e60 msgr2=0x556c61728010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadd1000640 1 --2- 172.21.15.78:0/3360887728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61543e60 0x556c61728010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadd1000640 1 -- 172.21.15.78:0/3360887728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c61672da0 con 0x556c61182e80 2024-05-21T14:43:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadcb400640 1 --2- 172.21.15.78:0/3360887728 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61550960 0x556c61728550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadd1000640 1 --2- 172.21.15.78:0/3360887728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61182e80 0x556c61728a90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0c64a0 tx=0x7fadc4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3b00acae68c47 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadb7e00640 1 -- 172.21.15.78:0/3360887728 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc401b020 con 0x556c61182e80 2024-05-21T14:43:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadb7e00640 1 -- 172.21.15.78:0/3360887728 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc4017470 con 0x556c61182e80 2024-05-21T14:43:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadb7e00640 1 -- 172.21.15.78:0/3360887728 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4017860 con 0x556c61182e80 2024-05-21T14:43:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadda734000 1 -- 172.21.15.78:0/3360887728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61182e80 msgr2=0x556c61728a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadda734000 1 --2- 172.21.15.78:0/3360887728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61182e80 0x556c61728a90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0c64a0 tx=0x7fadc4009750 comp rx=0 tx=0).stop 2024-05-21T14:43:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadda734000 1 -- 172.21.15.78:0/3360887728 shutdown_connections 2024-05-21T14:43:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadda734000 1 --2- 172.21.15.78:0/3360887728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61182e80 0x556c61728a90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadda734000 1 --2- 172.21.15.78:0/3360887728 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61550960 0x556c61728550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadda734000 1 --2- 172.21.15.78:0/3360887728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61543e60 0x556c61728010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadda734000 1 -- 172.21.15.78:0/3360887728 >> 172.21.15.78:0/3360887728 conn(0x556c6158e4e0 msgr2=0x556c616b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadda734000 1 -- 172.21.15.78:0/3360887728 shutdown_connections 2024-05-21T14:43:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadda734000 1 -- 172.21.15.78:0/3360887728 wait complete. 2024-05-21T14:43:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadda734000 1 -- start start 2024-05-21T14:43:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.336+0000 7fadda734000 1 Processor -- start 2024-05-21T14:43:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61182e80 0x556c61725ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61543e60 0x556c61726530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61550960 0x556c61726c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556c614c6270 con 0x556c61543e60 2024-05-21T14:43:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556c614c0f50 con 0x556c61550960 2024-05-21T14:43:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x556c61467830 con 0x556c61182e80 2024-05-21T14:43:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 10 client.0 _ll_register_callbacks cb 0x7fadbc0114f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T14:43:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadcb400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61543e60 0x556c61726530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadcb400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61543e60 0x556c61726530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35214/0 (socket says 172.21.15.78:35214) 2024-05-21T14:43:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadcb400640 1 -- 172.21.15.78:0/2764962392 learned_addr learned my addr 172.21.15.78:0/2764962392 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadd1000640 1 --2- 172.21.15.78:0/2764962392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61550960 0x556c61726c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadcbe00640 1 --2- 172.21.15.78:0/2764962392 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61182e80 0x556c61725ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadcb400640 1 -- 172.21.15.78:0/2764962392 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61182e80 msgr2=0x556c61725ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadcb400640 1 --2- 172.21.15.78:0/2764962392 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61182e80 0x556c61725ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadcb400640 1 -- 172.21.15.78:0/2764962392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61550960 msgr2=0x556c61726c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadcb400640 1 --2- 172.21.15.78:0/2764962392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61550960 0x556c61726c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadcb400640 1 -- 172.21.15.78:0/2764962392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c6151ad30 con 0x556c61543e60 2024-05-21T14:43:54.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadcb400640 1 --2- 172.21.15.78:0/2764962392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61543e60 0x556c61726530 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fadb8001980 tx=0x7fadb8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5289b3b752c634ce server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadb5600640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-05-21T14:43:54.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadb5600640 1 -- 172.21.15.78:0/2764962392 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb80c0040 con 0x556c61543e60 2024-05-21T14:43:54.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadb5600640 1 -- 172.21.15.78:0/2764962392 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fadb810b120 con 0x556c61543e60 2024-05-21T14:43:54.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 -- 172.21.15.78:0/2764962392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadc4017470 con 0x556c61543e60 2024-05-21T14:43:54.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadb5600640 1 -- 172.21.15.78:0/2764962392 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fadb81213b0 con 0x556c61543e60 2024-05-21T14:43:54.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 10 client.4710 fetch_fsmap learned FSMap version 16 2024-05-21T14:43:54.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 -- 172.21.15.78:0/2764962392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x556c61450b80 con 0x556c61543e60 2024-05-21T14:43:54.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadb5600640 1 -- 172.21.15.78:0/2764962392 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc4017470 con 0x556c61543e60 2024-05-21T14:43:54.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadb5600640 1 -- 172.21.15.78:0/2764962392 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7fadb80ef820 con 0x556c61543e60 2024-05-21T14:43:54.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 10 client.4710 fetch_fsmap finished waiting for FSMap version 16 2024-05-21T14:43:54.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 10 client.4710 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-21T14:43:54.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 20 client.4710 populate_metadata read hostname 'smithi078' 2024-05-21T14:43:54.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 --2- 172.21.15.78:0/2764962392 >> [v2:172.21.15.84:6834/3155872080,v1:172.21.15.84:6835/3155872080] conn(0x556c617275f0 0x556c61727a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 4 client.4710 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T14:43:54.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 -- 172.21.15.78:0/2764962392 --> [v2:172.21.15.84:6834/3155872080,v1:172.21.15.84:6835/3155872080] -- command(tid 0: {"prefix": "status"}) -- 0x556c614cf370 con 0x556c617275f0 2024-05-21T14:43:54.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadcbe00640 1 --2- 172.21.15.78:0/2764962392 >> [v2:172.21.15.84:6834/3155872080,v1:172.21.15.84:6835/3155872080] conn(0x556c617275f0 0x556c61727a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadcbe00640 1 --2- 172.21.15.78:0/2764962392 >> [v2:172.21.15.84:6834/3155872080,v1:172.21.15.84:6835/3155872080] conn(0x556c617275f0 0x556c61727a00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4e1f0c71f85945af server_cookie=59fc34c611e9f63 in_seq=0 out_seq=0 2024-05-21T14:43:54.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadb5600640 10 client.4710 ms_handle_connect on v2:172.21.15.84:6834/3155872080 2024-05-21T14:43:54.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadb5600640 1 -- 172.21.15.78:0/2764962392 <== mds.3 v2:172.21.15.84:6834/3155872080 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x556c614cf370 con 0x556c617275f0 2024-05-21T14:43:54.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadb5600640 10 client.4710 handle_command_reply: tid=0 2024-05-21T14:43:54.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 client.4710 shutdown 2024-05-21T14:43:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 -- 172.21.15.78:0/2764962392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61543e60 msgr2=0x556c61726530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 --2- 172.21.15.78:0/2764962392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61543e60 0x556c61726530 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fadb8001980 tx=0x7fadb8000bd0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 -- 172.21.15.78:0/2764962392 shutdown_connections 2024-05-21T14:43:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 --2- 172.21.15.78:0/2764962392 >> [v2:172.21.15.84:6834/3155872080,v1:172.21.15.84:6835/3155872080] conn(0x556c617275f0 0x556c61727a00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 --2- 172.21.15.78:0/2764962392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556c61550960 0x556c61726c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 --2- 172.21.15.78:0/2764962392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c61543e60 0x556c61726530 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadb5600640 0 client.4710 ms_handle_reset on v2:172.21.15.84:6834/3155872080 2024-05-21T14:43:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 --2- 172.21.15.78:0/2764962392 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x556c61182e80 0x556c61725ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 -- 172.21.15.78:0/2764962392 >> 172.21.15.78:0/2764962392 conn(0x556c6158e4e0 msgr2=0x556c61673890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 -- 172.21.15.78:0/2764962392 shutdown_connections 2024-05-21T14:43:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.340+0000 7fadda734000 1 -- 172.21.15.78:0/2764962392 wait complete. 2024-05-21T14:43:54.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.344+0000 7fadda734000 20 client.4710 trim_cache size 0 max 16384 2024-05-21T14:43:54.357 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-05-21T14:43:54.357 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa", 2024-05-21T14:43:54.357 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 3, 2024-05-21T14:43:54.357 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4294, 2024-05-21T14:43:54.357 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-05-21T14:43:54.357 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-05-21T14:43:54.357 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-05-21T14:43:54.357 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 17.615920694, 2024-05-21T14:43:54.357 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 16, 2024-05-21T14:43:54.357 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 23, 2024-05-21T14:43:54.357 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 23, 2024-05-21T14:43:54.357 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 42.060475453999999 2024-05-21T14:43:54.357 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-05-21T14:43:54.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.344+0000 7fadd3000640 1 -- 172.21.15.78:0/1290890701 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fadac0678c0 msgr2=0x7fadac069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.344+0000 7fadd3000640 1 --2- 172.21.15.78:0/1290890701 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fadac0678c0 0x7fadac069dd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fadbc000c10 tx=0x7fadbc009040 comp rx=0 tx=0).stop 2024-05-21T14:43:54.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.344+0000 7fadd3000640 1 -- 172.21.15.78:0/1290890701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadcc1522c0 msgr2=0x7fadcc158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.344+0000 7fadd3000640 1 --2- 172.21.15.78:0/1290890701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadcc1522c0 0x7fadcc158b50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fadb801f140 tx=0x7fadb0005840 comp rx=0 tx=0).stop 2024-05-21T14:43:54.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.344+0000 7fadd3000640 1 -- 172.21.15.78:0/1290890701 shutdown_connections 2024-05-21T14:43:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.344+0000 7fadd3000640 1 --2- 172.21.15.78:0/1290890701 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fadac0678c0 0x7fadac069dd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.344+0000 7fadd3000640 1 --2- 172.21.15.78:0/1290890701 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fadcc1526d0 0x7fadcc159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.344+0000 7fadd3000640 1 --2- 172.21.15.78:0/1290890701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadcc1522c0 0x7fadcc158b50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.344+0000 7fadd3000640 1 --2- 172.21.15.78:0/1290890701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadb0004810 0x7fadcc1551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.344+0000 7fadd3000640 1 -- 172.21.15.78:0/1290890701 >> 172.21.15.78:0/1290890701 conn(0x7fadcc0cd1e0 msgr2=0x7fadcc06f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.344+0000 7fadd3000640 1 -- 172.21.15.78:0/1290890701 shutdown_connections 2024-05-21T14:43:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.344+0000 7fadd3000640 1 -- 172.21.15.78:0/1290890701 wait complete. 2024-05-21T14:43:54.371 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-21T14:43:54.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.512+0000 7f1b2c600640 1 Processor -- start 2024-05-21T14:43:54.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.512+0000 7f1b2c600640 1 -- start start 2024-05-21T14:43:54.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.512+0000 7f1b2c600640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1b241527a0 0x7f1b240c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.512+0000 7f1b2c600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1b240c5980 0x7f1b24162e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.512+0000 7f1b2c600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b240737e0 con 0x7f1b240733d0 2024-05-21T14:43:54.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.512+0000 7f1b2c600640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f1b24072980 con 0x7f1b241527a0 2024-05-21T14:43:54.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.512+0000 7f1b2c600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f1b24072f40 con 0x7f1b240c5980 2024-05-21T14:43:54.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.512+0000 7f1b29200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1b241527a0 0x7f1b240c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.512+0000 7f1b29200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1b241527a0 0x7f1b240c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35216/0 (socket says 172.21.15.78:35216) 2024-05-21T14:43:54.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.512+0000 7f1b29200640 1 -- 172.21.15.78:0/3653214965 learned_addr learned my addr 172.21.15.78:0/3653214965 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.512+0000 7f1b2a600640 1 --2- 172.21.15.78:0/3653214965 >> v2:172.21.15.84:3300/0 conn(0x7f1b240c5980 0x7f1b24162e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.512+0000 7f1b29200640 1 -- 172.21.15.78:0/3653214965 >> v2:172.21.15.84:3300/0 conn(0x7f1b240c5980 msgr2=0x7f1b24162e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.512+0000 7f1b29200640 1 --2- 172.21.15.78:0/3653214965 >> v2:172.21.15.84:3300/0 conn(0x7f1b240c5980 0x7f1b24162e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.512+0000 7f1b29200640 1 -- 172.21.15.78:0/3653214965 >> v1:172.21.15.84:6789/0 conn(0x7f1b240733d0 legacy=0x7f1b24071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.512+0000 7f1b29200640 1 -- 172.21.15.78:0/3653214965 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b24073aa0 con 0x7f1b241527a0 2024-05-21T14:43:54.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.516+0000 7f1b29200640 1 --2- 172.21.15.78:0/3653214965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b241527a0 0x7f1b240c5440 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1b24072b00 tx=0x7f1b1001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79aba324801a9b19 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.516+0000 7f1b23e00640 1 -- 172.21.15.78:0/3653214965 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b100b5070 con 0x7f1b241527a0 2024-05-21T14:43:54.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.516+0000 7f1b23e00640 1 -- 172.21.15.78:0/3653214965 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b100a8a10 con 0x7f1b241527a0 2024-05-21T14:43:54.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.516+0000 7f1b23e00640 1 -- 172.21.15.78:0/3653214965 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b100a8de0 con 0x7f1b241527a0 2024-05-21T14:43:54.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.516+0000 7f1b2c600640 1 -- 172.21.15.78:0/3653214965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b241527a0 msgr2=0x7f1b240c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.516+0000 7f1b2c600640 1 --2- 172.21.15.78:0/3653214965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b241527a0 0x7f1b240c5440 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1b24072b00 tx=0x7f1b1001ed10 comp rx=0 tx=0).stop 2024-05-21T14:43:54.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.516+0000 7f1b2c600640 1 -- 172.21.15.78:0/3653214965 shutdown_connections 2024-05-21T14:43:54.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.516+0000 7f1b2c600640 1 --2- 172.21.15.78:0/3653214965 >> v2:172.21.15.84:3300/0 conn(0x7f1b240c5980 0x7f1b24162e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.516+0000 7f1b2c600640 1 --2- 172.21.15.78:0/3653214965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b241527a0 0x7f1b240c5440 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.516+0000 7f1b2c600640 1 -- 172.21.15.78:0/3653214965 >> 172.21.15.78:0/3653214965 conn(0x7f1b240cd1e0 msgr2=0x7f1b240c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.516+0000 7f1b2c600640 1 -- 172.21.15.78:0/3653214965 shutdown_connections 2024-05-21T14:43:54.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.516+0000 7f1b2c600640 1 -- 172.21.15.78:0/3653214965 wait complete. 2024-05-21T14:43:54.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b2c600640 1 Processor -- start 2024-05-21T14:43:54.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b2c600640 1 -- start start 2024-05-21T14:43:54.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b2c600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b240733d0 0x7f1b241563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b2c600640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1b240c5980 0x7f1b24157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b2c600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b241527a0 0x7f1b2414b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b2c600640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1b24072bd0 con 0x7f1b241527a0 2024-05-21T14:43:54.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b2c600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1b24074060 con 0x7f1b240733d0 2024-05-21T14:43:54.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b2c600640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1b240ca100 con 0x7f1b240c5980 2024-05-21T14:43:54.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b2a600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b241527a0 0x7f1b2414b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b2a600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b241527a0 0x7f1b2414b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35228/0 (socket says 172.21.15.78:35228) 2024-05-21T14:43:54.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b2a600640 1 -- 172.21.15.78:0/3027363679 learned_addr learned my addr 172.21.15.78:0/3027363679 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b29200640 1 --2- 172.21.15.78:0/3027363679 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1b240c5980 0x7f1b24157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b29c00640 1 --2- 172.21.15.78:0/3027363679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b240733d0 0x7f1b241563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b2a600640 1 -- 172.21.15.78:0/3027363679 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1b240c5980 msgr2=0x7f1b24157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b2a600640 1 --2- 172.21.15.78:0/3027363679 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1b240c5980 0x7f1b24157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b2a600640 1 -- 172.21.15.78:0/3027363679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b240733d0 msgr2=0x7f1b241563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b2a600640 1 --2- 172.21.15.78:0/3027363679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b240733d0 0x7f1b241563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.520+0000 7f1b2a600640 1 -- 172.21.15.78:0/3027363679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2406f4d0 con 0x7f1b241527a0 2024-05-21T14:43:54.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.524+0000 7f1b2a600640 1 --2- 172.21.15.78:0/3027363679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b241527a0 0x7f1b2414b350 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00bde0 tx=0x7f1b1c00e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.524+0000 7f1b21600640 1 -- 172.21.15.78:0/3027363679 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c01a070 con 0x7f1b241527a0 2024-05-21T14:43:54.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.524+0000 7f1b21600640 1 -- 172.21.15.78:0/3027363679 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1c00ed20 con 0x7f1b241527a0 2024-05-21T14:43:54.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.524+0000 7f1b21600640 1 -- 172.21.15.78:0/3027363679 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c00b3e0 con 0x7f1b241527a0 2024-05-21T14:43:54.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.524+0000 7f1b2c600640 1 -- 172.21.15.78:0/3027363679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b241578a0 con 0x7f1b241527a0 2024-05-21T14:43:54.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.524+0000 7f1b2c600640 1 -- 172.21.15.78:0/3027363679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b2406c240 con 0x7f1b241527a0 2024-05-21T14:43:54.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.524+0000 7f1b21600640 1 -- 172.21.15.78:0/3027363679 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b1c01d070 con 0x7f1b241527a0 2024-05-21T14:43:54.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.524+0000 7f1b21600640 1 --2- 172.21.15.78:0/3027363679 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1b040678c0 0x7f1b04069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.524+0000 7f1b21600640 1 -- 172.21.15.78:0/3027363679 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1b1c085ea0 con 0x7f1b241527a0 2024-05-21T14:43:54.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b29c00640 1 --2- 172.21.15.78:0/3027363679 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1b040678c0 0x7f1b04069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b33c98000 1 Processor -- start 2024-05-21T14:43:54.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b33c98000 1 -- start start 2024-05-21T14:43:54.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b29c00640 1 --2- 172.21.15.78:0/3027363679 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1b040678c0 0x7f1b04069dd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1b18000f70 tx=0x7f1b18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b33c98000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bf30960 0x55c36c090870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b33c98000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf23e60 0x55c36c095300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b33c98000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bb25280 0x55c36c095840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b33c98000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55c36bea1c40 con 0x55c36bf23e60 2024-05-21T14:43:54.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b33c98000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c36be3eaa0 con 0x55c36bf30960 2024-05-21T14:43:54.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b33c98000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x55c36be9dc00 con 0x55c36bb25280 2024-05-21T14:43:54.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b29200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf23e60 0x55c36c095300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b29200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf23e60 0x55c36c095300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35232/0 (socket says 172.21.15.78:35232) 2024-05-21T14:43:54.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b29200640 1 -- 172.21.15.78:0/1237144600 learned_addr learned my addr 172.21.15.78:0/1237144600 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b2a600640 1 --2- 172.21.15.78:0/1237144600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bb25280 0x55c36c095840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b29c00640 1 --2- 172.21.15.78:0/1237144600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bf30960 0x55c36c090870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b29200640 1 -- 172.21.15.78:0/1237144600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bb25280 msgr2=0x55c36c095840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b29200640 1 --2- 172.21.15.78:0/1237144600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bb25280 0x55c36c095840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b29200640 1 -- 172.21.15.78:0/1237144600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bf30960 msgr2=0x55c36c090870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b29200640 1 --2- 172.21.15.78:0/1237144600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bf30960 0x55c36c090870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b29200640 1 -- 172.21.15.78:0/1237144600 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c36be28b40 con 0x55c36bf23e60 2024-05-21T14:43:54.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b29200640 1 --2- 172.21.15.78:0/1237144600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf23e60 0x55c36c095300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b1001b920 tx=0x7f1b100aa070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6894bc27d7484d6f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b16000640 1 -- 172.21.15.78:0/1237144600 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b100b5040 con 0x55c36bf23e60 2024-05-21T14:43:54.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b16000640 1 -- 172.21.15.78:0/1237144600 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b100a8bd0 con 0x55c36bf23e60 2024-05-21T14:43:54.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b16000640 1 -- 172.21.15.78:0/1237144600 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b100bb440 con 0x55c36bf23e60 2024-05-21T14:43:54.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b33c98000 1 -- 172.21.15.78:0/1237144600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf23e60 msgr2=0x55c36c095300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b33c98000 1 --2- 172.21.15.78:0/1237144600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf23e60 0x55c36c095300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b1001b920 tx=0x7f1b100aa070 comp rx=0 tx=0).stop 2024-05-21T14:43:54.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b33c98000 1 -- 172.21.15.78:0/1237144600 shutdown_connections 2024-05-21T14:43:54.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b33c98000 1 --2- 172.21.15.78:0/1237144600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bb25280 0x55c36c095840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b33c98000 1 --2- 172.21.15.78:0/1237144600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf23e60 0x55c36c095300 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.528+0000 7f1b33c98000 1 --2- 172.21.15.78:0/1237144600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bf30960 0x55c36c090870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b33c98000 1 -- 172.21.15.78:0/1237144600 >> 172.21.15.78:0/1237144600 conn(0x55c36bf6e4e0 msgr2=0x55c36c0930c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b33c98000 1 -- 172.21.15.78:0/1237144600 shutdown_connections 2024-05-21T14:43:54.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b33c98000 1 -- 172.21.15.78:0/1237144600 wait complete. 2024-05-21T14:43:54.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b33c98000 1 -- start start 2024-05-21T14:43:54.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b33c98000 1 Processor -- start 2024-05-21T14:43:54.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b33c98000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bb25280 0x55c36c08f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b33c98000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bf23e60 0x55c36c09a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b33c98000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bf30960 0x55c36c09a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b33c98000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55c36be29910 con 0x55c36bb25280 2024-05-21T14:43:54.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b33c98000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c36be5f020 con 0x55c36bf23e60 2024-05-21T14:43:54.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b33c98000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x55c36be69940 con 0x55c36bf30960 2024-05-21T14:43:54.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b33c98000 10 client.0 _ll_register_callbacks cb 0x55c36c03fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T14:43:54.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b29c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bb25280 0x55c36c08f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b29c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bb25280 0x55c36c08f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35242/0 (socket says 172.21.15.78:35242) 2024-05-21T14:43:54.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b29c00640 1 -- 172.21.15.78:0/3856039361 learned_addr learned my addr 172.21.15.78:0/3856039361 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b29200640 1 --2- 172.21.15.78:0/3856039361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bf23e60 0x55c36c09a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b2a600640 1 --2- 172.21.15.78:0/3856039361 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bf30960 0x55c36c09a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b29c00640 1 -- 172.21.15.78:0/3856039361 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bf30960 msgr2=0x55c36c09a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b29c00640 1 --2- 172.21.15.78:0/3856039361 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bf30960 0x55c36c09a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b29c00640 1 -- 172.21.15.78:0/3856039361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bf23e60 msgr2=0x55c36c09a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b29c00640 1 --2- 172.21.15.78:0/3856039361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bf23e60 0x55c36c09a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b29c00640 1 -- 172.21.15.78:0/3856039361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c36be29ea0 con 0x55c36bb25280 2024-05-21T14:43:54.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b29c00640 1 --2- 172.21.15.78:0/3856039361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bb25280 0x55c36c08f830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b18003950 tx=0x7f1b18000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eefe99c8de4e1663 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b0aa00640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-05-21T14:43:54.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b0aa00640 1 -- 172.21.15.78:0/3856039361 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18027060 con 0x55c36bb25280 2024-05-21T14:43:54.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b0aa00640 1 -- 172.21.15.78:0/3856039361 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1b18010040 con 0x55c36bb25280 2024-05-21T14:43:54.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.532+0000 7f1b33c98000 1 -- 172.21.15.78:0/3856039361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b100a8bd0 con 0x55c36bb25280 2024-05-21T14:43:54.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.536+0000 7f1b0aa00640 1 -- 172.21.15.78:0/3856039361 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f1b1800ec30 con 0x55c36bb25280 2024-05-21T14:43:54.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.536+0000 7f1b33c98000 10 client.4722 fetch_fsmap learned FSMap version 16 2024-05-21T14:43:54.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.536+0000 7f1b33c98000 1 -- 172.21.15.78:0/3856039361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55c36be6e780 con 0x55c36bb25280 2024-05-21T14:43:54.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.536+0000 7f1b0aa00640 1 -- 172.21.15.78:0/3856039361 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b100a8bd0 con 0x55c36bb25280 2024-05-21T14:43:54.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.536+0000 7f1b0aa00640 1 -- 172.21.15.78:0/3856039361 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f1b1802e720 con 0x55c36bb25280 2024-05-21T14:43:54.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.536+0000 7f1b33c98000 10 client.4722 fetch_fsmap finished waiting for FSMap version 16 2024-05-21T14:43:54.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.536+0000 7f1b33c98000 10 client.4722 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-21T14:43:54.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.536+0000 7f1b33c98000 20 client.4722 populate_metadata read hostname 'smithi078' 2024-05-21T14:43:54.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.536+0000 7f1b33c98000 1 --2- 172.21.15.78:0/3856039361 >> [v2:172.21.15.84:6836/1750816366,v1:172.21.15.84:6838/1750816366] conn(0x55c36bb497d0 0x55c36c09b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.536+0000 7f1b33c98000 4 client.4722 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T14:43:54.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.536+0000 7f1b33c98000 1 -- 172.21.15.78:0/3856039361 --> [v2:172.21.15.84:6836/1750816366,v1:172.21.15.84:6838/1750816366] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c36be3cad0 con 0x55c36bb497d0 2024-05-21T14:43:54.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.536+0000 7f1b29200640 1 --2- 172.21.15.78:0/3856039361 >> [v2:172.21.15.84:6836/1750816366,v1:172.21.15.84:6838/1750816366] conn(0x55c36bb497d0 0x55c36c09b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.536+0000 7f1b0aa00640 10 client.4722 ms_handle_connect on v2:172.21.15.84:6836/1750816366 2024-05-21T14:43:54.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.536+0000 7f1b29200640 1 --2- 172.21.15.78:0/3856039361 >> [v2:172.21.15.84:6836/1750816366,v1:172.21.15.84:6838/1750816366] conn(0x55c36bb497d0 0x55c36c09b2f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7450e7af85f386c9 server_cookie=5eed64326ae63611 in_seq=0 out_seq=0 2024-05-21T14:43:54.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.540+0000 7f1b0aa00640 1 -- 172.21.15.78:0/3856039361 <== mds.2 v2:172.21.15.84:6836/1750816366 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c36be3cad0 con 0x55c36bb497d0 2024-05-21T14:43:54.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.540+0000 7f1b0aa00640 10 client.4722 handle_command_reply: tid=0 2024-05-21T14:43:54.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.540+0000 7f1b33c98000 1 client.4722 shutdown 2024-05-21T14:43:54.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.540+0000 7f1b33c98000 1 -- 172.21.15.78:0/3856039361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bb25280 msgr2=0x55c36c08f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.540+0000 7f1b33c98000 1 --2- 172.21.15.78:0/3856039361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bb25280 0x55c36c08f830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b18003950 tx=0x7f1b18000ee0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.540+0000 7f1b33c98000 1 -- 172.21.15.78:0/3856039361 shutdown_connections 2024-05-21T14:43:54.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.540+0000 7f1b33c98000 1 --2- 172.21.15.78:0/3856039361 >> [v2:172.21.15.84:6836/1750816366,v1:172.21.15.84:6838/1750816366] conn(0x55c36bb497d0 0x55c36c09b2f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.540+0000 7f1b33c98000 1 --2- 172.21.15.78:0/3856039361 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bf30960 0x55c36c09a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.540+0000 7f1b33c98000 1 --2- 172.21.15.78:0/3856039361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bf23e60 0x55c36c09a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.540+0000 7f1b33c98000 1 --2- 172.21.15.78:0/3856039361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bb25280 0x55c36c08f830 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.540+0000 7f1b0aa00640 0 client.4722 ms_handle_reset on v2:172.21.15.84:6836/1750816366 2024-05-21T14:43:54.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.540+0000 7f1b33c98000 1 -- 172.21.15.78:0/3856039361 >> 172.21.15.78:0/3856039361 conn(0x55c36bf6e4e0 msgr2=0x55c36c05a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.540+0000 7f1b33c98000 1 -- 172.21.15.78:0/3856039361 shutdown_connections 2024-05-21T14:43:54.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.540+0000 7f1b33c98000 1 -- 172.21.15.78:0/3856039361 wait complete. 2024-05-21T14:43:54.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.540+0000 7f1b33c98000 20 client.4722 trim_cache size 0 max 16384 2024-05-21T14:43:54.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.556+0000 7f1b33c98000 1 Processor -- start 2024-05-21T14:43:54.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.556+0000 7f1b33c98000 1 -- start start 2024-05-21T14:43:54.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b33c98000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bb25280 0x55c36c098de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b33c98000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bf23e60 0x55c36c099320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b33c98000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf30960 0x55c36c0a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b33c98000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1b241f1e40 con 0x55c36bf30960 2024-05-21T14:43:54.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b33c98000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c36bea6270 con 0x55c36bb25280 2024-05-21T14:43:54.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b33c98000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x55c36be47830 con 0x55c36bf23e60 2024-05-21T14:43:54.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b2a600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf30960 0x55c36c0a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b2a600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf30960 0x55c36c0a53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35258/0 (socket says 172.21.15.78:35258) 2024-05-21T14:43:54.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b2a600640 1 -- 172.21.15.78:0/973833379 learned_addr learned my addr 172.21.15.78:0/973833379 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b29200640 1 --2- 172.21.15.78:0/973833379 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bf23e60 0x55c36c099320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b29c00640 1 --2- 172.21.15.78:0/973833379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bb25280 0x55c36c098de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b2a600640 1 -- 172.21.15.78:0/973833379 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bf23e60 msgr2=0x55c36c099320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b2a600640 1 --2- 172.21.15.78:0/973833379 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bf23e60 0x55c36c099320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b2a600640 1 -- 172.21.15.78:0/973833379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bb25280 msgr2=0x55c36c098de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b2a600640 1 --2- 172.21.15.78:0/973833379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bb25280 0x55c36c098de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b2a600640 1 -- 172.21.15.78:0/973833379 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c36befad30 con 0x55c36bf30960 2024-05-21T14:43:54.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b2a600640 1 --2- 172.21.15.78:0/973833379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf30960 0x55c36c0a53b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c052730 tx=0x7f1b1c056b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3302bbce24e56b2b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b15600640 1 -- 172.21.15.78:0/973833379 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c05eeb0 con 0x55c36bf30960 2024-05-21T14:43:54.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b15600640 1 -- 172.21.15.78:0/973833379 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1c0545d0 con 0x55c36bf30960 2024-05-21T14:43:54.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b15600640 1 -- 172.21.15.78:0/973833379 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c052940 con 0x55c36bf30960 2024-05-21T14:43:54.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b33c98000 1 -- 172.21.15.78:0/973833379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf30960 msgr2=0x55c36c0a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b33c98000 1 --2- 172.21.15.78:0/973833379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf30960 0x55c36c0a53b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c052730 tx=0x7f1b1c056b10 comp rx=0 tx=0).stop 2024-05-21T14:43:54.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b33c98000 1 -- 172.21.15.78:0/973833379 shutdown_connections 2024-05-21T14:43:54.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b33c98000 1 --2- 172.21.15.78:0/973833379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf30960 0x55c36c0a53b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b33c98000 1 --2- 172.21.15.78:0/973833379 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bf23e60 0x55c36c099320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b33c98000 1 --2- 172.21.15.78:0/973833379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bb25280 0x55c36c098de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b33c98000 1 -- 172.21.15.78:0/973833379 >> 172.21.15.78:0/973833379 conn(0x55c36bf6e4e0 msgr2=0x55c36c0afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b33c98000 1 -- 172.21.15.78:0/973833379 shutdown_connections 2024-05-21T14:43:54.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b33c98000 1 -- 172.21.15.78:0/973833379 wait complete. 2024-05-21T14:43:54.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b33c98000 1 -- start start 2024-05-21T14:43:54.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.560+0000 7f1b33c98000 1 Processor -- start 2024-05-21T14:43:54.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b33c98000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bb25280 0x55c36c10bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b33c98000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf23e60 0x55c36c10c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b33c98000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bf30960 0x55c36c0abb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b33c98000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55c36bf5f410 con 0x55c36bf23e60 2024-05-21T14:43:54.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b33c98000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c36be397d0 con 0x55c36bf30960 2024-05-21T14:43:54.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b33c98000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x55c36bea0b30 con 0x55c36bb25280 2024-05-21T14:43:54.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b33c98000 10 client.0 _ll_register_callbacks cb 0x7f1b180050d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T14:43:54.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b29200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf23e60 0x55c36c10c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b29200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf23e60 0x55c36c10c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35260/0 (socket says 172.21.15.78:35260) 2024-05-21T14:43:54.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b29200640 1 -- 172.21.15.78:0/1961268022 learned_addr learned my addr 172.21.15.78:0/1961268022 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b29c00640 1 --2- 172.21.15.78:0/1961268022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bb25280 0x55c36c10bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b2a600640 1 --2- 172.21.15.78:0/1961268022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bf30960 0x55c36c0abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b29200640 1 -- 172.21.15.78:0/1961268022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bb25280 msgr2=0x55c36c10bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b29200640 1 --2- 172.21.15.78:0/1961268022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bb25280 0x55c36c10bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b29200640 1 -- 172.21.15.78:0/1961268022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bf30960 msgr2=0x55c36c0abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b29200640 1 --2- 172.21.15.78:0/1961268022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bf30960 0x55c36c0abb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b29200640 1 -- 172.21.15.78:0/1961268022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c36be30b80 con 0x55c36bf23e60 2024-05-21T14:43:54.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b2a600640 1 --2- 172.21.15.78:0/1961268022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bf30960 0x55c36c0abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:54.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b29c00640 1 --2- 172.21.15.78:0/1961268022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bb25280 0x55c36c10bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:54.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b29200640 1 --2- 172.21.15.78:0/1961268022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf23e60 0x55c36c10c210 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1b10006b20 tx=0x7f1b100046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94afa9c7deaacfdf server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b0aa00640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-05-21T14:43:54.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b0aa00640 1 -- 172.21.15.78:0/1961268022 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b100ca060 con 0x55c36bf23e60 2024-05-21T14:43:54.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b0aa00640 1 -- 172.21.15.78:0/1961268022 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1b100a8bd0 con 0x55c36bf23e60 2024-05-21T14:43:54.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b33c98000 1 -- 172.21.15.78:0/1961268022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b1c0545d0 con 0x55c36bf23e60 2024-05-21T14:43:54.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b0aa00640 1 -- 172.21.15.78:0/1961268022 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f1b100d0050 con 0x55c36bf23e60 2024-05-21T14:43:54.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b33c98000 10 client.4728 fetch_fsmap learned FSMap version 16 2024-05-21T14:43:54.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b33c98000 1 -- 172.21.15.78:0/1961268022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55c36be47ef0 con 0x55c36bf23e60 2024-05-21T14:43:54.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b0aa00640 1 -- 172.21.15.78:0/1961268022 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1c0545d0 con 0x55c36bf23e60 2024-05-21T14:43:54.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b0aa00640 1 -- 172.21.15.78:0/1961268022 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f1b100d3020 con 0x55c36bf23e60 2024-05-21T14:43:54.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b33c98000 10 client.4728 fetch_fsmap finished waiting for FSMap version 16 2024-05-21T14:43:54.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b33c98000 10 client.4728 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-21T14:43:54.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b33c98000 20 client.4728 populate_metadata read hostname 'smithi078' 2024-05-21T14:43:54.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b33c98000 1 --2- 172.21.15.78:0/1961268022 >> [v2:172.21.15.84:6836/1750816366,v1:172.21.15.84:6838/1750816366] conn(0x55c36bb37830 0x55c36c0ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b33c98000 4 client.4728 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T14:43:54.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b33c98000 1 -- 172.21.15.78:0/1961268022 --> [v2:172.21.15.84:6836/1750816366,v1:172.21.15.84:6838/1750816366] -- command(tid 0: {"prefix": "status"}) -- 0x55c36beaf370 con 0x55c36bb37830 2024-05-21T14:43:54.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.564+0000 7f1b29c00640 1 --2- 172.21.15.78:0/1961268022 >> [v2:172.21.15.84:6836/1750816366,v1:172.21.15.84:6838/1750816366] conn(0x55c36bb37830 0x55c36c0ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b29c00640 1 --2- 172.21.15.78:0/1961268022 >> [v2:172.21.15.84:6836/1750816366,v1:172.21.15.84:6838/1750816366] conn(0x55c36bb37830 0x55c36c0ac4b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3c5a842043c7941a server_cookie=b9cde65812666937 in_seq=0 out_seq=0 2024-05-21T14:43:54.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b0aa00640 10 client.4728 ms_handle_connect on v2:172.21.15.84:6836/1750816366 2024-05-21T14:43:54.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b0aa00640 1 -- 172.21.15.78:0/1961268022 <== mds.2 v2:172.21.15.84:6836/1750816366 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55c36beaf370 con 0x55c36bb37830 2024-05-21T14:43:54.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b0aa00640 10 client.4728 handle_command_reply: tid=0 2024-05-21T14:43:54.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b33c98000 1 client.4728 shutdown 2024-05-21T14:43:54.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b33c98000 1 -- 172.21.15.78:0/1961268022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf23e60 msgr2=0x55c36c10c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b33c98000 1 --2- 172.21.15.78:0/1961268022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf23e60 0x55c36c10c210 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1b10006b20 tx=0x7f1b100046d0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b33c98000 1 -- 172.21.15.78:0/1961268022 shutdown_connections 2024-05-21T14:43:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b33c98000 1 --2- 172.21.15.78:0/1961268022 >> [v2:172.21.15.84:6836/1750816366,v1:172.21.15.84:6838/1750816366] conn(0x55c36bb37830 0x55c36c0ac4b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b33c98000 1 --2- 172.21.15.78:0/1961268022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36bf30960 0x55c36c0abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b33c98000 1 --2- 172.21.15.78:0/1961268022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c36bf23e60 0x55c36c10c210 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b33c98000 1 --2- 172.21.15.78:0/1961268022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55c36bb25280 0x55c36c10bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b0aa00640 0 client.4728 ms_handle_reset on v2:172.21.15.84:6836/1750816366 2024-05-21T14:43:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b33c98000 1 -- 172.21.15.78:0/1961268022 >> 172.21.15.78:0/1961268022 conn(0x55c36bf6e4e0 msgr2=0x55c36c0a53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b33c98000 1 -- 172.21.15.78:0/1961268022 shutdown_connections 2024-05-21T14:43:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b33c98000 1 -- 172.21.15.78:0/1961268022 wait complete. 2024-05-21T14:43:54.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b33c98000 20 client.4728 trim_cache size 0 max 16384 2024-05-21T14:43:54.581 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-05-21T14:43:54.582 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa", 2024-05-21T14:43:54.582 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 2, 2024-05-21T14:43:54.582 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4297, 2024-05-21T14:43:54.582 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-05-21T14:43:54.582 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-05-21T14:43:54.582 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-05-21T14:43:54.582 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 23.861587978999999, 2024-05-21T14:43:54.582 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 16, 2024-05-21T14:43:54.582 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 23, 2024-05-21T14:43:54.582 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 23, 2024-05-21T14:43:54.582 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 42.284010287999998 2024-05-21T14:43:54.582 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-05-21T14:43:54.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b2c600640 1 -- 172.21.15.78:0/3027363679 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1b040678c0 msgr2=0x7f1b04069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b2c600640 1 --2- 172.21.15.78:0/3027363679 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1b040678c0 0x7f1b04069dd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1b18000f70 tx=0x7f1b18009040 comp rx=0 tx=0).stop 2024-05-21T14:43:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b2c600640 1 -- 172.21.15.78:0/3027363679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b241527a0 msgr2=0x7f1b2414b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b2c600640 1 --2- 172.21.15.78:0/3027363679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b241527a0 0x7f1b2414b350 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00bde0 tx=0x7f1b1c00e490 comp rx=0 tx=0).stop 2024-05-21T14:43:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b2c600640 1 -- 172.21.15.78:0/3027363679 shutdown_connections 2024-05-21T14:43:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b2c600640 1 --2- 172.21.15.78:0/3027363679 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1b040678c0 0x7f1b04069dd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b2c600640 1 --2- 172.21.15.78:0/3027363679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b241527a0 0x7f1b2414b350 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b2c600640 1 --2- 172.21.15.78:0/3027363679 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1b240c5980 0x7f1b24157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b2c600640 1 --2- 172.21.15.78:0/3027363679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b240733d0 0x7f1b241563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b2c600640 1 -- 172.21.15.78:0/3027363679 >> 172.21.15.78:0/3027363679 conn(0x7f1b240cd1e0 msgr2=0x7f1b24067580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b2c600640 1 -- 172.21.15.78:0/3027363679 shutdown_connections 2024-05-21T14:43:54.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.568+0000 7f1b2c600640 1 -- 172.21.15.78:0/3027363679 wait complete. 2024-05-21T14:43:54.596 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-21T14:43:54.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.736+0000 7f528d600640 1 Processor -- start 2024-05-21T14:43:54.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.736+0000 7f528d600640 1 -- start start 2024-05-21T14:43:54.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.736+0000 7f528d600640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f52880733d0 0x7f5288071910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.736+0000 7f528d600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5288160e20 0x7f5288163240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.736+0000 7f528d600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5288071e50 con 0x7f52881527a0 2024-05-21T14:43:54.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.736+0000 7f528d600640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f5288072980 con 0x7f52880733d0 2024-05-21T14:43:54.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.736+0000 7f528d600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f5288072f40 con 0x7f5288160e20 2024-05-21T14:43:54.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.736+0000 7f5286a00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f52880733d0 0x7f5288071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.736+0000 7f5286a00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f52880733d0 0x7f5288071910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35276/0 (socket says 172.21.15.78:35276) 2024-05-21T14:43:54.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.736+0000 7f5286a00640 1 -- 172.21.15.78:0/1285063223 learned_addr learned my addr 172.21.15.78:0/1285063223 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.736+0000 7f5287400640 1 --2- 172.21.15.78:0/1285063223 >> v2:172.21.15.84:3300/0 conn(0x7f5288160e20 0x7f5288163240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.736+0000 7f5286a00640 1 -- 172.21.15.78:0/1285063223 >> v2:172.21.15.84:3300/0 conn(0x7f5288160e20 msgr2=0x7f5288163240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.736+0000 7f5286a00640 1 --2- 172.21.15.78:0/1285063223 >> v2:172.21.15.84:3300/0 conn(0x7f5288160e20 0x7f5288163240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.736+0000 7f5286a00640 1 -- 172.21.15.78:0/1285063223 >> v1:172.21.15.84:6789/0 conn(0x7f52881527a0 legacy=0x7f52880c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.736+0000 7f5286a00640 1 -- 172.21.15.78:0/1285063223 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52880737e0 con 0x7f52880733d0 2024-05-21T14:43:54.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.740+0000 7f5286a00640 1 --2- 172.21.15.78:0/1285063223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52880733d0 0x7f5288071910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5288072b00 tx=0x7f527801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c690796d53ec508 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.740+0000 7f5286000640 1 -- 172.21.15.78:0/1285063223 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52780b5070 con 0x7f52880733d0 2024-05-21T14:43:54.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.740+0000 7f5286000640 1 -- 172.21.15.78:0/1285063223 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52780a8a10 con 0x7f52880733d0 2024-05-21T14:43:54.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.740+0000 7f5286000640 1 -- 172.21.15.78:0/1285063223 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52780a8de0 con 0x7f52880733d0 2024-05-21T14:43:54.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.740+0000 7f528d600640 1 -- 172.21.15.78:0/1285063223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52880733d0 msgr2=0x7f5288071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.740+0000 7f528d600640 1 --2- 172.21.15.78:0/1285063223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52880733d0 0x7f5288071910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5288072b00 tx=0x7f527801ed10 comp rx=0 tx=0).stop 2024-05-21T14:43:54.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.740+0000 7f528d600640 1 -- 172.21.15.78:0/1285063223 shutdown_connections 2024-05-21T14:43:54.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.740+0000 7f528d600640 1 --2- 172.21.15.78:0/1285063223 >> v2:172.21.15.84:3300/0 conn(0x7f5288160e20 0x7f5288163240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.740+0000 7f528d600640 1 --2- 172.21.15.78:0/1285063223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52880733d0 0x7f5288071910 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.740+0000 7f528d600640 1 -- 172.21.15.78:0/1285063223 >> 172.21.15.78:0/1285063223 conn(0x7f52880cd1e0 msgr2=0x7f52880c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.740+0000 7f528d600640 1 -- 172.21.15.78:0/1285063223 shutdown_connections 2024-05-21T14:43:54.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.740+0000 7f528d600640 1 -- 172.21.15.78:0/1285063223 wait complete. 2024-05-21T14:43:54.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f528d600640 1 Processor -- start 2024-05-21T14:43:54.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f528d600640 1 -- start start 2024-05-21T14:43:54.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f528d600640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52880733d0 0x7f5288145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f528d600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52881527a0 0x7f52880cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f528d600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5288160e20 0x7f52881372f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f528d600640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5288074060 con 0x7f52881527a0 2024-05-21T14:43:54.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f528d600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5288073d80 con 0x7f5288160e20 2024-05-21T14:43:54.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f528d600640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f5288072bd0 con 0x7f52880733d0 2024-05-21T14:43:54.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f527fe00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52881527a0 0x7f52880cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f527fe00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52881527a0 0x7f52880cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35284/0 (socket says 172.21.15.78:35284) 2024-05-21T14:43:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f527fe00640 1 -- 172.21.15.78:0/3936409788 learned_addr learned my addr 172.21.15.78:0/3936409788 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f5286a00640 1 --2- 172.21.15.78:0/3936409788 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52880733d0 0x7f5288145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f5287400640 1 --2- 172.21.15.78:0/3936409788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5288160e20 0x7f52881372f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f527fe00640 1 -- 172.21.15.78:0/3936409788 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52880733d0 msgr2=0x7f5288145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f527fe00640 1 --2- 172.21.15.78:0/3936409788 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52880733d0 0x7f5288145ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f527fe00640 1 -- 172.21.15.78:0/3936409788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5288160e20 msgr2=0x7f52881372f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f527fe00640 1 --2- 172.21.15.78:0/3936409788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5288160e20 0x7f52881372f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f527fe00640 1 -- 172.21.15.78:0/3936409788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52880cb870 con 0x7f52881527a0 2024-05-21T14:43:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f5287400640 1 --2- 172.21.15.78:0/3936409788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5288160e20 0x7f52881372f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f527fe00640 1 --2- 172.21.15.78:0/3936409788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52881527a0 0x7f52880cb330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f527000c370 tx=0x7f527000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f527ea00640 1 -- 172.21.15.78:0/3936409788 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52700052d0 con 0x7f52881527a0 2024-05-21T14:43:54.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.744+0000 7f527ea00640 1 -- 172.21.15.78:0/3936409788 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5270005470 con 0x7f52881527a0 2024-05-21T14:43:54.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.748+0000 7f528d600640 1 -- 172.21.15.78:0/3936409788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5288156f70 con 0x7f52881527a0 2024-05-21T14:43:54.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.748+0000 7f527ea00640 1 -- 172.21.15.78:0/3936409788 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5270007260 con 0x7f52881527a0 2024-05-21T14:43:54.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.748+0000 7f528d600640 1 -- 172.21.15.78:0/3936409788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52880ca850 con 0x7f52881527a0 2024-05-21T14:43:54.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.748+0000 7f527ea00640 1 -- 172.21.15.78:0/3936409788 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5270007400 con 0x7f52881527a0 2024-05-21T14:43:54.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.748+0000 7f527ea00640 1 --2- 172.21.15.78:0/3936409788 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f52640678f0 0x7f5264069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.748+0000 7f527ea00640 1 -- 172.21.15.78:0/3936409788 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5270084ff0 con 0x7f52881527a0 2024-05-21T14:43:54.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.748+0000 7f5286a00640 1 --2- 172.21.15.78:0/3936409788 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f52640678f0 0x7f5264069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.748+0000 7f5294d01000 1 Processor -- start 2024-05-21T14:43:54.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.748+0000 7f5294d01000 1 -- start start 2024-05-21T14:43:54.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5286a00640 1 --2- 172.21.15.78:0/3936409788 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f52640678f0 0x7f5264069e00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f52780b2000 tx=0x7f5278009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5294d01000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e57870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5294d01000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a867ceae60 0x55a867e5c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5294d01000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8678ec280 0x55a867e5c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5294d01000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a867c68c40 con 0x55a867cf7960 2024-05-21T14:43:54.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5294d01000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a867c05aa0 con 0x55a8678ec280 2024-05-21T14:43:54.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5294d01000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x55a867c64c00 con 0x55a867ceae60 2024-05-21T14:43:54.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5286a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e57870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5286a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e57870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35288/0 (socket says 172.21.15.78:35288) 2024-05-21T14:43:54.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5286a00640 1 -- 172.21.15.78:0/738980403 learned_addr learned my addr 172.21.15.78:0/738980403 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f527fe00640 1 --2- 172.21.15.78:0/738980403 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a867ceae60 0x55a867e5c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5287400640 1 --2- 172.21.15.78:0/738980403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8678ec280 0x55a867e5c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5286a00640 1 -- 172.21.15.78:0/738980403 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a867ceae60 msgr2=0x55a867e5c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5286a00640 1 --2- 172.21.15.78:0/738980403 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a867ceae60 0x55a867e5c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5286a00640 1 -- 172.21.15.78:0/738980403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8678ec280 msgr2=0x55a867e5c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5286a00640 1 --2- 172.21.15.78:0/738980403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8678ec280 0x55a867e5c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5286a00640 1 -- 172.21.15.78:0/738980403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a867befb40 con 0x55a867cf7960 2024-05-21T14:43:54.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f527fe00640 1 --2- 172.21.15.78:0/738980403 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a867ceae60 0x55a867e5c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:54.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5286a00640 1 --2- 172.21.15.78:0/738980403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e57870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f527801b920 tx=0x7f5278004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a01e4eafcd94dc server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5277000640 1 -- 172.21.15.78:0/738980403 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52780cb070 con 0x55a867cf7960 2024-05-21T14:43:54.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5277000640 1 -- 172.21.15.78:0/738980403 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52780a8d30 con 0x55a867cf7960 2024-05-21T14:43:54.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5277000640 1 -- 172.21.15.78:0/738980403 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52780b5040 con 0x55a867cf7960 2024-05-21T14:43:54.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5294d01000 1 -- 172.21.15.78:0/738980403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 msgr2=0x55a867e57870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5294d01000 1 --2- 172.21.15.78:0/738980403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e57870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f527801b920 tx=0x7f5278004740 comp rx=0 tx=0).stop 2024-05-21T14:43:54.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5294d01000 1 -- 172.21.15.78:0/738980403 shutdown_connections 2024-05-21T14:43:54.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5294d01000 1 --2- 172.21.15.78:0/738980403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8678ec280 0x55a867e5c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5294d01000 1 --2- 172.21.15.78:0/738980403 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a867ceae60 0x55a867e5c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5294d01000 1 --2- 172.21.15.78:0/738980403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e57870 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5294d01000 1 -- 172.21.15.78:0/738980403 >> 172.21.15.78:0/738980403 conn(0x55a867d354e0 msgr2=0x55a867e5a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5294d01000 1 -- 172.21.15.78:0/738980403 shutdown_connections 2024-05-21T14:43:54.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.752+0000 7f5294d01000 1 -- 172.21.15.78:0/738980403 wait complete. 2024-05-21T14:43:54.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 1 -- start start 2024-05-21T14:43:54.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 1 Processor -- start 2024-05-21T14:43:54.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8678ec280 0x55a867e56410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a867ceae60 0x55a867e56950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e615b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a867bf0910 con 0x55a867cf7960 2024-05-21T14:43:54.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a867c26020 con 0x55a8678ec280 2024-05-21T14:43:54.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x55a867c30940 con 0x55a867ceae60 2024-05-21T14:43:54.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 10 client.0 _ll_register_callbacks cb 0x55a867e06ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T14:43:54.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5287400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5287400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e615b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35296/0 (socket says 172.21.15.78:35296) 2024-05-21T14:43:54.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5287400640 1 -- 172.21.15.78:0/4280836546 learned_addr learned my addr 172.21.15.78:0/4280836546 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5286a00640 1 --2- 172.21.15.78:0/4280836546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8678ec280 0x55a867e56410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f527fe00640 1 --2- 172.21.15.78:0/4280836546 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a867ceae60 0x55a867e56950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5287400640 1 -- 172.21.15.78:0/4280836546 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a867ceae60 msgr2=0x55a867e56950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5287400640 1 --2- 172.21.15.78:0/4280836546 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a867ceae60 0x55a867e56950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5287400640 1 -- 172.21.15.78:0/4280836546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8678ec280 msgr2=0x55a867e56410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5287400640 1 --2- 172.21.15.78:0/4280836546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8678ec280 0x55a867e56410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5287400640 1 -- 172.21.15.78:0/4280836546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a867bf0ea0 con 0x55a867cf7960 2024-05-21T14:43:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f527fe00640 1 --2- 172.21.15.78:0/4280836546 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a867ceae60 0x55a867e56950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5287400640 1 --2- 172.21.15.78:0/4280836546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e615b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5280007950 tx=0x7f5280007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6ca69b1aab21e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f526b400640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-05-21T14:43:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f526b400640 1 -- 172.21.15.78:0/4280836546 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528001b020 con 0x55a867cf7960 2024-05-21T14:43:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f526b400640 1 -- 172.21.15.78:0/4280836546 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5280011a80 con 0x55a867cf7960 2024-05-21T14:43:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 1 -- 172.21.15.78:0/4280836546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52780a8d30 con 0x55a867cf7960 2024-05-21T14:43:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f526b400640 1 -- 172.21.15.78:0/4280836546 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f5280025050 con 0x55a867cf7960 2024-05-21T14:43:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 10 client.4740 fetch_fsmap learned FSMap version 16 2024-05-21T14:43:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 1 -- 172.21.15.78:0/4280836546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55a867c35780 con 0x55a867cf7960 2024-05-21T14:43:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f526b400640 1 -- 172.21.15.78:0/4280836546 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52780a8d30 con 0x55a867cf7960 2024-05-21T14:43:54.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f526b400640 1 -- 172.21.15.78:0/4280836546 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f5280028020 con 0x55a867cf7960 2024-05-21T14:43:54.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 10 client.4740 fetch_fsmap finished waiting for FSMap version 16 2024-05-21T14:43:54.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 10 client.4740 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-21T14:43:54.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 20 client.4740 populate_metadata read hostname 'smithi078' 2024-05-21T14:43:54.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 1 --2- 172.21.15.78:0/4280836546 >> [v2:172.21.15.84:6837/4232079477,v1:172.21.15.84:6839/4232079477] conn(0x55a8679107d0 0x55a867e62320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 4 client.4740 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T14:43:54.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.756+0000 7f5294d01000 1 -- 172.21.15.78:0/4280836546 --> [v2:172.21.15.84:6837/4232079477,v1:172.21.15.84:6839/4232079477] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a867c03ad0 con 0x55a8679107d0 2024-05-21T14:43:54.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f5286a00640 1 --2- 172.21.15.78:0/4280836546 >> [v2:172.21.15.84:6837/4232079477,v1:172.21.15.84:6839/4232079477] conn(0x55a8679107d0 0x55a867e62320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f5286a00640 1 --2- 172.21.15.78:0/4280836546 >> [v2:172.21.15.84:6837/4232079477,v1:172.21.15.84:6839/4232079477] conn(0x55a8679107d0 0x55a867e62320 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=37f330aa1e33cbd4 server_cookie=e736c33adbbf1db6 in_seq=0 out_seq=0 2024-05-21T14:43:54.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f526b400640 10 client.4740 ms_handle_connect on v2:172.21.15.84:6837/4232079477 2024-05-21T14:43:54.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f526b400640 1 -- 172.21.15.78:0/4280836546 <== mds.1 v2:172.21.15.84:6837/4232079477 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a867c03ad0 con 0x55a8679107d0 2024-05-21T14:43:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f526b400640 10 client.4740 handle_command_reply: tid=0 2024-05-21T14:43:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f5294d01000 1 client.4740 shutdown 2024-05-21T14:43:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f5294d01000 1 -- 172.21.15.78:0/4280836546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 msgr2=0x55a867e615b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f5294d01000 1 --2- 172.21.15.78:0/4280836546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e615b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5280007950 tx=0x7f5280007e10 comp rx=0 tx=0).stop 2024-05-21T14:43:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f5294d01000 1 -- 172.21.15.78:0/4280836546 shutdown_connections 2024-05-21T14:43:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f5294d01000 1 --2- 172.21.15.78:0/4280836546 >> [v2:172.21.15.84:6837/4232079477,v1:172.21.15.84:6839/4232079477] conn(0x55a8679107d0 0x55a867e62320 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f5294d01000 1 --2- 172.21.15.78:0/4280836546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e615b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f5294d01000 1 --2- 172.21.15.78:0/4280836546 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a867ceae60 0x55a867e56950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f526b400640 0 client.4740 ms_handle_reset on v2:172.21.15.84:6837/4232079477 2024-05-21T14:43:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f5294d01000 1 --2- 172.21.15.78:0/4280836546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8678ec280 0x55a867e56410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f5294d01000 1 -- 172.21.15.78:0/4280836546 >> 172.21.15.78:0/4280836546 conn(0x55a867d354e0 msgr2=0x55a867e21430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f5294d01000 1 -- 172.21.15.78:0/4280836546 shutdown_connections 2024-05-21T14:43:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f5294d01000 1 -- 172.21.15.78:0/4280836546 wait complete. 2024-05-21T14:43:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.760+0000 7f5294d01000 20 client.4740 trim_cache size 0 max 16384 2024-05-21T14:43:54.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.780+0000 7f5294d01000 1 Processor -- start 2024-05-21T14:43:54.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.780+0000 7f5294d01000 1 -- start start 2024-05-21T14:43:54.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.780+0000 7f5294d01000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a8678ec280 0x55a867e71f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.780+0000 7f5294d01000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a867ceae60 0x55a867e724c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.780+0000 7f5294d01000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e72a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.780+0000 7f5294d01000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f52881fe840 con 0x55a867cf7960 2024-05-21T14:43:54.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.780+0000 7f5294d01000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f52881f27e0 con 0x55a867ceae60 2024-05-21T14:43:54.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.780+0000 7f5294d01000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x55a867c6d270 con 0x55a8678ec280 2024-05-21T14:43:54.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.780+0000 7f5287400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e72a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.780+0000 7f5287400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e72a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35298/0 (socket says 172.21.15.78:35298) 2024-05-21T14:43:54.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.780+0000 7f5287400640 1 -- 172.21.15.78:0/2824726814 learned_addr learned my addr 172.21.15.78:0/2824726814 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.780+0000 7f5286a00640 1 --2- 172.21.15.78:0/2824726814 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a8678ec280 0x55a867e71f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.780+0000 7f527fe00640 1 --2- 172.21.15.78:0/2824726814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a867ceae60 0x55a867e724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5287400640 1 -- 172.21.15.78:0/2824726814 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a8678ec280 msgr2=0x55a867e71f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5287400640 1 --2- 172.21.15.78:0/2824726814 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a8678ec280 0x55a867e71f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5287400640 1 -- 172.21.15.78:0/2824726814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a867ceae60 msgr2=0x55a867e724c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5287400640 1 --2- 172.21.15.78:0/2824726814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a867ceae60 0x55a867e724c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5287400640 1 -- 172.21.15.78:0/2824726814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a867cc1d30 con 0x55a867cf7960 2024-05-21T14:43:54.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5287400640 1 --2- 172.21.15.78:0/2824726814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e72a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5280009ee0 tx=0x7f5280017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f885611018f351 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5276600640 1 -- 172.21.15.78:0/2824726814 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528001b040 con 0x55a867cf7960 2024-05-21T14:43:54.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5276600640 1 -- 172.21.15.78:0/2824726814 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5280007540 con 0x55a867cf7960 2024-05-21T14:43:54.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5276600640 1 -- 172.21.15.78:0/2824726814 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280007730 con 0x55a867cf7960 2024-05-21T14:43:54.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5294d01000 1 -- 172.21.15.78:0/2824726814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 msgr2=0x55a867e72a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5294d01000 1 --2- 172.21.15.78:0/2824726814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e72a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5280009ee0 tx=0x7f5280017000 comp rx=0 tx=0).stop 2024-05-21T14:43:54.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5294d01000 1 -- 172.21.15.78:0/2824726814 shutdown_connections 2024-05-21T14:43:54.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5294d01000 1 --2- 172.21.15.78:0/2824726814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a867cf7960 0x55a867e72a00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5294d01000 1 --2- 172.21.15.78:0/2824726814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a867ceae60 0x55a867e724c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5294d01000 1 --2- 172.21.15.78:0/2824726814 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a8678ec280 0x55a867e71f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5294d01000 1 -- 172.21.15.78:0/2824726814 >> 172.21.15.78:0/2824726814 conn(0x55a867d354e0 msgr2=0x55a867e5fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5294d01000 1 -- 172.21.15.78:0/2824726814 shutdown_connections 2024-05-21T14:43:54.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5294d01000 1 -- 172.21.15.78:0/2824726814 wait complete. 2024-05-21T14:43:54.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5294d01000 1 -- start start 2024-05-21T14:43:54.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.784+0000 7f5294d01000 1 Processor -- start 2024-05-21T14:43:54.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5294d01000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a8678ec280 0x55a867e77660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5294d01000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a867ceae60 0x55a867e755c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5294d01000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a867cf7960 0x55a867e75b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5294d01000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a867d26410 con 0x55a8678ec280 2024-05-21T14:43:54.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5294d01000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a867c007d0 con 0x55a867cf7960 2024-05-21T14:43:54.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5294d01000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x55a867c1cc60 con 0x55a867ceae60 2024-05-21T14:43:54.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5294d01000 10 client.0 _ll_register_callbacks cb 0x7f5280009750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T14:43:54.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5286a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a8678ec280 0x55a867e77660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5286a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a8678ec280 0x55a867e77660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35308/0 (socket says 172.21.15.78:35308) 2024-05-21T14:43:54.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5286a00640 1 -- 172.21.15.78:0/2969966471 learned_addr learned my addr 172.21.15.78:0/2969966471 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f527fe00640 1 --2- 172.21.15.78:0/2969966471 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a867ceae60 0x55a867e755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5287400640 1 --2- 172.21.15.78:0/2969966471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a867cf7960 0x55a867e75b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5286a00640 1 -- 172.21.15.78:0/2969966471 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a867ceae60 msgr2=0x55a867e755c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5286a00640 1 --2- 172.21.15.78:0/2969966471 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a867ceae60 0x55a867e755c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5286a00640 1 -- 172.21.15.78:0/2969966471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a867cf7960 msgr2=0x55a867e75b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5286a00640 1 --2- 172.21.15.78:0/2969966471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a867cf7960 0x55a867e75b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5286a00640 1 -- 172.21.15.78:0/2969966471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a867bf7b80 con 0x55a8678ec280 2024-05-21T14:43:54.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5287400640 1 --2- 172.21.15.78:0/2969966471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a867cf7960 0x55a867e75b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:54.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5286a00640 1 --2- 172.21.15.78:0/2969966471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a8678ec280 0x55a867e77660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f527801b920 tx=0x7f52780046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b1d53fdd8a27f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f526b400640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-05-21T14:43:54.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f526b400640 1 -- 172.21.15.78:0/2969966471 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52780cb040 con 0x55a8678ec280 2024-05-21T14:43:54.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f526b400640 1 -- 172.21.15.78:0/2969966471 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f52780d2ac0 con 0x55a8678ec280 2024-05-21T14:43:54.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5294d01000 1 -- 172.21.15.78:0/2969966471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5280007540 con 0x55a8678ec280 2024-05-21T14:43:54.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f526b400640 1 -- 172.21.15.78:0/2969966471 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f52780db050 con 0x55a8678ec280 2024-05-21T14:43:54.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5294d01000 10 client.4746 fetch_fsmap learned FSMap version 16 2024-05-21T14:43:54.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5294d01000 1 -- 172.21.15.78:0/2969966471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55a867c0eef0 con 0x55a8678ec280 2024-05-21T14:43:54.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f526b400640 1 -- 172.21.15.78:0/2969966471 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5280007540 con 0x55a8678ec280 2024-05-21T14:43:54.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f526b400640 1 -- 172.21.15.78:0/2969966471 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7f52780de020 con 0x55a8678ec280 2024-05-21T14:43:54.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5294d01000 10 client.4746 fetch_fsmap finished waiting for FSMap version 16 2024-05-21T14:43:54.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5294d01000 10 client.4746 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-21T14:43:54.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5294d01000 20 client.4746 populate_metadata read hostname 'smithi078' 2024-05-21T14:43:54.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5294d01000 1 --2- 172.21.15.78:0/2969966471 >> [v2:172.21.15.84:6837/4232079477,v1:172.21.15.84:6839/4232079477] conn(0x55a8678fe830 0x55a867e76460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5294d01000 4 client.4746 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T14:43:54.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5294d01000 1 -- 172.21.15.78:0/2969966471 --> [v2:172.21.15.84:6837/4232079477,v1:172.21.15.84:6839/4232079477] -- command(tid 0: {"prefix": "status"}) -- 0x55a867c76370 con 0x55a8678fe830 2024-05-21T14:43:54.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f527fe00640 1 --2- 172.21.15.78:0/2969966471 >> [v2:172.21.15.84:6837/4232079477,v1:172.21.15.84:6839/4232079477] conn(0x55a8678fe830 0x55a867e76460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f526b400640 10 client.4746 ms_handle_connect on v2:172.21.15.84:6837/4232079477 2024-05-21T14:43:54.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f527fe00640 1 --2- 172.21.15.78:0/2969966471 >> [v2:172.21.15.84:6837/4232079477,v1:172.21.15.84:6839/4232079477] conn(0x55a8678fe830 0x55a867e76460 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=286e9a5a48f558c9 server_cookie=ca0f5c2fc4a053fb in_seq=0 out_seq=0 2024-05-21T14:43:54.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f526b400640 1 -- 172.21.15.78:0/2969966471 <== mds.1 v2:172.21.15.84:6837/4232079477 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55a867c76370 con 0x55a8678fe830 2024-05-21T14:43:54.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f526b400640 10 client.4746 handle_command_reply: tid=0 2024-05-21T14:43:54.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.788+0000 7f5294d01000 1 client.4746 shutdown 2024-05-21T14:43:54.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f5294d01000 1 -- 172.21.15.78:0/2969966471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a8678ec280 msgr2=0x55a867e77660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f5294d01000 1 --2- 172.21.15.78:0/2969966471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a8678ec280 0x55a867e77660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f527801b920 tx=0x7f52780046d0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f5294d01000 1 -- 172.21.15.78:0/2969966471 shutdown_connections 2024-05-21T14:43:54.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f5294d01000 1 --2- 172.21.15.78:0/2969966471 >> [v2:172.21.15.84:6837/4232079477,v1:172.21.15.84:6839/4232079477] conn(0x55a8678fe830 0x55a867e76460 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f5294d01000 1 --2- 172.21.15.78:0/2969966471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a867cf7960 0x55a867e75b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f5294d01000 1 --2- 172.21.15.78:0/2969966471 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a867ceae60 0x55a867e755c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f5294d01000 1 --2- 172.21.15.78:0/2969966471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a8678ec280 0x55a867e77660 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f526b400640 0 client.4746 ms_handle_reset on v2:172.21.15.84:6837/4232079477 2024-05-21T14:43:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f5294d01000 1 -- 172.21.15.78:0/2969966471 >> 172.21.15.78:0/2969966471 conn(0x55a867d354e0 msgr2=0x55a867e6c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f5294d01000 1 -- 172.21.15.78:0/2969966471 shutdown_connections 2024-05-21T14:43:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f5294d01000 1 -- 172.21.15.78:0/2969966471 wait complete. 2024-05-21T14:43:54.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f5294d01000 20 client.4746 trim_cache size 0 max 16384 2024-05-21T14:43:54.804 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-05-21T14:43:54.804 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa", 2024-05-21T14:43:54.804 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 1, 2024-05-21T14:43:54.804 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4300, 2024-05-21T14:43:54.804 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-05-21T14:43:54.804 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-05-21T14:43:54.804 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-05-21T14:43:54.804 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 30.135234366999999, 2024-05-21T14:43:54.804 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 16, 2024-05-21T14:43:54.804 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 23, 2024-05-21T14:43:54.804 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 23, 2024-05-21T14:43:54.804 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 42.507296162000003 2024-05-21T14:43:54.804 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-05-21T14:43:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f528d600640 1 -- 172.21.15.78:0/3936409788 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f52640678f0 msgr2=0x7f5264069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f528d600640 1 --2- 172.21.15.78:0/3936409788 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f52640678f0 0x7f5264069e00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f52780b2000 tx=0x7f5278009040 comp rx=0 tx=0).stop 2024-05-21T14:43:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f528d600640 1 -- 172.21.15.78:0/3936409788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52881527a0 msgr2=0x7f52880cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f528d600640 1 --2- 172.21.15.78:0/3936409788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52881527a0 0x7f52880cb330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f527000c370 tx=0x7f527000c830 comp rx=0 tx=0).stop 2024-05-21T14:43:54.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f528d600640 1 -- 172.21.15.78:0/3936409788 shutdown_connections 2024-05-21T14:43:54.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f528d600640 1 --2- 172.21.15.78:0/3936409788 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f52640678f0 0x7f5264069e00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f528d600640 1 --2- 172.21.15.78:0/3936409788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5288160e20 0x7f52881372f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f528d600640 1 --2- 172.21.15.78:0/3936409788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52881527a0 0x7f52880cb330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f528d600640 1 --2- 172.21.15.78:0/3936409788 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52880733d0 0x7f5288145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f528d600640 1 -- 172.21.15.78:0/3936409788 >> 172.21.15.78:0/3936409788 conn(0x7f52880cd1e0 msgr2=0x7f52880c7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f528d600640 1 -- 172.21.15.78:0/3936409788 shutdown_connections 2024-05-21T14:43:54.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.792+0000 7f528d600640 1 -- 172.21.15.78:0/3936409788 wait complete. 2024-05-21T14:43:54.819 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-21T14:43:54.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.960+0000 7eff0f000640 1 Processor -- start 2024-05-21T14:43:54.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.960+0000 7eff0f000640 1 -- start start 2024-05-21T14:43:54.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.960+0000 7eff0f000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7eff080c5c30 0x7eff081538d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.960+0000 7eff0f000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff080c7f90 0x7eff0815cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.960+0000 7eff0f000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff080c7240 con 0x7eff080c6540 2024-05-21T14:43:54.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.960+0000 7eff0f000640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7eff08153e10 con 0x7eff080c7f90 2024-05-21T14:43:54.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.960+0000 7eff0f000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7eff080c4370 con 0x7eff080c5c30 2024-05-21T14:43:54.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.960+0000 7efeff400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff080c7f90 0x7eff0815cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.960+0000 7efeff400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff080c7f90 0x7eff0815cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35310/0 (socket says 172.21.15.78:35310) 2024-05-21T14:43:54.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.960+0000 7efeff400640 1 -- 172.21.15.78:0/971590821 learned_addr learned my addr 172.21.15.78:0/971590821 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.960+0000 7eff07e00640 1 --2- 172.21.15.78:0/971590821 >> v2:172.21.15.84:3300/0 conn(0x7eff080c5c30 0x7eff081538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.960+0000 7efeff400640 1 -- 172.21.15.78:0/971590821 >> v2:172.21.15.84:3300/0 conn(0x7eff080c5c30 msgr2=0x7eff081538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.960+0000 7efeff400640 1 --2- 172.21.15.78:0/971590821 >> v2:172.21.15.84:3300/0 conn(0x7eff080c5c30 0x7eff081538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.960+0000 7efeff400640 1 -- 172.21.15.78:0/971590821 >> v1:172.21.15.84:6789/0 conn(0x7eff080c6540 legacy=0x7eff080735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.960+0000 7efeff400640 1 -- 172.21.15.78:0/971590821 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff080c74e0 con 0x7eff080c7f90 2024-05-21T14:43:54.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.964+0000 7efeff400640 1 --2- 172.21.15.78:0/971590821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff080c7f90 0x7eff0815cc90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7eff080c44f0 tx=0x7efef001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c6d4777835a5a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.964+0000 7eff07400640 1 -- 172.21.15.78:0/971590821 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef00b0070 con 0x7eff080c7f90 2024-05-21T14:43:54.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.964+0000 7eff07400640 1 -- 172.21.15.78:0/971590821 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef00ab600 con 0x7eff080c7f90 2024-05-21T14:43:54.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.964+0000 7eff07400640 1 -- 172.21.15.78:0/971590821 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef00ab9d0 con 0x7eff080c7f90 2024-05-21T14:43:54.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.964+0000 7eff0f000640 1 -- 172.21.15.78:0/971590821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff080c7f90 msgr2=0x7eff0815cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.964+0000 7eff0f000640 1 --2- 172.21.15.78:0/971590821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff080c7f90 0x7eff0815cc90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7eff080c44f0 tx=0x7efef001c520 comp rx=0 tx=0).stop 2024-05-21T14:43:54.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.964+0000 7eff0f000640 1 -- 172.21.15.78:0/971590821 shutdown_connections 2024-05-21T14:43:54.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.964+0000 7eff0f000640 1 --2- 172.21.15.78:0/971590821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff080c7f90 0x7eff0815cc90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.964+0000 7eff0f000640 1 --2- 172.21.15.78:0/971590821 >> v2:172.21.15.84:3300/0 conn(0x7eff080c5c30 0x7eff081538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.964+0000 7eff0f000640 1 -- 172.21.15.78:0/971590821 >> 172.21.15.78:0/971590821 conn(0x7eff080cd1e0 msgr2=0x7eff080c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.964+0000 7eff0f000640 1 -- 172.21.15.78:0/971590821 shutdown_connections 2024-05-21T14:43:54.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.964+0000 7eff0f000640 1 -- 172.21.15.78:0/971590821 wait complete. 2024-05-21T14:43:54.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7eff0f000640 1 Processor -- start 2024-05-21T14:43:54.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7eff0f000640 1 -- start start 2024-05-21T14:43:54.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7eff0f000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff080c5c30 0x7eff081f4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7eff0f000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff080c6540 0x7eff081524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7eff0f000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7eff080c7f90 0x7eff0814e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7eff0f000640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7eff08073cf0 con 0x7eff080c5c30 2024-05-21T14:43:54.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7eff0f000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7eff080c4930 con 0x7eff080c6540 2024-05-21T14:43:54.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7eff0f000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7eff08073e70 con 0x7eff080c7f90 2024-05-21T14:43:54.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7eff07e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff080c5c30 0x7eff081f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7eff07e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff080c5c30 0x7eff081f4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35314/0 (socket says 172.21.15.78:35314) 2024-05-21T14:43:54.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7eff07e00640 1 -- 172.21.15.78:0/1642754864 learned_addr learned my addr 172.21.15.78:0/1642754864 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7efeff400640 1 --2- 172.21.15.78:0/1642754864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff080c6540 0x7eff081524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7eff0d000640 1 --2- 172.21.15.78:0/1642754864 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7eff080c7f90 0x7eff0814e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7eff07e00640 1 -- 172.21.15.78:0/1642754864 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7eff080c7f90 msgr2=0x7eff0814e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7eff07e00640 1 --2- 172.21.15.78:0/1642754864 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7eff080c7f90 0x7eff0814e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7eff07e00640 1 -- 172.21.15.78:0/1642754864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff080c6540 msgr2=0x7eff081524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7eff07e00640 1 --2- 172.21.15.78:0/1642754864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff080c6540 0x7eff081524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.968+0000 7eff07e00640 1 -- 172.21.15.78:0/1642754864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff080c3b00 con 0x7eff080c5c30 2024-05-21T14:43:54.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.972+0000 7eff07e00640 1 --2- 172.21.15.78:0/1642754864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff080c5c30 0x7eff081f4d00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efef800e870 tx=0x7efef800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.972+0000 7eff04c00640 1 -- 172.21.15.78:0/1642754864 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8017070 con 0x7eff080c5c30 2024-05-21T14:43:54.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.972+0000 7eff04c00640 1 -- 172.21.15.78:0/1642754864 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef800c8e0 con 0x7eff080c5c30 2024-05-21T14:43:54.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.972+0000 7eff04c00640 1 -- 172.21.15.78:0/1642754864 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef800cc90 con 0x7eff080c5c30 2024-05-21T14:43:54.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.972+0000 7eff0f000640 1 -- 172.21.15.78:0/1642754864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff081543f0 con 0x7eff080c5c30 2024-05-21T14:43:54.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.972+0000 7eff0f000640 1 -- 172.21.15.78:0/1642754864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff081f8760 con 0x7eff080c5c30 2024-05-21T14:43:54.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.972+0000 7eff04c00640 1 -- 172.21.15.78:0/1642754864 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efef801a070 con 0x7eff080c5c30 2024-05-21T14:43:54.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.972+0000 7eff04c00640 1 --2- 172.21.15.78:0/1642754864 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efee40678c0 0x7efee4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.972+0000 7eff04c00640 1 -- 172.21.15.78:0/1642754864 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efef8085ba0 con 0x7eff080c5c30 2024-05-21T14:43:54.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.972+0000 7efeff400640 1 --2- 172.21.15.78:0/1642754864 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efee40678c0 0x7efee4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff166c0000 1 Processor -- start 2024-05-21T14:43:54.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff166c0000 1 -- start start 2024-05-21T14:43:54.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7efeff400640 1 --2- 172.21.15.78:0/1642754864 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efee40678c0 0x7efee4069dd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efef00ad000 tx=0x7efef0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff166c0000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a770255960 0x55a7703b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff166c0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770248e60 0x55a7703ba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff166c0000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76fe4a280 0x55a7703ba840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff166c0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a7701c6c40 con 0x55a770248e60 2024-05-21T14:43:54.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff166c0000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a770163aa0 con 0x55a76fe4a280 2024-05-21T14:43:54.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff166c0000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x55a7701c2c00 con 0x55a770255960 2024-05-21T14:43:54.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7efeff400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770248e60 0x55a7703ba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7efeff400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770248e60 0x55a7703ba300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35324/0 (socket says 172.21.15.78:35324) 2024-05-21T14:43:54.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7efeff400640 1 -- 172.21.15.78:0/2202717697 learned_addr learned my addr 172.21.15.78:0/2202717697 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff07e00640 1 --2- 172.21.15.78:0/2202717697 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a770255960 0x55a7703b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff0d000640 1 --2- 172.21.15.78:0/2202717697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76fe4a280 0x55a7703ba840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7efeff400640 1 -- 172.21.15.78:0/2202717697 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a770255960 msgr2=0x55a7703b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7efeff400640 1 --2- 172.21.15.78:0/2202717697 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a770255960 0x55a7703b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7efeff400640 1 -- 172.21.15.78:0/2202717697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76fe4a280 msgr2=0x55a7703ba840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7efeff400640 1 --2- 172.21.15.78:0/2202717697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76fe4a280 0x55a7703ba840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7efeff400640 1 -- 172.21.15.78:0/2202717697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a77014db40 con 0x55a770248e60 2024-05-21T14:43:54.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff07e00640 1 --2- 172.21.15.78:0/2202717697 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a770255960 0x55a7703b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:54.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff0d000640 1 --2- 172.21.15.78:0/2202717697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76fe4a280 0x55a7703ba840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:54.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7efeff400640 1 --2- 172.21.15.78:0/2202717697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770248e60 0x55a7703ba300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efef00ae040 tx=0x7efef00a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b437dcd6ae90b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7efefcc00640 1 -- 172.21.15.78:0/2202717697 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef00c7070 con 0x55a770248e60 2024-05-21T14:43:54.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7efefcc00640 1 -- 172.21.15.78:0/2202717697 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef00b6470 con 0x55a770248e60 2024-05-21T14:43:54.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7efefcc00640 1 -- 172.21.15.78:0/2202717697 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef00b0040 con 0x55a770248e60 2024-05-21T14:43:54.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff166c0000 1 -- 172.21.15.78:0/2202717697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770248e60 msgr2=0x55a7703ba300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff166c0000 1 --2- 172.21.15.78:0/2202717697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770248e60 0x55a7703ba300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efef00ae040 tx=0x7efef00a6000 comp rx=0 tx=0).stop 2024-05-21T14:43:54.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff166c0000 1 -- 172.21.15.78:0/2202717697 shutdown_connections 2024-05-21T14:43:54.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff166c0000 1 --2- 172.21.15.78:0/2202717697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76fe4a280 0x55a7703ba840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff166c0000 1 --2- 172.21.15.78:0/2202717697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770248e60 0x55a7703ba300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff166c0000 1 --2- 172.21.15.78:0/2202717697 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a770255960 0x55a7703b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff166c0000 1 -- 172.21.15.78:0/2202717697 >> 172.21.15.78:0/2202717697 conn(0x55a7702934e0 msgr2=0x55a7703b80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff166c0000 1 -- 172.21.15.78:0/2202717697 shutdown_connections 2024-05-21T14:43:54.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.976+0000 7eff166c0000 1 -- 172.21.15.78:0/2202717697 wait complete. 2024-05-21T14:43:54.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7eff166c0000 1 -- start start 2024-05-21T14:43:54.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7eff166c0000 1 Processor -- start 2024-05-21T14:43:54.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7eff166c0000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a76fe4a280 0x55a7703c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7eff166c0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770248e60 0x55a7703c4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7eff166c0000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a770255960 0x55a770377480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7eff166c0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a77014e910 con 0x55a770248e60 2024-05-21T14:43:54.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7eff166c0000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a770184020 con 0x55a770255960 2024-05-21T14:43:54.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7eff166c0000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x55a77018e940 con 0x55a76fe4a280 2024-05-21T14:43:54.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7eff166c0000 10 client.0 _ll_register_callbacks cb 0x55a770364ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T14:43:54.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7efeff400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770248e60 0x55a7703c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7efeff400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770248e60 0x55a7703c4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35326/0 (socket says 172.21.15.78:35326) 2024-05-21T14:43:54.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7efeff400640 1 -- 172.21.15.78:0/762162198 learned_addr learned my addr 172.21.15.78:0/762162198 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:54.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7eff07e00640 1 --2- 172.21.15.78:0/762162198 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a76fe4a280 0x55a7703c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7eff0d000640 1 --2- 172.21.15.78:0/762162198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a770255960 0x55a770377480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7efeff400640 1 -- 172.21.15.78:0/762162198 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a76fe4a280 msgr2=0x55a7703c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7efeff400640 1 --2- 172.21.15.78:0/762162198 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a76fe4a280 0x55a7703c43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7efeff400640 1 -- 172.21.15.78:0/762162198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a770255960 msgr2=0x55a770377480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:54.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7efeff400640 1 --2- 172.21.15.78:0/762162198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a770255960 0x55a770377480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7efeff400640 1 -- 172.21.15.78:0/762162198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a77014eea0 con 0x55a770248e60 2024-05-21T14:43:54.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7eff0d000640 1 --2- 172.21.15.78:0/762162198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a770255960 0x55a770377480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:54.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7eff07e00640 1 --2- 172.21.15.78:0/762162198 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a76fe4a280 0x55a7703c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:54.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7efeff400640 1 --2- 172.21.15.78:0/762162198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770248e60 0x55a7703c4900 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efef00ae040 tx=0x7efef001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996fa2f4faaae2c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:54.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7efef5600640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-05-21T14:43:54.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7efef5600640 1 -- 172.21.15.78:0/762162198 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef00d0060 con 0x55a770248e60 2024-05-21T14:43:54.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7eff166c0000 1 -- 172.21.15.78:0/762162198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efef00b6470 con 0x55a770248e60 2024-05-21T14:43:54.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.980+0000 7efef5600640 1 -- 172.21.15.78:0/762162198 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efef00b6e40 con 0x55a770248e60 2024-05-21T14:43:54.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7efef5600640 1 -- 172.21.15.78:0/762162198 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7efef00c7040 con 0x55a770248e60 2024-05-21T14:43:54.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 10 client.4758 fetch_fsmap learned FSMap version 16 2024-05-21T14:43:54.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 1 -- 172.21.15.78:0/762162198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55a770193780 con 0x55a770248e60 2024-05-21T14:43:54.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7efef5600640 1 -- 172.21.15.78:0/762162198 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef00b6470 con 0x55a770248e60 2024-05-21T14:43:54.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7efef5600640 1 -- 172.21.15.78:0/762162198 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7efef00c1070 con 0x55a770248e60 2024-05-21T14:43:54.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 10 client.4758 fetch_fsmap finished waiting for FSMap version 16 2024-05-21T14:43:54.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 10 client.4758 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-21T14:43:54.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 20 client.4758 populate_metadata read hostname 'smithi078' 2024-05-21T14:43:54.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 1 --2- 172.21.15.78:0/762162198 >> [v2:172.21.15.78:6835/1924967428,v1:172.21.15.78:6837/1924967428] conn(0x55a76fe6e7d0 0x55a7703781c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:54.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 4 client.4758 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T14:43:54.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 1 -- 172.21.15.78:0/762162198 --> [v2:172.21.15.78:6835/1924967428,v1:172.21.15.78:6837/1924967428] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a770161ad0 con 0x55a76fe6e7d0 2024-05-21T14:43:54.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff07e00640 1 --2- 172.21.15.78:0/762162198 >> [v2:172.21.15.78:6835/1924967428,v1:172.21.15.78:6837/1924967428] conn(0x55a76fe6e7d0 0x55a7703781c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:54.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff07e00640 1 --2- 172.21.15.78:0/762162198 >> [v2:172.21.15.78:6835/1924967428,v1:172.21.15.78:6837/1924967428] conn(0x55a76fe6e7d0 0x55a7703781c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fad7ca2c6ed909cd server_cookie=a61f261cf58492f9 in_seq=0 out_seq=0 2024-05-21T14:43:54.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7efef5600640 10 client.4758 ms_handle_connect on v2:172.21.15.78:6835/1924967428 2024-05-21T14:43:54.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7efef5600640 1 -- 172.21.15.78:0/762162198 <== mds.0 v2:172.21.15.78:6835/1924967428 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a770161ad0 con 0x55a76fe6e7d0 2024-05-21T14:43:54.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7efef5600640 10 client.4758 handle_command_reply: tid=0 2024-05-21T14:43:54.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 1 client.4758 shutdown 2024-05-21T14:43:54.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 1 -- 172.21.15.78:0/762162198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770248e60 msgr2=0x55a7703c4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:54.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 1 --2- 172.21.15.78:0/762162198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770248e60 0x55a7703c4900 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efef00ae040 tx=0x7efef001ad60 comp rx=0 tx=0).stop 2024-05-21T14:43:54.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 1 -- 172.21.15.78:0/762162198 shutdown_connections 2024-05-21T14:43:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 1 --2- 172.21.15.78:0/762162198 >> [v2:172.21.15.78:6835/1924967428,v1:172.21.15.78:6837/1924967428] conn(0x55a76fe6e7d0 0x55a7703781c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 1 --2- 172.21.15.78:0/762162198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a770255960 0x55a770377480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 1 --2- 172.21.15.78:0/762162198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770248e60 0x55a7703c4900 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 1 --2- 172.21.15.78:0/762162198 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a76fe4a280 0x55a7703c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7efef5600640 0 client.4758 ms_handle_reset on v2:172.21.15.78:6835/1924967428 2024-05-21T14:43:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 1 -- 172.21.15.78:0/762162198 >> 172.21.15.78:0/762162198 conn(0x55a7702934e0 msgr2=0x55a77037f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 1 -- 172.21.15.78:0/762162198 shutdown_connections 2024-05-21T14:43:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 1 -- 172.21.15.78:0/762162198 wait complete. 2024-05-21T14:43:54.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:54.984+0000 7eff166c0000 20 client.4758 trim_cache size 0 max 16384 2024-05-21T14:43:55.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff166c0000 1 Processor -- start 2024-05-21T14:43:55.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff166c0000 1 -- start start 2024-05-21T14:43:55.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff166c0000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a76fe4a280 0x55a7703ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:55.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff166c0000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a770248e60 0x55a7703ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:55.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff166c0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770255960 0x55a77037e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:55.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff166c0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7eff08072160 con 0x55a770255960 2024-05-21T14:43:55.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff166c0000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a770189a90 con 0x55a770248e60 2024-05-21T14:43:55.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff166c0000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x55a77014e910 con 0x55a76fe4a280 2024-05-21T14:43:55.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff0d000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770255960 0x55a77037e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:55.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff0d000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770255960 0x55a77037e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35336/0 (socket says 172.21.15.78:35336) 2024-05-21T14:43:55.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff0d000640 1 -- 172.21.15.78:0/1301783547 learned_addr learned my addr 172.21.15.78:0/1301783547 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:55.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff07e00640 1 --2- 172.21.15.78:0/1301783547 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a76fe4a280 0x55a7703ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:55.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7efeff400640 1 --2- 172.21.15.78:0/1301783547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a770248e60 0x55a7703ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:55.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff0d000640 1 -- 172.21.15.78:0/1301783547 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a76fe4a280 msgr2=0x55a7703ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:55.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff0d000640 1 --2- 172.21.15.78:0/1301783547 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a76fe4a280 0x55a7703ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff0d000640 1 -- 172.21.15.78:0/1301783547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a770248e60 msgr2=0x55a7703ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:55.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff0d000640 1 --2- 172.21.15.78:0/1301783547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a770248e60 0x55a7703ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff0d000640 1 -- 172.21.15.78:0/1301783547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a77021fd30 con 0x55a770255960 2024-05-21T14:43:55.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7efeff400640 1 --2- 172.21.15.78:0/1301783547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a770248e60 0x55a7703ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:55.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7eff0d000640 1 --2- 172.21.15.78:0/1301783547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770255960 0x55a77037e1f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7eff00005180 tx=0x7eff00005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3367fcbf15f985 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:55.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7efef7e00640 1 -- 172.21.15.78:0/1301783547 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00006b60 con 0x55a770255960 2024-05-21T14:43:55.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7efef7e00640 1 -- 172.21.15.78:0/1301783547 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff00006d00 con 0x55a770255960 2024-05-21T14:43:55.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.004+0000 7efef7e00640 1 -- 172.21.15.78:0/1301783547 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00012a60 con 0x55a770255960 2024-05-21T14:43:55.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 1 -- 172.21.15.78:0/1301783547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770255960 msgr2=0x55a77037e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:55.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 1 --2- 172.21.15.78:0/1301783547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770255960 0x55a77037e1f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7eff00005180 tx=0x7eff00005640 comp rx=0 tx=0).stop 2024-05-21T14:43:55.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 1 -- 172.21.15.78:0/1301783547 shutdown_connections 2024-05-21T14:43:55.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 1 --2- 172.21.15.78:0/1301783547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770255960 0x55a77037e1f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 1 --2- 172.21.15.78:0/1301783547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a770248e60 0x55a7703ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 1 --2- 172.21.15.78:0/1301783547 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a76fe4a280 0x55a7703ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 1 -- 172.21.15.78:0/1301783547 >> 172.21.15.78:0/1301783547 conn(0x55a7702934e0 msgr2=0x55a770377220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:55.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 1 -- 172.21.15.78:0/1301783547 shutdown_connections 2024-05-21T14:43:55.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 1 -- 172.21.15.78:0/1301783547 wait complete. 2024-05-21T14:43:55.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 1 -- start start 2024-05-21T14:43:55.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 1 Processor -- start 2024-05-21T14:43:55.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a76fe4a280 0x55a7703c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:55.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a770248e60 0x55a7703c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:55.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770255960 0x55a7703c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:55.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a77015e7d0 con 0x55a770255960 2024-05-21T14:43:55.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a7701cb270 con 0x55a770248e60 2024-05-21T14:43:55.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x55a7701c5f50 con 0x55a76fe4a280 2024-05-21T14:43:55.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff166c0000 10 client.0 _ll_register_callbacks cb 0x7efef00c5070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T14:43:55.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff0d000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770255960 0x55a7703c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:55.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff0d000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770255960 0x55a7703c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35340/0 (socket says 172.21.15.78:35340) 2024-05-21T14:43:55.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff0d000640 1 -- 172.21.15.78:0/1414505145 learned_addr learned my addr 172.21.15.78:0/1414505145 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:55.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff07e00640 1 --2- 172.21.15.78:0/1414505145 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a76fe4a280 0x55a7703c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:55.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7efeff400640 1 --2- 172.21.15.78:0/1414505145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a770248e60 0x55a7703c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:55.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff0d000640 1 -- 172.21.15.78:0/1414505145 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a76fe4a280 msgr2=0x55a7703c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:55.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff0d000640 1 --2- 172.21.15.78:0/1414505145 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a76fe4a280 0x55a7703c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff0d000640 1 -- 172.21.15.78:0/1414505145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a770248e60 msgr2=0x55a7703c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:55.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff0d000640 1 --2- 172.21.15.78:0/1414505145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a770248e60 0x55a7703c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff0d000640 1 -- 172.21.15.78:0/1414505145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a770155b80 con 0x55a770255960 2024-05-21T14:43:55.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7eff07e00640 1 --2- 172.21.15.78:0/1414505145 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a76fe4a280 0x55a7703c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:55.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.008+0000 7efef5600640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-05-21T14:43:55.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff0d000640 1 --2- 172.21.15.78:0/1414505145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770255960 0x55a7703c9360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55a7703b8940 tx=0x7eff00001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139d9d1a52f44eef server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:55.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7efef5600640 1 -- 172.21.15.78:0/1414505145 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00006b60 con 0x55a770255960 2024-05-21T14:43:55.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7efef5600640 1 -- 172.21.15.78:0/1414505145 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7eff00016890 con 0x55a770255960 2024-05-21T14:43:55.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 1 -- 172.21.15.78:0/1414505145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff00006d00 con 0x55a770255960 2024-05-21T14:43:55.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7efef5600640 1 -- 172.21.15.78:0/1414505145 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7eff00016a90 con 0x55a770255960 2024-05-21T14:43:55.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 10 client.4764 fetch_fsmap learned FSMap version 16 2024-05-21T14:43:55.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 1 -- 172.21.15.78:0/1414505145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55a77016cef0 con 0x55a770255960 2024-05-21T14:43:55.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7efef5600640 1 -- 172.21.15.78:0/1414505145 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff00006d00 con 0x55a770255960 2024-05-21T14:43:55.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7efef5600640 1 -- 172.21.15.78:0/1414505145 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 16) ==== 4784+0+0 (secure 0 0 0) 0x7eff00016c30 con 0x55a770255960 2024-05-21T14:43:55.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 10 client.4764 fetch_fsmap finished waiting for FSMap version 16 2024-05-21T14:43:55.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 10 client.4764 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-21T14:43:55.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 20 client.4764 populate_metadata read hostname 'smithi078' 2024-05-21T14:43:55.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 1 --2- 172.21.15.78:0/1414505145 >> [v2:172.21.15.78:6835/1924967428,v1:172.21.15.78:6837/1924967428] conn(0x55a76fe5c830 0x55a7703c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:55.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 4 client.4764 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T14:43:55.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 1 -- 172.21.15.78:0/1414505145 --> [v2:172.21.15.78:6835/1924967428,v1:172.21.15.78:6837/1924967428] -- command(tid 0: {"prefix": "status"}) -- 0x55a7701d4370 con 0x55a76fe5c830 2024-05-21T14:43:55.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff07e00640 1 --2- 172.21.15.78:0/1414505145 >> [v2:172.21.15.78:6835/1924967428,v1:172.21.15.78:6837/1924967428] conn(0x55a76fe5c830 0x55a7703c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff07e00640 1 --2- 172.21.15.78:0/1414505145 >> [v2:172.21.15.78:6835/1924967428,v1:172.21.15.78:6837/1924967428] conn(0x55a76fe5c830 0x55a7703c9c60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=640bc743f2611486 server_cookie=c8e50613c4531ab1 in_seq=0 out_seq=0 2024-05-21T14:43:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7efef5600640 10 client.4764 ms_handle_connect on v2:172.21.15.78:6835/1924967428 2024-05-21T14:43:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7efef5600640 1 -- 172.21.15.78:0/1414505145 <== mds.0 v2:172.21.15.78:6835/1924967428 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55a7701d4370 con 0x55a76fe5c830 2024-05-21T14:43:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7efef5600640 10 client.4764 handle_command_reply: tid=0 2024-05-21T14:43:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 1 client.4764 shutdown 2024-05-21T14:43:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 1 -- 172.21.15.78:0/1414505145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770255960 msgr2=0x55a7703c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 1 --2- 172.21.15.78:0/1414505145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770255960 0x55a7703c9360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55a7703b8940 tx=0x7eff00001260 comp rx=0 tx=0).stop 2024-05-21T14:43:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 1 -- 172.21.15.78:0/1414505145 shutdown_connections 2024-05-21T14:43:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 1 --2- 172.21.15.78:0/1414505145 >> [v2:172.21.15.78:6835/1924967428,v1:172.21.15.78:6837/1924967428] conn(0x55a76fe5c830 0x55a7703c9c60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 1 --2- 172.21.15.78:0/1414505145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a770255960 0x55a7703c9360 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 1 --2- 172.21.15.78:0/1414505145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a770248e60 0x55a7703c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 1 --2- 172.21.15.78:0/1414505145 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x55a76fe4a280 0x55a7703c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7efef5600640 0 client.4764 ms_handle_reset on v2:172.21.15.78:6835/1924967428 2024-05-21T14:43:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 1 -- 172.21.15.78:0/1414505145 >> 172.21.15.78:0/1414505145 conn(0x55a7702934e0 msgr2=0x55a7703765e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 1 -- 172.21.15.78:0/1414505145 shutdown_connections 2024-05-21T14:43:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 1 -- 172.21.15.78:0/1414505145 wait complete. 2024-05-21T14:43:55.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff166c0000 20 client.4764 trim_cache size 0 max 16384 2024-05-21T14:43:55.025 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-05-21T14:43:55.025 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa", 2024-05-21T14:43:55.025 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-05-21T14:43:55.025 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4321, 2024-05-21T14:43:55.026 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-05-21T14:43:55.026 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-05-21T14:43:55.026 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-05-21T14:43:55.026 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 35.439883969, 2024-05-21T14:43:55.026 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 16, 2024-05-21T14:43:55.026 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 23, 2024-05-21T14:43:55.026 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 23, 2024-05-21T14:43:55.026 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 42.697415372999998 2024-05-21T14:43:55.026 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-05-21T14:43:55.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff0f000640 1 -- 172.21.15.78:0/1642754864 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efee40678c0 msgr2=0x7efee4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:55.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff0f000640 1 --2- 172.21.15.78:0/1642754864 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efee40678c0 0x7efee4069dd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efef00ad000 tx=0x7efef0008040 comp rx=0 tx=0).stop 2024-05-21T14:43:55.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff0f000640 1 -- 172.21.15.78:0/1642754864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff080c5c30 msgr2=0x7eff081f4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:55.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff0f000640 1 --2- 172.21.15.78:0/1642754864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff080c5c30 0x7eff081f4d00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efef800e870 tx=0x7efef800ec70 comp rx=0 tx=0).stop 2024-05-21T14:43:55.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff0f000640 1 -- 172.21.15.78:0/1642754864 shutdown_connections 2024-05-21T14:43:55.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff0f000640 1 --2- 172.21.15.78:0/1642754864 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efee40678c0 0x7efee4069dd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff0f000640 1 --2- 172.21.15.78:0/1642754864 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7eff080c7f90 0x7eff0814e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff0f000640 1 --2- 172.21.15.78:0/1642754864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff080c6540 0x7eff081524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff0f000640 1 --2- 172.21.15.78:0/1642754864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff080c5c30 0x7eff081f4d00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff0f000640 1 -- 172.21.15.78:0/1642754864 >> 172.21.15.78:0/1642754864 conn(0x7eff080cd1e0 msgr2=0x7eff08162840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:55.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff0f000640 1 -- 172.21.15.78:0/1642754864 shutdown_connections 2024-05-21T14:43:55.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.012+0000 7eff0f000640 1 -- 172.21.15.78:0/1642754864 wait complete. 2024-05-21T14:43:55.042 INFO:teuthology.run_tasks:Running task sequential... 2024-05-21T14:43:55.052 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-21T14:43:55.052 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-21T14:43:55.052 INFO:teuthology.task.print:Enabling mgr modules 2024-05-21T14:43:55.053 INFO:teuthology.run_tasks:Running task kclient... 2024-05-21T14:43:55.109 INFO:tasks.kclient:Mounting kernel clients... 2024-05-21T14:43:55.109 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-21T14:43:55.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T14:43:55.109 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-05-21T14:43:55.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T14:43:55.119 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2024-05-21T14:43:55.185 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2024-05-21T14:43:55.186 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T14:43:55.187 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-05-21T14:43:55.187 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-21T14:43:55.187 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-21T14:43:55.187 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-21T14:43:55.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.372+0000 7f2152800640 1 Processor -- start 2024-05-21T14:43:55.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.372+0000 7f2152800640 1 -- start start 2024-05-21T14:43:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.372+0000 7f2152800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f214c071f50 0x7f214c15c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.372+0000 7f2152800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f214c0c7ff0 0x7f214c0cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.372+0000 7f2152800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f214c072970 con 0x7f214c0cd930 2024-05-21T14:43:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.372+0000 7f2152800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f214c15bbd0 con 0x7f214c071f50 2024-05-21T14:43:55.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.372+0000 7f2152800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f214c0c4c60 con 0x7f214c0c7ff0 2024-05-21T14:43:55.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.372+0000 7f214b400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f214c071f50 0x7f214c15c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:55.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.372+0000 7f214aa00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f214c0c7ff0 0x7f214c0cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:55.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.372+0000 7f214b400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f214c071f50 0x7f214c15c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:51152/0 (socket says 172.21.15.78:51152) 2024-05-21T14:43:55.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.372+0000 7f214b400640 1 -- 172.21.15.78:0/1059593253 learned_addr learned my addr 172.21.15.78:0/1059593253 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:55.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.372+0000 7f214b400640 1 -- 172.21.15.78:0/1059593253 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f214c0c7ff0 msgr2=0x7f214c0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:55.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.372+0000 7f214b400640 1 --2- 172.21.15.78:0/1059593253 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f214c0c7ff0 0x7f214c0cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.372+0000 7f214b400640 1 -- 172.21.15.78:0/1059593253 >> v1:172.21.15.84:6789/0 conn(0x7f214c0cd930 legacy=0x7f214c0c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:55.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.372+0000 7f214b400640 1 -- 172.21.15.78:0/1059593253 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214c072c10 con 0x7f214c071f50 2024-05-21T14:43:55.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.376+0000 7f214b400640 1 --2- 172.21.15.78:0/1059593253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c071f50 0x7f214c15c060 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f213c009870 tx=0x7f213c01ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc6a5925225f67ec server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:55.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.376+0000 7f214a000640 1 -- 172.21.15.78:0/1059593253 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c0b5070 con 0x7f214c071f50 2024-05-21T14:43:55.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.376+0000 7f214a000640 1 -- 172.21.15.78:0/1059593253 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f213c0a8a50 con 0x7f214c071f50 2024-05-21T14:43:55.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.376+0000 7f214a000640 1 -- 172.21.15.78:0/1059593253 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c0a8e20 con 0x7f214c071f50 2024-05-21T14:43:55.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.376+0000 7f2152800640 1 -- 172.21.15.78:0/1059593253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c071f50 msgr2=0x7f214c15c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:55.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.376+0000 7f2152800640 1 --2- 172.21.15.78:0/1059593253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c071f50 0x7f214c15c060 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f213c009870 tx=0x7f213c01ed50 comp rx=0 tx=0).stop 2024-05-21T14:43:55.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.376+0000 7f2152800640 1 -- 172.21.15.78:0/1059593253 shutdown_connections 2024-05-21T14:43:55.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.376+0000 7f2152800640 1 --2- 172.21.15.78:0/1059593253 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f214c0c7ff0 0x7f214c0cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.376+0000 7f2152800640 1 --2- 172.21.15.78:0/1059593253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c071f50 0x7f214c15c060 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.376+0000 7f2152800640 1 -- 172.21.15.78:0/1059593253 >> 172.21.15.78:0/1059593253 conn(0x7f214c06b620 msgr2=0x7f214c06ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:55.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.376+0000 7f2152800640 1 -- 172.21.15.78:0/1059593253 shutdown_connections 2024-05-21T14:43:55.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.376+0000 7f2152800640 1 -- 172.21.15.78:0/1059593253 wait complete. 2024-05-21T14:43:55.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f2152800640 1 Processor -- start 2024-05-21T14:43:55.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f2152800640 1 -- start start 2024-05-21T14:43:55.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f2152800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c071f50 0x7f214c0c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:55.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f2152800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f214c0c7ff0 0x7f214c1f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:55.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f2152800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f214c0cd930 0x7f214c151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:55.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f2152800640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f214c0734b0 con 0x7f214c0cd930 2024-05-21T14:43:55.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f2152800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f214c0731d0 con 0x7f214c071f50 2024-05-21T14:43:55.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f2152800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f214c15b7f0 con 0x7f214c0c7ff0 2024-05-21T14:43:55.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f214be00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f214c0cd930 0x7f214c151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:55.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f214be00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f214c0cd930 0x7f214c151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35356/0 (socket says 172.21.15.78:35356) 2024-05-21T14:43:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f214be00640 1 -- 172.21.15.78:0/3758684479 learned_addr learned my addr 172.21.15.78:0/3758684479 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f214aa00640 1 --2- 172.21.15.78:0/3758684479 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f214c0c7ff0 0x7f214c1f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f214b400640 1 --2- 172.21.15.78:0/3758684479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c071f50 0x7f214c0c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f214be00640 1 -- 172.21.15.78:0/3758684479 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f214c0c7ff0 msgr2=0x7f214c1f5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f214be00640 1 --2- 172.21.15.78:0/3758684479 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f214c0c7ff0 0x7f214c1f5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f214be00640 1 -- 172.21.15.78:0/3758684479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c071f50 msgr2=0x7f214c0c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f214be00640 1 --2- 172.21.15.78:0/3758684479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c071f50 0x7f214c0c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f214be00640 1 -- 172.21.15.78:0/3758684479 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214c1f5ee0 con 0x7f214c0cd930 2024-05-21T14:43:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f214aa00640 1 --2- 172.21.15.78:0/3758684479 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f214c0c7ff0 0x7f214c1f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:55.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.380+0000 7f214be00640 1 --2- 172.21.15.78:0/3758684479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f214c0cd930 0x7f214c151be0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f214400c730 tx=0x7f214400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:55.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.384+0000 7f2143400640 1 -- 172.21.15.78:0/3758684479 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2144003b80 con 0x7f214c0cd930 2024-05-21T14:43:55.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.384+0000 7f2143400640 1 -- 172.21.15.78:0/3758684479 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2144003d20 con 0x7f214c0cd930 2024-05-21T14:43:55.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.384+0000 7f2152800640 1 -- 172.21.15.78:0/3758684479 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f214c158260 con 0x7f214c0cd930 2024-05-21T14:43:55.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.384+0000 7f2143400640 1 -- 172.21.15.78:0/3758684479 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2144005310 con 0x7f214c0cd930 2024-05-21T14:43:55.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.384+0000 7f2152800640 1 -- 172.21.15.78:0/3758684479 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f214c15b460 con 0x7f214c0cd930 2024-05-21T14:43:55.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.384+0000 7f2152800640 1 -- 172.21.15.78:0/3758684479 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f214c04f730 con 0x7f214c0cd930 2024-05-21T14:43:55.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.384+0000 7f2143400640 1 -- 172.21.15.78:0/3758684479 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f21440056c0 con 0x7f214c0cd930 2024-05-21T14:43:55.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.384+0000 7f2143400640 1 --2- 172.21.15.78:0/3758684479 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f212c0678c0 0x7f212c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:55.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.384+0000 7f2143400640 1 -- 172.21.15.78:0/3758684479 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2144085d30 con 0x7f214c0cd930 2024-05-21T14:43:55.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.384+0000 7f214b400640 1 --2- 172.21.15.78:0/3758684479 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f212c0678c0 0x7f212c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:55.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.388+0000 7f214b400640 1 --2- 172.21.15.78:0/3758684479 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f212c0678c0 0x7f212c069dd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f213c0b2000 tx=0x7f213c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:55.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.388+0000 7f2143400640 1 -- 172.21.15.78:0/3758684479 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f21440567d0 con 0x7f214c0cd930 2024-05-21T14:43:55.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.580+0000 7f2152800640 1 -- 172.21.15.78:0/3758684479 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f214c074cc0 con 0x7f214c0cd930 2024-05-21T14:43:55.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.580+0000 7f2143400640 1 -- 172.21.15.78:0/3758684479 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f21440560d0 con 0x7f214c0cd930 2024-05-21T14:43:55.590 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-21T14:43:55.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.584+0000 7f2152800640 1 -- 172.21.15.78:0/3758684479 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f212c0678c0 msgr2=0x7f212c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:55.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.584+0000 7f2152800640 1 --2- 172.21.15.78:0/3758684479 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f212c0678c0 0x7f212c069dd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f213c0b2000 tx=0x7f213c009040 comp rx=0 tx=0).stop 2024-05-21T14:43:55.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.584+0000 7f2152800640 1 -- 172.21.15.78:0/3758684479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f214c0cd930 msgr2=0x7f214c151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:55.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.584+0000 7f2152800640 1 --2- 172.21.15.78:0/3758684479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f214c0cd930 0x7f214c151be0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f214400c730 tx=0x7f214400cbf0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.584+0000 7f2152800640 1 -- 172.21.15.78:0/3758684479 shutdown_connections 2024-05-21T14:43:55.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.584+0000 7f2152800640 1 --2- 172.21.15.78:0/3758684479 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f212c0678c0 0x7f212c069dd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.584+0000 7f2152800640 1 --2- 172.21.15.78:0/3758684479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f214c0cd930 0x7f214c151be0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.584+0000 7f2152800640 1 --2- 172.21.15.78:0/3758684479 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f214c0c7ff0 0x7f214c1f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.584+0000 7f2152800640 1 --2- 172.21.15.78:0/3758684479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c071f50 0x7f214c0c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:55.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.584+0000 7f2152800640 1 -- 172.21.15.78:0/3758684479 >> 172.21.15.78:0/3758684479 conn(0x7f214c06b620 msgr2=0x7f214c153fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:55.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.584+0000 7f2152800640 1 -- 172.21.15.78:0/3758684479 shutdown_connections 2024-05-21T14:43:55.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55.584+0000 7f2152800640 1 -- 172.21.15.78:0/3758684479 wait complete. 2024-05-21T14:43:55.612 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-21T14:43:55.612 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-21T14:43:55.612 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2024-05-21T14:43:55.612 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-21T14:43:55.612 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-21T14:43:55.612 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-21T14:43:55.612 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-21T14:43:55.612 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-21T14:43:55.612 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-21T14:43:55.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T14:43:55.613 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2024-05-21T14:43:55.621 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-21T14:43:55.621 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-21T14:43:55.621 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-05-21T14:43:55.622 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-05-21T14:43:55.622 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-05-21T14:43:55.622 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-05-21T14:43:55.622 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-21T14:43:55.622 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2024-05-21T14:43:55.622 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2024-05-21T14:43:55.622 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-21T14:43:55.622 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2024-05-21T14:43:55.622 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2024-05-21T14:43:55.622 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-21T14:43:55.622 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2024-05-21T14:43:55.622 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-21T14:43:55.623 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2024-05-21T14:43:55.623 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-21T14:43:55.623 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42433sec preferred_lft 42433sec 2024-05-21T14:43:55.623 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2024-05-21T14:43:55.623 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-05-21T14:43:55.623 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-21T14:43:55.623 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:02:7c:60:95 brd ff:ff:ff:ff:ff:ff 2024-05-21T14:43:55.623 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-21T14:43:55.623 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-05-21T14:43:55.624 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-21T14:43:55.624 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T14:43:55.624 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-05-21T14:43:55.625 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add name ceph-brx type bridge 2024-05-21T14:43:55.625 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr flush dev ceph-brx 2024-05-21T14:43:55.625 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set ceph-brx up 2024-05-21T14:43:55.625 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-21T14:43:55.625 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-05-21T14:43:55.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T14:43:55.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T14:43:55.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T14:43:55.783 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-21T14:43:55.802 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-05-21T14:43:55.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T14:43:55.805 DEBUG:teuthology.orchestra.run.smithi078:> route 2024-05-21T14:43:55.896 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2024-05-21T14:43:55.896 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-21T14:43:55.896 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-21T14:43:55.896 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-21T14:43:55.896 INFO:teuthology.orchestra.run.smithi078.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-21T14:43:55.896 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-21T14:43:55.896 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-21T14:43:55.896 INFO:teuthology.orchestra.run.smithi078.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-21T14:43:55.897 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-21T14:43:55.897 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-21T14:43:55.897 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-21T14:43:55.897 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T14:43:55.897 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-05-21T14:43:55.897 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-21T14:43:55.897 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-21T14:43:55.898 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-21T14:43:55.898 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-05-21T14:43:55.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T14:43:55.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T14:43:55.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T14:43:55.992 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-05-21T14:43:56.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T14:43:56.048 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2024-05-21T14:43:56.103 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T14:43:56.103 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-05-21T14:43:56.103 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-21T14:43:56.103 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-21T14:43:56.103 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-05-21T14:43:56.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T14:43:56.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T14:43:56.229 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-21T14:43:56.229 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T14:43:56.229 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-05-21T14:43:56.229 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-21T14:43:56.230 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-21T14:43:56.230 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-21T14:43:56.230 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-21T14:43:56.230 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-21T14:43:56.230 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-05-21T14:43:56.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T14:43:56.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T14:43:56.432 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T14:43:56.432 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-05-21T14:43:56.432 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2024-05-21T14:43:56.432 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.0 master ceph-brx 2024-05-21T14:43:56.432 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-05-21T14:43:56.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T14:43:56.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T14:43:56.516 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-21T14:43:56.516 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-21T14:43:56.567 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-21T14:43:56.567 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-21T14:43:56.567 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-21T14:43:56.618 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-21T14:43:56.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T14:43:56.618 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-21T14:43:56.718 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-21T14:43:56.718 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-21T14:43:57.286 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-21T14:43:57.286 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-21T14:43:57.286 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.84:3300,172.21.15.84:3301" 2024-05-21T14:43:57.286 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with new device syntax: 0@6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa.cephfs=/ 2024-05-21T14:43:57.287 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.78:3300/172.21.15.84:3300/172.21.15.84:3301" will pass to kernel 2024-05-21T14:43:57.290 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-21T14:43:57.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T14:43:57.290 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-21T14:43:57.313 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-21T14:43:57.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-21T14:43:57.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T14:43:57.433 INFO:teuthology.orchestra.run.smithi078.stdout:client4825 2024-05-21T14:43:57.434 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:43:57.434 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-21T14:43:57.442 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-21T14:43:57.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-21T14:43:57.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T14:43:57.549 INFO:teuthology.orchestra.run.smithi078.stdout:client4825 2024-05-21T14:43:57.550 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-21T14:43:57.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-21T14:43:57.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T14:43:57.613 INFO:teuthology.orchestra.run.smithi078.stdout:client4825 2024-05-21T14:43:57.614 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa.client4825/status') 2024-05-21T14:43:57.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T14:43:57.679 INFO:teuthology.orchestra.run.smithi078.stdout:instance: client.4825 (3)172.21.15.78:0/3646323472 2024-05-21T14:43:57.679 INFO:teuthology.orchestra.run.smithi078.stdout:blocklisted: false 2024-05-21T14:43:57.679 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records in 2024-05-21T14:43:57.679 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records out 2024-05-21T14:43:57.679 INFO:teuthology.orchestra.run.smithi078.stderr:70 bytes copied, 8.1334e-05 s, 861 kB/s 2024-05-21T14:43:57.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T14:43:57.687 INFO:teuthology.run_tasks:Running task mds_thrash... 2024-05-21T14:43:57.698 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:43:57.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.836+0000 7efcbbc00640 1 Processor -- start 2024-05-21T14:43:57.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.836+0000 7efcbbc00640 1 -- start start 2024-05-21T14:43:57.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.840+0000 7efcbbc00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efcb41529d0 0x7efcb4072e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:57.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.840+0000 7efcbbc00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efcb4071fe0 0x7efcb40723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:57.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.840+0000 7efcbbc00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb4073380 con 0x7efcb40c5640 2024-05-21T14:43:57.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.840+0000 7efcbbc00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7efcb40715f0 con 0x7efcb41529d0 2024-05-21T14:43:57.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.840+0000 7efcbbc00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7efcb4072b80 con 0x7efcb4071fe0 2024-05-21T14:43:57.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.840+0000 7efcb9200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efcb41529d0 0x7efcb4072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:57.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.840+0000 7efcb9c00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efcb40c5640 0x7efcb406b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36996/0 (socket says 172.21.15.78:36996) 2024-05-21T14:43:57.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.840+0000 7efcb9c00640 1 -- 172.21.15.78:0/2002243459 learned_addr learned my addr 172.21.15.78:0/2002243459 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:57.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.840+0000 7efcabe00640 1 --2- 172.21.15.78:0/2002243459 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efcb4071fe0 0x7efcb40723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:57.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.840+0000 7efcb9200640 1 -- 172.21.15.78:0/2002243459 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efcb4071fe0 msgr2=0x7efcb40723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:57.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.840+0000 7efcb9200640 1 --2- 172.21.15.78:0/2002243459 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efcb4071fe0 0x7efcb40723f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:57.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.840+0000 7efcb9200640 1 -- 172.21.15.78:0/2002243459 >> v1:172.21.15.78:6789/0 conn(0x7efcb40c5640 legacy=0x7efcb406b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:57.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.840+0000 7efcb3e00640 1 -- 172.21.15.78:0/2002243459 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3571085367 0 0) 0x7efcac0014a0 con 0x7efcb40c5640 2024-05-21T14:43:57.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.840+0000 7efcb9200640 1 -- 172.21.15.78:0/2002243459 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb40c8530 con 0x7efcb41529d0 2024-05-21T14:43:57.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.844+0000 7efcb9200640 1 --2- 172.21.15.78:0/2002243459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb41529d0 0x7efcb4072e40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efca40097c0 tx=0x7efca401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e90ca4ecd623f06 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:57.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.844+0000 7efcb3e00640 1 -- 172.21.15.78:0/2002243459 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca40b0070 con 0x7efcb41529d0 2024-05-21T14:43:57.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.844+0000 7efcb3e00640 1 -- 172.21.15.78:0/2002243459 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca40ab600 con 0x7efcb41529d0 2024-05-21T14:43:57.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.844+0000 7efcb3e00640 1 -- 172.21.15.78:0/2002243459 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca40ab9d0 con 0x7efcb41529d0 2024-05-21T14:43:57.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.844+0000 7efcbbc00640 1 -- 172.21.15.78:0/2002243459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb41529d0 msgr2=0x7efcb4072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:57.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.844+0000 7efcbbc00640 1 --2- 172.21.15.78:0/2002243459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb41529d0 0x7efcb4072e40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efca40097c0 tx=0x7efca401c4c0 comp rx=0 tx=0).stop 2024-05-21T14:43:57.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.844+0000 7efcbbc00640 1 -- 172.21.15.78:0/2002243459 shutdown_connections 2024-05-21T14:43:57.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.844+0000 7efcbbc00640 1 --2- 172.21.15.78:0/2002243459 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efcb4071fe0 0x7efcb40723f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:57.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.844+0000 7efcbbc00640 1 --2- 172.21.15.78:0/2002243459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb41529d0 0x7efcb4072e40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:57.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.844+0000 7efcbbc00640 1 -- 172.21.15.78:0/2002243459 >> 172.21.15.78:0/2002243459 conn(0x7efcb40c9380 msgr2=0x7efcb40c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:57.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.844+0000 7efcbbc00640 1 -- 172.21.15.78:0/2002243459 shutdown_connections 2024-05-21T14:43:57.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.844+0000 7efcbbc00640 1 -- 172.21.15.78:0/2002243459 wait complete. 2024-05-21T14:43:57.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.844+0000 7efcbbc00640 1 Processor -- start 2024-05-21T14:43:57.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.844+0000 7efcbbc00640 1 -- start start 2024-05-21T14:43:57.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcbbc00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb4071fe0 0x7efcb41f8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:57.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcbbc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcb40c5640 0x7efcb4151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:57.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcbbc00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efcb41529d0 0x7efcb4145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:57.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcbbc00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efcb40c3a20 con 0x7efcb4071fe0 2024-05-21T14:43:57.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcbbc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efcb40c38a0 con 0x7efcb40c5640 2024-05-21T14:43:57.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcbbc00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7efcb4163e90 con 0x7efcb41529d0 2024-05-21T14:43:57.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcb9200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb4071fe0 0x7efcb41f8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:57.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcb9200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb4071fe0 0x7efcb41f8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35384/0 (socket says 172.21.15.78:35384) 2024-05-21T14:43:57.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcb9200640 1 -- 172.21.15.78:0/3607158772 learned_addr learned my addr 172.21.15.78:0/3607158772 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:57.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcabe00640 1 --2- 172.21.15.78:0/3607158772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcb40c5640 0x7efcb4151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:57.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcb9c00640 1 --2- 172.21.15.78:0/3607158772 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efcb41529d0 0x7efcb4145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:57.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcb9200640 1 -- 172.21.15.78:0/3607158772 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efcb41529d0 msgr2=0x7efcb4145c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:57.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcb9200640 1 --2- 172.21.15.78:0/3607158772 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efcb41529d0 0x7efcb4145c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:57.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcb9200640 1 -- 172.21.15.78:0/3607158772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcb40c5640 msgr2=0x7efcb4151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:57.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcb9200640 1 --2- 172.21.15.78:0/3607158772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcb40c5640 0x7efcb4151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:57.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcb9200640 1 -- 172.21.15.78:0/3607158772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb4165cd0 con 0x7efcb4071fe0 2024-05-21T14:43:57.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcb9200640 1 --2- 172.21.15.78:0/3607158772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb4071fe0 0x7efcb41f8e00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efca401a0f0 tx=0x7efca401ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:57.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcb1600640 1 -- 172.21.15.78:0/3607158772 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca40b0050 con 0x7efcb4071fe0 2024-05-21T14:43:57.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcb1600640 1 -- 172.21.15.78:0/3607158772 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca40bc070 con 0x7efcb4071fe0 2024-05-21T14:43:57.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcb1600640 1 -- 172.21.15.78:0/3607158772 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca40b5850 con 0x7efcb4071fe0 2024-05-21T14:43:57.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcbbc00640 1 -- 172.21.15.78:0/3607158772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb4165fb0 con 0x7efcb4071fe0 2024-05-21T14:43:57.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcbbc00640 1 -- 172.21.15.78:0/3607158772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb41620f0 con 0x7efcb4071fe0 2024-05-21T14:43:57.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.848+0000 7efcbbc00640 1 -- 172.21.15.78:0/3607158772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb404f730 con 0x7efcb4071fe0 2024-05-21T14:43:57.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.852+0000 7efcb1600640 1 -- 172.21.15.78:0/3607158772 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efca40b59f0 con 0x7efcb4071fe0 2024-05-21T14:43:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.852+0000 7efcb1600640 1 --2- 172.21.15.78:0/3607158772 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efc900678c0 0x7efc90069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.852+0000 7efcb1600640 1 -- 172.21.15.78:0/3607158772 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efca4120480 con 0x7efcb4071fe0 2024-05-21T14:43:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.852+0000 7efcabe00640 1 --2- 172.21.15.78:0/3607158772 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efc900678c0 0x7efc90069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:57.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.852+0000 7efcabe00640 1 --2- 172.21.15.78:0/3607158772 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efc900678c0 0x7efc90069dd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efcb4146e00 tx=0x7efc9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:57.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:57.856+0000 7efcb1600640 1 -- 172.21.15.78:0/3607158772 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7efca40160b0 con 0x7efcb4071fe0 2024-05-21T14:43:58.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.016+0000 7efcbbc00640 1 -- 172.21.15.78:0/3607158772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efcb4071dc0 con 0x7efcb4071fe0 2024-05-21T14:43:58.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.016+0000 7efcb1600640 1 -- 172.21.15.78:0/3607158772 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16537 (secure 0 0 0) 0x7efca40f1040 con 0x7efcb4071fe0 2024-05-21T14:43:58.026 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:58.026 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:20.573644+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T14:43:17.088549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T14:43:18.012571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:43:58.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.016+0000 7efcbbc00640 1 -- 172.21.15.78:0/3607158772 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efc900678c0 msgr2=0x7efc90069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.016+0000 7efcbbc00640 1 --2- 172.21.15.78:0/3607158772 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efc900678c0 0x7efc90069dd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efcb4146e00 tx=0x7efc9c008040 comp rx=0 tx=0).stop 2024-05-21T14:43:58.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.016+0000 7efcbbc00640 1 -- 172.21.15.78:0/3607158772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb4071fe0 msgr2=0x7efcb41f8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.016+0000 7efcbbc00640 1 --2- 172.21.15.78:0/3607158772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb4071fe0 0x7efcb41f8e00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efca401a0f0 tx=0x7efca401ad00 comp rx=0 tx=0).stop 2024-05-21T14:43:58.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.016+0000 7efcbbc00640 1 -- 172.21.15.78:0/3607158772 shutdown_connections 2024-05-21T14:43:58.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.016+0000 7efcbbc00640 1 --2- 172.21.15.78:0/3607158772 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7efc900678c0 0x7efc90069dd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.016+0000 7efcbbc00640 1 --2- 172.21.15.78:0/3607158772 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efcb41529d0 0x7efcb4145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.016+0000 7efcbbc00640 1 --2- 172.21.15.78:0/3607158772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcb40c5640 0x7efcb4151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.016+0000 7efcbbc00640 1 --2- 172.21.15.78:0/3607158772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb4071fe0 0x7efcb41f8e00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.016+0000 7efcbbc00640 1 -- 172.21.15.78:0/3607158772 >> 172.21.15.78:0/3607158772 conn(0x7efcb40c9380 msgr2=0x7efcb40c6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:58.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.016+0000 7efcbbc00640 1 -- 172.21.15.78:0/3607158772 shutdown_connections 2024-05-21T14:43:58.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.020+0000 7efcbbc00640 1 -- 172.21.15.78:0/3607158772 wait complete. 2024-05-21T14:43:58.047 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-21T14:43:06.569415+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-21T14:43:17.088549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-21T14:43:18.012571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-21T14:43:58.048 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-21T14:43:58.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.188+0000 7f2b04c00640 1 Processor -- start 2024-05-21T14:43:58.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.188+0000 7f2b04c00640 1 -- start start 2024-05-21T14:43:58.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.192+0000 7f2b04c00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2b001538d0 0x7f2b000735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.192+0000 7f2b04c00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b000c7240 con 0x7f2b000c7f90 2024-05-21T14:43:58.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.192+0000 7f2b04c00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b000c6c50 con 0x7f2b000c5c30 2024-05-21T14:43:58.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.192+0000 7f2b04c00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f2b000c4370 con 0x7f2b001538d0 2024-05-21T14:43:58.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.192+0000 7f2afe800640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2b001538d0 0x7f2b000735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.192+0000 7f2af5400640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2b000c7f90 0x7f2b000c6540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37012/0 (socket says 172.21.15.78:37012) 2024-05-21T14:43:58.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.192+0000 7f2af5400640 1 -- 172.21.15.78:0/715831402 learned_addr learned my addr 172.21.15.78:0/715831402 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:58.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.192+0000 7f2afe800640 1 -- 172.21.15.78:0/715831402 >> v1:172.21.15.84:6789/0 conn(0x7f2b000c5c30 legacy=0x7f2b0015cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.192+0000 7f2afe800640 1 -- 172.21.15.78:0/715831402 >> v1:172.21.15.78:6789/0 conn(0x7f2b000c7f90 legacy=0x7f2b000c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.192+0000 7f2afe800640 1 -- 172.21.15.78:0/715831402 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b000c74e0 con 0x7f2b001538d0 2024-05-21T14:43:58.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.192+0000 7f2afd400640 1 -- 172.21.15.78:0/715831402 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 184711016 0 0) 0x7f2b000c7240 con 0x7f2b000c7f90 2024-05-21T14:43:58.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.192+0000 7f2afe800640 1 --2- 172.21.15.78:0/715831402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b001538d0 0x7f2b000735e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2b000c44f0 tx=0x7f2af801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7766c2ab19538926 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:58.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.192+0000 7f2afd400640 1 -- 172.21.15.78:0/715831402 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af80b2070 con 0x7f2b001538d0 2024-05-21T14:43:58.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.192+0000 7f2afd400640 1 -- 172.21.15.78:0/715831402 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af80a5810 con 0x7f2b001538d0 2024-05-21T14:43:58.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.192+0000 7f2afd400640 1 -- 172.21.15.78:0/715831402 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af80a5be0 con 0x7f2b001538d0 2024-05-21T14:43:58.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.196+0000 7f2b04c00640 1 -- 172.21.15.78:0/715831402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b001538d0 msgr2=0x7f2b000735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.196+0000 7f2b04c00640 1 --2- 172.21.15.78:0/715831402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b001538d0 0x7f2b000735e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2b000c44f0 tx=0x7f2af801c950 comp rx=0 tx=0).stop 2024-05-21T14:43:58.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.196+0000 7f2b04c00640 1 -- 172.21.15.78:0/715831402 shutdown_connections 2024-05-21T14:43:58.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.196+0000 7f2b04c00640 1 --2- 172.21.15.78:0/715831402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b001538d0 0x7f2b000735e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.196+0000 7f2b04c00640 1 -- 172.21.15.78:0/715831402 >> 172.21.15.78:0/715831402 conn(0x7f2b000cd1e0 msgr2=0x7f2b000c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:58.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.196+0000 7f2b04c00640 1 -- 172.21.15.78:0/715831402 shutdown_connections 2024-05-21T14:43:58.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.196+0000 7f2b04c00640 1 -- 172.21.15.78:0/715831402 wait complete. 2024-05-21T14:43:58.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.196+0000 7f2b04c00640 1 Processor -- start 2024-05-21T14:43:58.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.196+0000 7f2b04c00640 1 -- start start 2024-05-21T14:43:58.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2b04c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2b000c5c30 0x7f2b00152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2b04c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b000c7f90 0x7f2b00149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2b04c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b001538d0 0x7f2b00143f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2b04c00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2b00167850 con 0x7f2b000c7f90 2024-05-21T14:43:58.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2b04c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2b00153ce0 con 0x7f2b001538d0 2024-05-21T14:43:58.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2b04c00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f2b001679d0 con 0x7f2b000c5c30 2024-05-21T14:43:58.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2af5400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b000c7f90 0x7f2b00149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2af5400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b000c7f90 0x7f2b00149b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35396/0 (socket says 172.21.15.78:35396) 2024-05-21T14:43:58.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2af5400640 1 -- 172.21.15.78:0/3461529802 learned_addr learned my addr 172.21.15.78:0/3461529802 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:58.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2afde00640 1 --2- 172.21.15.78:0/3461529802 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2b000c5c30 0x7f2b00152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2afe800640 1 --2- 172.21.15.78:0/3461529802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b001538d0 0x7f2b00143f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2af5400640 1 -- 172.21.15.78:0/3461529802 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2b000c5c30 msgr2=0x7f2b00152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2af5400640 1 --2- 172.21.15.78:0/3461529802 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2b000c5c30 0x7f2b00152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2af5400640 1 -- 172.21.15.78:0/3461529802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b001538d0 msgr2=0x7f2b00143f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2af5400640 1 --2- 172.21.15.78:0/3461529802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b001538d0 0x7f2b00143f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2af5400640 1 -- 172.21.15.78:0/3461529802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b00152f70 con 0x7f2b000c7f90 2024-05-21T14:43:58.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2af5400640 1 --2- 172.21.15.78:0/3461529802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b000c7f90 0x7f2b00149b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800c440 tx=0x7f2ae800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:58.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2af6a00640 1 -- 172.21.15.78:0/3461529802 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8018070 con 0x7f2b000c7f90 2024-05-21T14:43:58.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2af6a00640 1 -- 172.21.15.78:0/3461529802 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae80074e0 con 0x7f2b000c7f90 2024-05-21T14:43:58.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2b04c00640 1 -- 172.21.15.78:0/3461529802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b00072830 con 0x7f2b000c7f90 2024-05-21T14:43:58.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2af6a00640 1 -- 172.21.15.78:0/3461529802 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8004a30 con 0x7f2b000c7f90 2024-05-21T14:43:58.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2b04c00640 1 -- 172.21.15.78:0/3461529802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b00072df0 con 0x7f2b000c7f90 2024-05-21T14:43:58.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.200+0000 7f2b04c00640 1 -- 172.21.15.78:0/3461529802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b00152ce0 con 0x7f2b000c7f90 2024-05-21T14:43:58.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.204+0000 7f2af6a00640 1 -- 172.21.15.78:0/3461529802 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ae801b070 con 0x7f2b000c7f90 2024-05-21T14:43:58.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.204+0000 7f2af6a00640 1 --2- 172.21.15.78:0/3461529802 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2adc0678f0 0x7f2adc069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.204+0000 7f2af6a00640 1 -- 172.21.15.78:0/3461529802 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2ae8084eb0 con 0x7f2b000c7f90 2024-05-21T14:43:58.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.204+0000 7f2afde00640 1 --2- 172.21.15.78:0/3461529802 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2adc0678f0 0x7f2adc069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.204+0000 7f2afde00640 1 --2- 172.21.15.78:0/3461529802 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2adc0678f0 0x7f2adc069e00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2af0007fd0 tx=0x7f2af0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:58.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.208+0000 7f2af6a00640 1 -- 172.21.15.78:0/3461529802 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f2ae8055300 con 0x7f2b000c7f90 2024-05-21T14:43:58.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.364+0000 7f2b04c00640 1 -- 172.21.15.78:0/3461529802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2b000c7b40 con 0x7f2b000c7f90 2024-05-21T14:43:58.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.364+0000 7f2af6a00640 1 -- 172.21.15.78:0/3461529802 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f2ae8059600 con 0x7f2b000c7f90 2024-05-21T14:43:58.373 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-05-21T14:43:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.364+0000 7f2b04c00640 1 -- 172.21.15.78:0/3461529802 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2adc0678f0 msgr2=0x7f2adc069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.364+0000 7f2b04c00640 1 --2- 172.21.15.78:0/3461529802 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2adc0678f0 0x7f2adc069e00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2af0007fd0 tx=0x7f2af0009040 comp rx=0 tx=0).stop 2024-05-21T14:43:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.364+0000 7f2b04c00640 1 -- 172.21.15.78:0/3461529802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b000c7f90 msgr2=0x7f2b00149b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.364+0000 7f2b04c00640 1 --2- 172.21.15.78:0/3461529802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b000c7f90 0x7f2b00149b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800c440 tx=0x7f2ae800c900 comp rx=0 tx=0).stop 2024-05-21T14:43:58.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.368+0000 7f2b04c00640 1 -- 172.21.15.78:0/3461529802 shutdown_connections 2024-05-21T14:43:58.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.368+0000 7f2b04c00640 1 --2- 172.21.15.78:0/3461529802 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f2adc0678f0 0x7f2adc069e00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.368+0000 7f2b04c00640 1 --2- 172.21.15.78:0/3461529802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b001538d0 0x7f2b00143f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.368+0000 7f2b04c00640 1 --2- 172.21.15.78:0/3461529802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b000c7f90 0x7f2b00149b50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.368+0000 7f2b04c00640 1 --2- 172.21.15.78:0/3461529802 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2b000c5c30 0x7f2b00152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.368+0000 7f2b04c00640 1 -- 172.21.15.78:0/3461529802 >> 172.21.15.78:0/3461529802 conn(0x7f2b000cd1e0 msgr2=0x7f2b0006f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:58.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.368+0000 7f2b04c00640 1 -- 172.21.15.78:0/3461529802 shutdown_connections 2024-05-21T14:43:58.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.368+0000 7f2b04c00640 1 -- 172.21.15.78:0/3461529802 wait complete. 2024-05-21T14:43:58.395 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-21T14:43:58.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.536+0000 7ff8d6200640 1 Processor -- start 2024-05-21T14:43:58.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.536+0000 7ff8d6200640 1 -- start start 2024-05-21T14:43:58.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.536+0000 7ff8d6200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff8d00caad0 0x7ff8d00caee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.536+0000 7ff8d6200640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8d0070800 con 0x7ff8d00c7fa0 2024-05-21T14:43:58.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.536+0000 7ff8d6200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8d006fad0 con 0x7ff8d0159830 2024-05-21T14:43:58.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.536+0000 7ff8d6200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff8d006fd90 con 0x7ff8d00caad0 2024-05-21T14:43:58.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.536+0000 7ff8cf400640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff8d00c7fa0 0x7ff8d006f3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37020/0 (socket says 172.21.15.78:37020) 2024-05-21T14:43:58.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.536+0000 7ff8cf400640 1 -- 172.21.15.78:0/330106240 learned_addr learned my addr 172.21.15.78:0/330106240 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:58.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.536+0000 7ff8cea00640 1 --2- 172.21.15.78:0/330106240 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff8d00caad0 0x7ff8d00caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8ce000640 1 -- 172.21.15.78:0/330106240 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503071528 0 0) 0x7ff8d0070800 con 0x7ff8d00c7fa0 2024-05-21T14:43:58.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8ce000640 1 -- 172.21.15.78:0/330106240 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8b4003530 con 0x7ff8d00c7fa0 2024-05-21T14:43:58.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8ce000640 1 -- 172.21.15.78:0/330106240 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 252117784 0 0) 0x7ff8b4003530 con 0x7ff8d00c7fa0 2024-05-21T14:43:58.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8ce000640 1 -- 172.21.15.78:0/330106240 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff8d00caad0 msgr2=0x7ff8d00caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:58.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8ce000640 1 --2- 172.21.15.78:0/330106240 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff8d00caad0 0x7ff8d00caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8ce000640 1 -- 172.21.15.78:0/330106240 >> v1:172.21.15.84:6789/0 conn(0x7ff8d0159830 legacy=0x7ff8d0159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8ce000640 1 -- 172.21.15.78:0/330106240 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d015cd40 con 0x7ff8d00c7fa0 2024-05-21T14:43:58.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8ce000640 1 -- 172.21.15.78:0/330106240 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7ff8c0001a20 con 0x7ff8d00c7fa0 2024-05-21T14:43:58.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8ce000640 1 -- 172.21.15.78:0/330106240 >> v1:172.21.15.78:6789/0 conn(0x7ff8d00c7fa0 legacy=0x7ff8d006f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8ce000640 1 --2- 172.21.15.78:0/330106240 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff8d00caad0 0x7ff8b4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8ce000640 1 --2- 172.21.15.78:0/330106240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4003fc0 0x7ff8b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8ce000640 1 --2- 172.21.15.78:0/330106240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8b4004d50 0x7ff8b4005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8ce000640 1 -- 172.21.15.78:0/330106240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d006fd90 con 0x7ff8b4003fc0 2024-05-21T14:43:58.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8ce000640 1 -- 172.21.15.78:0/330106240 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b400bb60 con 0x7ff8b4004d50 2024-05-21T14:43:58.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8ce000640 1 -- 172.21.15.78:0/330106240 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff8b400bd60 con 0x7ff8d00caad0 2024-05-21T14:43:58.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8cea00640 1 --2- 172.21.15.78:0/330106240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4003fc0 0x7ff8b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8cf400640 1 --2- 172.21.15.78:0/330106240 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff8d00caad0 0x7ff8b4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8cfe00640 1 --2- 172.21.15.78:0/330106240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8b4004d50 0x7ff8b4005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8cea00640 1 -- 172.21.15.78:0/330106240 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff8d00caad0 msgr2=0x7ff8b4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:58.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8cea00640 1 --2- 172.21.15.78:0/330106240 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff8d00caad0 0x7ff8b4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8cea00640 1 -- 172.21.15.78:0/330106240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8b4004d50 msgr2=0x7ff8b4005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:58.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8cea00640 1 --2- 172.21.15.78:0/330106240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8b4004d50 0x7ff8b4005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8cea00640 1 -- 172.21.15.78:0/330106240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b4003530 con 0x7ff8b4003fc0 2024-05-21T14:43:58.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.540+0000 7ff8cfe00640 1 --2- 172.21.15.78:0/330106240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8b4004d50 0x7ff8b4005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:43:58.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.544+0000 7ff8cea00640 1 --2- 172.21.15.78:0/330106240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4003fc0 0x7ff8b4004810 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009ae0 tx=0x7ff8bc01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff01a8bf900b640 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:58.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.544+0000 7ff8ce000640 1 -- 172.21.15.78:0/330106240 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0b2070 con 0x7ff8b4003fc0 2024-05-21T14:43:58.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.544+0000 7ff8ce000640 1 -- 172.21.15.78:0/330106240 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8bc0a5570 con 0x7ff8b4003fc0 2024-05-21T14:43:58.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.544+0000 7ff8ce000640 1 -- 172.21.15.78:0/330106240 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0096b0 con 0x7ff8b4003fc0 2024-05-21T14:43:58.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.544+0000 7ff8d6200640 1 -- 172.21.15.78:0/330106240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4003fc0 msgr2=0x7ff8b4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.544+0000 7ff8d6200640 1 --2- 172.21.15.78:0/330106240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4003fc0 0x7ff8b4004810 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009ae0 tx=0x7ff8bc01ca90 comp rx=0 tx=0).stop 2024-05-21T14:43:58.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.544+0000 7ff8cfe00640 1 -- 172.21.15.78:0/330106240 reap_dead start 2024-05-21T14:43:58.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.544+0000 7ff8d6200640 1 -- 172.21.15.78:0/330106240 shutdown_connections 2024-05-21T14:43:58.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.544+0000 7ff8d6200640 1 -- 172.21.15.78:0/330106240 >> 172.21.15.78:0/330106240 conn(0x7ff8d00cf460 msgr2=0x7ff8d0073670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:58.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.544+0000 7ff8d6200640 1 -- 172.21.15.78:0/330106240 shutdown_connections 2024-05-21T14:43:58.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.544+0000 7ff8d6200640 1 -- 172.21.15.78:0/330106240 wait complete. 2024-05-21T14:43:58.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.544+0000 7ff8d6200640 1 Processor -- start 2024-05-21T14:43:58.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.544+0000 7ff8d6200640 1 -- start start 2024-05-21T14:43:58.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8d6200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4003fc0 0x7ff8d01f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8d6200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8d0159e10 0x7ff8d0147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8d6200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff8d015a220 0x7ff8d0147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8d6200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d015d5e0 con 0x7ff8b4003fc0 2024-05-21T14:43:58.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8d6200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d015d300 con 0x7ff8d0159e10 2024-05-21T14:43:58.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8d6200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff8d015d8c0 con 0x7ff8d015a220 2024-05-21T14:43:58.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8cf400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4003fc0 0x7ff8d01f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8cf400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4003fc0 0x7ff8d01f1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35416/0 (socket says 172.21.15.78:35416) 2024-05-21T14:43:58.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8cf400640 1 -- 172.21.15.78:0/71603693 learned_addr learned my addr 172.21.15.78:0/71603693 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:58.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8cfe00640 1 --2- 172.21.15.78:0/71603693 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff8d015a220 0x7ff8d0147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8cea00640 1 --2- 172.21.15.78:0/71603693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8d0159e10 0x7ff8d0147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8cf400640 1 -- 172.21.15.78:0/71603693 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff8d015a220 msgr2=0x7ff8d0147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8cf400640 1 --2- 172.21.15.78:0/71603693 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff8d015a220 0x7ff8d0147950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8cf400640 1 -- 172.21.15.78:0/71603693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8d0159e10 msgr2=0x7ff8d0147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8cf400640 1 --2- 172.21.15.78:0/71603693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8d0159e10 0x7ff8d0147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8cf400640 1 -- 172.21.15.78:0/71603693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d0075340 con 0x7ff8b4003fc0 2024-05-21T14:43:58.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8cea00640 1 --2- 172.21.15.78:0/71603693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8d0159e10 0x7ff8d0147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:43:58.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8cf400640 1 --2- 172.21.15.78:0/71603693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4003fc0 0x7ff8d01f1570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0005c30 tx=0x7ff8c0011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:58.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8c7400640 1 -- 172.21.15.78:0/71603693 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0010040 con 0x7ff8b4003fc0 2024-05-21T14:43:58.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8c7400640 1 -- 172.21.15.78:0/71603693 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c001a070 con 0x7ff8b4003fc0 2024-05-21T14:43:58.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8c7400640 1 -- 172.21.15.78:0/71603693 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c000fd80 con 0x7ff8b4003fc0 2024-05-21T14:43:58.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8d6200640 1 -- 172.21.15.78:0/71603693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8d01f1ab0 con 0x7ff8b4003fc0 2024-05-21T14:43:58.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8d6200640 1 -- 172.21.15.78:0/71603693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d0158ed0 con 0x7ff8b4003fc0 2024-05-21T14:43:58.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.548+0000 7ff8d6200640 1 -- 172.21.15.78:0/71603693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8d004f730 con 0x7ff8b4003fc0 2024-05-21T14:43:58.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.552+0000 7ff8c7400640 1 -- 172.21.15.78:0/71603693 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff8c001f460 con 0x7ff8b4003fc0 2024-05-21T14:43:58.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.552+0000 7ff8c7400640 1 --2- 172.21.15.78:0/71603693 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff8b00678f0 0x7ff8b0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.552+0000 7ff8c7400640 1 -- 172.21.15.78:0/71603693 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff8c0088ff0 con 0x7ff8b4003fc0 2024-05-21T14:43:58.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.552+0000 7ff8cea00640 1 --2- 172.21.15.78:0/71603693 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff8b00678f0 0x7ff8b0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.552+0000 7ff8cea00640 1 --2- 172.21.15.78:0/71603693 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff8b00678f0 0x7ff8b0069e00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009ae0 tx=0x7ff8bc0046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:58.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.556+0000 7ff8c7400640 1 -- 172.21.15.78:0/71603693 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7ff8c0059a20 con 0x7ff8b4003fc0 2024-05-21T14:43:58.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.712+0000 7ff8d6200640 1 -- 172.21.15.78:0/71603693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff8d00c7b00 con 0x7ff8b4003fc0 2024-05-21T14:43:58.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.716+0000 7ff8c7400640 1 -- 172.21.15.78:0/71603693 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7ff8c0059320 con 0x7ff8b4003fc0 2024-05-21T14:43:58.724 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-05-21T14:43:58.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.716+0000 7ff8d6200640 1 -- 172.21.15.78:0/71603693 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff8b00678f0 msgr2=0x7ff8b0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.716+0000 7ff8d6200640 1 --2- 172.21.15.78:0/71603693 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff8b00678f0 0x7ff8b0069e00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009ae0 tx=0x7ff8bc0046d0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.716+0000 7ff8d6200640 1 -- 172.21.15.78:0/71603693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4003fc0 msgr2=0x7ff8d01f1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.716+0000 7ff8d6200640 1 --2- 172.21.15.78:0/71603693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4003fc0 0x7ff8d01f1570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0005c30 tx=0x7ff8c0011d10 comp rx=0 tx=0).stop 2024-05-21T14:43:58.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.716+0000 7ff8d6200640 1 -- 172.21.15.78:0/71603693 shutdown_connections 2024-05-21T14:43:58.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.716+0000 7ff8d6200640 1 --2- 172.21.15.78:0/71603693 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff8b00678f0 0x7ff8b0069e00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.716+0000 7ff8d6200640 1 --2- 172.21.15.78:0/71603693 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff8d015a220 0x7ff8d0147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.716+0000 7ff8d6200640 1 --2- 172.21.15.78:0/71603693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8d0159e10 0x7ff8d0147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.716+0000 7ff8d6200640 1 --2- 172.21.15.78:0/71603693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4003fc0 0x7ff8d01f1570 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.716+0000 7ff8d6200640 1 -- 172.21.15.78:0/71603693 >> 172.21.15.78:0/71603693 conn(0x7ff8d00cf460 msgr2=0x7ff8d00c7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:58.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.716+0000 7ff8d6200640 1 -- 172.21.15.78:0/71603693 shutdown_connections 2024-05-21T14:43:58.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.716+0000 7ff8d6200640 1 -- 172.21.15.78:0/71603693 wait complete. 2024-05-21T14:43:58.745 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-21T14:43:58.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.888+0000 7f0d82a00640 1 Processor -- start 2024-05-21T14:43:58.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.888+0000 7f0d82a00640 1 -- start start 2024-05-21T14:43:58.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d82a00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d7c155a30 0x7f0d7c15c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d82a00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d7c074150 con 0x7f0d7c071230 2024-05-21T14:43:58.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d82a00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d7c06d000 con 0x7f0d7c070e20 2024-05-21T14:43:58.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d82a00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0d7c06cdb0 con 0x7f0d7c155a30 2024-05-21T14:43:58.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d82000640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0d7c071230 0x7f0d7c073a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37028/0 (socket says 172.21.15.78:37028) 2024-05-21T14:43:58.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d82000640 1 -- 172.21.15.78:0/2074775512 learned_addr learned my addr 172.21.15.78:0/2074775512 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:58.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d81600640 1 --2- 172.21.15.78:0/2074775512 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d7c155a30 0x7f0d7c15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d7be00640 1 -- 172.21.15.78:0/2074775512 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3834413554 0 0) 0x7f0d7c074150 con 0x7f0d7c071230 2024-05-21T14:43:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d7be00640 1 -- 172.21.15.78:0/2074775512 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d64003530 con 0x7f0d7c071230 2024-05-21T14:43:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d7be00640 1 -- 172.21.15.78:0/2074775512 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1779979339 0 0) 0x7f0d64003530 con 0x7f0d7c071230 2024-05-21T14:43:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d7be00640 1 -- 172.21.15.78:0/2074775512 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d7c155a30 msgr2=0x7f0d7c15c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d7be00640 1 --2- 172.21.15.78:0/2074775512 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d7c155a30 0x7f0d7c15c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d7be00640 1 -- 172.21.15.78:0/2074775512 >> v1:172.21.15.84:6789/0 conn(0x7f0d7c070e20 legacy=0x7f0d7c073330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d7be00640 1 -- 172.21.15.78:0/2074775512 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7c06d2e0 con 0x7f0d7c071230 2024-05-21T14:43:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d7be00640 1 -- 172.21.15.78:0/2074775512 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7f0d74001a00 con 0x7f0d7c071230 2024-05-21T14:43:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d7be00640 1 -- 172.21.15.78:0/2074775512 >> v1:172.21.15.78:6789/0 conn(0x7f0d7c071230 legacy=0x7f0d7c073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d7be00640 1 --2- 172.21.15.78:0/2074775512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d640039f0 0x7f0d64003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d7be00640 1 --2- 172.21.15.78:0/2074775512 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d7c155a30 0x7f0d64004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d7be00640 1 --2- 172.21.15.78:0/2074775512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d64004d50 0x7f0d64005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d7be00640 1 -- 172.21.15.78:0/2074775512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c06cdb0 con 0x7f0d64004d50 2024-05-21T14:43:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d7be00640 1 -- 172.21.15.78:0/2074775512 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6400bb60 con 0x7f0d640039f0 2024-05-21T14:43:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d7be00640 1 -- 172.21.15.78:0/2074775512 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0d6400bd10 con 0x7f0d7c155a30 2024-05-21T14:43:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d82000640 1 --2- 172.21.15.78:0/2074775512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d64004d50 0x7f0d64005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d80c00640 1 --2- 172.21.15.78:0/2074775512 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d7c155a30 0x7f0d64004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d81600640 1 --2- 172.21.15.78:0/2074775512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d640039f0 0x7f0d64003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d82000640 1 -- 172.21.15.78:0/2074775512 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d7c155a30 msgr2=0x7f0d64004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d82000640 1 --2- 172.21.15.78:0/2074775512 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d7c155a30 0x7f0d64004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d82000640 1 -- 172.21.15.78:0/2074775512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d640039f0 msgr2=0x7f0d64003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d82000640 1 --2- 172.21.15.78:0/2074775512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d640039f0 0x7f0d64003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.892+0000 7f0d82000640 1 -- 172.21.15.78:0/2074775512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d64003530 con 0x7f0d64004d50 2024-05-21T14:43:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.896+0000 7f0d82000640 1 --2- 172.21.15.78:0/2074775512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d64004d50 0x7f0d64005160 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400a860 tx=0x7f0d7401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e0b521a3a8923a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.896+0000 7f0d7be00640 1 -- 172.21.15.78:0/2074775512 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7400a480 con 0x7f0d64004d50 2024-05-21T14:43:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.896+0000 7f0d7be00640 1 -- 172.21.15.78:0/2074775512 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d740ad630 con 0x7f0d64004d50 2024-05-21T14:43:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.896+0000 7f0d7be00640 1 -- 172.21.15.78:0/2074775512 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d740ada60 con 0x7f0d64004d50 2024-05-21T14:43:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.896+0000 7f0d82a00640 1 -- 172.21.15.78:0/2074775512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d64004d50 msgr2=0x7f0d64005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.896+0000 7f0d82a00640 1 --2- 172.21.15.78:0/2074775512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d64004d50 0x7f0d64005160 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400a860 tx=0x7f0d7401d300 comp rx=0 tx=0).stop 2024-05-21T14:43:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.896+0000 7f0d82000640 1 -- 172.21.15.78:0/2074775512 reap_dead start 2024-05-21T14:43:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.896+0000 7f0d82a00640 1 -- 172.21.15.78:0/2074775512 shutdown_connections 2024-05-21T14:43:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.896+0000 7f0d82a00640 1 -- 172.21.15.78:0/2074775512 >> 172.21.15.78:0/2074775512 conn(0x7f0d7c0cbbb0 msgr2=0x7f0d7c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.896+0000 7f0d82a00640 1 -- 172.21.15.78:0/2074775512 shutdown_connections 2024-05-21T14:43:58.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.896+0000 7f0d82a00640 1 -- 172.21.15.78:0/2074775512 wait complete. 2024-05-21T14:43:58.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d82a00640 1 Processor -- start 2024-05-21T14:43:58.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d82a00640 1 -- start start 2024-05-21T14:43:58.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d82a00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d64004d50 0x7f0d7c15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d82a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d7c0c7250 0x7f0d7c0cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d82a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d7c0c8340 0x7f0d7c150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d82a00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c15b8c0 con 0x7f0d7c0c7250 2024-05-21T14:43:58.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d82a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c071640 con 0x7f0d7c0c8340 2024-05-21T14:43:58.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d82a00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0d7c0ca0a0 con 0x7f0d64004d50 2024-05-21T14:43:58.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d80c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d7c0c7250 0x7f0d7c0cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d80c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d7c0c7250 0x7f0d7c0cd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35432/0 (socket says 172.21.15.78:35432) 2024-05-21T14:43:58.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d80c00640 1 -- 172.21.15.78:0/2625959742 learned_addr learned my addr 172.21.15.78:0/2625959742 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:58.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d81600640 1 --2- 172.21.15.78:0/2625959742 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d64004d50 0x7f0d7c15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d82000640 1 --2- 172.21.15.78:0/2625959742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d7c0c8340 0x7f0d7c150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d80c00640 1 -- 172.21.15.78:0/2625959742 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d64004d50 msgr2=0x7f0d7c15e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d80c00640 1 --2- 172.21.15.78:0/2625959742 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d64004d50 0x7f0d7c15e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d80c00640 1 -- 172.21.15.78:0/2625959742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d7c0c8340 msgr2=0x7f0d7c150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:58.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d80c00640 1 --2- 172.21.15.78:0/2625959742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d7c0c8340 0x7f0d7c150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:58.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d80c00640 1 -- 172.21.15.78:0/2625959742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7c15e930 con 0x7f0d7c0c7250 2024-05-21T14:43:58.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d81600640 1 --2- 172.21.15.78:0/2625959742 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d64004d50 0x7f0d7c15e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:58.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d80c00640 1 --2- 172.21.15.78:0/2625959742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d7c0c7250 0x7f0d7c0cd9a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800f5f0 tx=0x7f0d6800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:58.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d79600640 1 -- 172.21.15.78:0/2625959742 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d680053a0 con 0x7f0d7c0c7250 2024-05-21T14:43:58.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d79600640 1 -- 172.21.15.78:0/2625959742 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d68018070 con 0x7f0d7c0c7250 2024-05-21T14:43:58.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d82a00640 1 -- 172.21.15.78:0/2625959742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d7c1555d0 con 0x7f0d7c0c7250 2024-05-21T14:43:58.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.900+0000 7f0d79600640 1 -- 172.21.15.78:0/2625959742 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68003840 con 0x7f0d7c0c7250 2024-05-21T14:43:58.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.904+0000 7f0d82a00640 1 -- 172.21.15.78:0/2625959742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d7c1552f0 con 0x7f0d7c0c7250 2024-05-21T14:43:58.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.904+0000 7f0d82a00640 1 -- 172.21.15.78:0/2625959742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d7c153680 con 0x7f0d7c0c7250 2024-05-21T14:43:58.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.904+0000 7f0d79600640 1 -- 172.21.15.78:0/2625959742 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0d680039e0 con 0x7f0d7c0c7250 2024-05-21T14:43:58.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.904+0000 7f0d79600640 1 --2- 172.21.15.78:0/2625959742 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0d5c0678c0 0x7f0d5c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:58.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.904+0000 7f0d79600640 1 -- 172.21.15.78:0/2625959742 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f0d68085aa0 con 0x7f0d7c0c7250 2024-05-21T14:43:58.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.904+0000 7f0d81600640 1 --2- 172.21.15.78:0/2625959742 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0d5c0678c0 0x7f0d5c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:58.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.908+0000 7f0d81600640 1 --2- 172.21.15.78:0/2625959742 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0d5c0678c0 0x7f0d5c069dd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009bc0 tx=0x7f0d70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:58.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:58.908+0000 7f0d79600640 1 -- 172.21.15.78:0/2625959742 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f0d6801a310 con 0x7f0d7c0c7250 2024-05-21T14:43:59.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.068+0000 7f0d82a00640 1 -- 172.21.15.78:0/2625959742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0d7c04f730 con 0x7f0d7c0c7250 2024-05-21T14:43:59.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.068+0000 7f0d79600640 1 -- 172.21.15.78:0/2625959742 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f0d680565b0 con 0x7f0d7c0c7250 2024-05-21T14:43:59.076 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-05-21T14:43:59.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.068+0000 7f0d82a00640 1 -- 172.21.15.78:0/2625959742 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0d5c0678c0 msgr2=0x7f0d5c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.068+0000 7f0d82a00640 1 --2- 172.21.15.78:0/2625959742 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0d5c0678c0 0x7f0d5c069dd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009bc0 tx=0x7f0d70008040 comp rx=0 tx=0).stop 2024-05-21T14:43:59.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.068+0000 7f0d82a00640 1 -- 172.21.15.78:0/2625959742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d7c0c7250 msgr2=0x7f0d7c0cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.068+0000 7f0d82a00640 1 --2- 172.21.15.78:0/2625959742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d7c0c7250 0x7f0d7c0cd9a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800f5f0 tx=0x7f0d6800fab0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.068+0000 7f0d82a00640 1 -- 172.21.15.78:0/2625959742 shutdown_connections 2024-05-21T14:43:59.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.068+0000 7f0d82a00640 1 --2- 172.21.15.78:0/2625959742 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0d5c0678c0 0x7f0d5c069dd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.068+0000 7f0d82a00640 1 --2- 172.21.15.78:0/2625959742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d7c0c8340 0x7f0d7c150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.068+0000 7f0d82a00640 1 --2- 172.21.15.78:0/2625959742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d7c0c7250 0x7f0d7c0cd9a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.068+0000 7f0d82a00640 1 --2- 172.21.15.78:0/2625959742 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d64004d50 0x7f0d7c15e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.068+0000 7f0d82a00640 1 -- 172.21.15.78:0/2625959742 >> 172.21.15.78:0/2625959742 conn(0x7f0d7c0cbbb0 msgr2=0x7f0d7c074cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:59.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.068+0000 7f0d82a00640 1 -- 172.21.15.78:0/2625959742 shutdown_connections 2024-05-21T14:43:59.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.068+0000 7f0d82a00640 1 -- 172.21.15.78:0/2625959742 wait complete. 2024-05-21T14:43:59.097 INFO:tasks.mds_thrash:mds thrasher using random seed: 1716302639 2024-05-21T14:43:59.098 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:43:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.236+0000 7fd9e2200640 1 Processor -- start 2024-05-21T14:43:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.236+0000 7fd9e2200640 1 -- start start 2024-05-21T14:43:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.240+0000 7fd9e2200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd9dc0c6760 0x7fd9dc0c7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.240+0000 7fd9e2200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9dc159f20 0x7fd9dc073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.240+0000 7fd9e2200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9dc153cd0 con 0x7fd9dc0736d0 2024-05-21T14:43:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.240+0000 7fd9e2200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fd9dc15cbb0 con 0x7fd9dc159f20 2024-05-21T14:43:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.240+0000 7fd9e2200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fd9dc15cdf0 con 0x7fd9dc0c6760 2024-05-21T14:43:59.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.240+0000 7fd9dbe00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9dc159f20 0x7fd9dc073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.240+0000 7fd9db400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd9dc0c6760 0x7fd9dc0c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.240+0000 7fd9dbe00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9dc159f20 0x7fd9dc073ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:51228/0 (socket says 172.21.15.78:51228) 2024-05-21T14:43:59.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.240+0000 7fd9dbe00640 1 -- 172.21.15.78:0/3664490609 learned_addr learned my addr 172.21.15.78:0/3664490609 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:59.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.240+0000 7fd9d2a00640 1 --1- 172.21.15.78:0/3664490609 >> v1:172.21.15.84:6789/0 conn(0x7fd9dc0736d0 0x7fd9dc159810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.78:47202/0 (socket says 172.21.15.78:47202) 2024-05-21T14:43:59.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.240+0000 7fd9dbe00640 1 -- 172.21.15.78:0/3664490609 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd9dc0c6760 msgr2=0x7fd9dc0c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:59.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.240+0000 7fd9dbe00640 1 --2- 172.21.15.78:0/3664490609 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd9dc0c6760 0x7fd9dc0c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.240+0000 7fd9dbe00640 1 -- 172.21.15.78:0/3664490609 >> v1:172.21.15.84:6789/0 conn(0x7fd9dc0736d0 legacy=0x7fd9dc159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.240+0000 7fd9dbe00640 1 -- 172.21.15.78:0/3664490609 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9dc15d0d0 con 0x7fd9dc159f20 2024-05-21T14:43:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.244+0000 7fd9dbe00640 1 --2- 172.21.15.78:0/3664490609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9dc159f20 0x7fd9dc073ae0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009e50 tx=0x7fd9d401ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff61aa114c45f5a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.244+0000 7fd9daa00640 1 -- 172.21.15.78:0/3664490609 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d40a5700 con 0x7fd9dc159f20 2024-05-21T14:43:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.244+0000 7fd9daa00640 1 -- 172.21.15.78:0/3664490609 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d40a58a0 con 0x7fd9dc159f20 2024-05-21T14:43:59.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.244+0000 7fd9daa00640 1 -- 172.21.15.78:0/3664490609 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d40a5c70 con 0x7fd9dc159f20 2024-05-21T14:43:59.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.244+0000 7fd9e2200640 1 -- 172.21.15.78:0/3664490609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9dc159f20 msgr2=0x7fd9dc073ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.244+0000 7fd9e2200640 1 --2- 172.21.15.78:0/3664490609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9dc159f20 0x7fd9dc073ae0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009e50 tx=0x7fd9d401ca30 comp rx=0 tx=0).stop 2024-05-21T14:43:59.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.244+0000 7fd9e2200640 1 -- 172.21.15.78:0/3664490609 shutdown_connections 2024-05-21T14:43:59.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.244+0000 7fd9e2200640 1 --2- 172.21.15.78:0/3664490609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9dc159f20 0x7fd9dc073ae0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.244+0000 7fd9e2200640 1 --2- 172.21.15.78:0/3664490609 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd9dc0c6760 0x7fd9dc0c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.244+0000 7fd9e2200640 1 -- 172.21.15.78:0/3664490609 >> 172.21.15.78:0/3664490609 conn(0x7fd9dc0c9380 msgr2=0x7fd9dc0c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:59.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.244+0000 7fd9e2200640 1 -- 172.21.15.78:0/3664490609 shutdown_connections 2024-05-21T14:43:59.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.244+0000 7fd9e2200640 1 -- 172.21.15.78:0/3664490609 wait complete. 2024-05-21T14:43:59.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9e2200640 1 Processor -- start 2024-05-21T14:43:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9e2200640 1 -- start start 2024-05-21T14:43:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9e2200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd9dc0736d0 0x7fd9dc1f86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9e2200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9dc0c6760 0x7fd9dc1474f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9e2200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9dc159f20 0x7fd9dc1621c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9e2200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc0c79d0 con 0x7fd9dc0c6760 2024-05-21T14:43:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9e2200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc0c7850 con 0x7fd9dc159f20 2024-05-21T14:43:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9e2200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fd9dc0c6b70 con 0x7fd9dc0736d0 2024-05-21T14:43:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9d2a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9dc0c6760 0x7fd9dc1474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9d2a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9dc0c6760 0x7fd9dc1474f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35440/0 (socket says 172.21.15.78:35440) 2024-05-21T14:43:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9d2a00640 1 -- 172.21.15.78:0/2586500986 learned_addr learned my addr 172.21.15.78:0/2586500986 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9db400640 1 --2- 172.21.15.78:0/2586500986 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd9dc0736d0 0x7fd9dc1f86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9dbe00640 1 --2- 172.21.15.78:0/2586500986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9dc159f20 0x7fd9dc1621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9d2a00640 1 -- 172.21.15.78:0/2586500986 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd9dc0736d0 msgr2=0x7fd9dc1f86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9d2a00640 1 --2- 172.21.15.78:0/2586500986 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd9dc0736d0 0x7fd9dc1f86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9d2a00640 1 -- 172.21.15.78:0/2586500986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9dc159f20 msgr2=0x7fd9dc1621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9d2a00640 1 --2- 172.21.15.78:0/2586500986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9dc159f20 0x7fd9dc1621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9d2a00640 1 -- 172.21.15.78:0/2586500986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9dc1f8c10 con 0x7fd9dc0c6760 2024-05-21T14:43:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9db400640 1 --2- 172.21.15.78:0/2586500986 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd9dc0736d0 0x7fd9dc1f86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9d2a00640 1 --2- 172.21.15.78:0/2586500986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9dc0c6760 0x7fd9dc1474f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400c3a0 tx=0x7fd9c400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9d3e00640 1 -- 172.21.15.78:0/2586500986 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c40074e0 con 0x7fd9dc0c6760 2024-05-21T14:43:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9d3e00640 1 -- 172.21.15.78:0/2586500986 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c4007680 con 0x7fd9dc0c6760 2024-05-21T14:43:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9d3e00640 1 -- 172.21.15.78:0/2586500986 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4004a30 con 0x7fd9dc0c6760 2024-05-21T14:43:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9e2200640 1 -- 172.21.15.78:0/2586500986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9dc147a30 con 0x7fd9dc0c6760 2024-05-21T14:43:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.248+0000 7fd9e2200640 1 -- 172.21.15.78:0/2586500986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9dc163050 con 0x7fd9dc0c6760 2024-05-21T14:43:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.252+0000 7fd9e2200640 1 -- 172.21.15.78:0/2586500986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9dc1f8310 con 0x7fd9dc0c6760 2024-05-21T14:43:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.252+0000 7fd9d3e00640 1 -- 172.21.15.78:0/2586500986 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd9c401a020 con 0x7fd9dc0c6760 2024-05-21T14:43:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.252+0000 7fd9d3e00640 1 --2- 172.21.15.78:0/2586500986 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fd9b80678c0 0x7fd9b8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.252+0000 7fd9d3e00640 1 -- 172.21.15.78:0/2586500986 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fd9c4085460 con 0x7fd9dc0c6760 2024-05-21T14:43:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.252+0000 7fd9db400640 1 --2- 172.21.15.78:0/2586500986 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fd9b80678c0 0x7fd9b8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.252+0000 7fd9db400640 1 --2- 172.21.15.78:0/2586500986 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fd9b80678c0 0x7fd9b8069dd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009b10 tx=0x7fd9cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:59.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.256+0000 7fd9d3e00640 1 -- 172.21.15.78:0/2586500986 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fd9c4055ee0 con 0x7fd9dc0c6760 2024-05-21T14:43:59.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.412+0000 7fd9e2200640 1 -- 172.21.15.78:0/2586500986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9dc0c7d00 con 0x7fd9dc0c6760 2024-05-21T14:43:59.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.416+0000 7fd9d3e00640 1 -- 172.21.15.78:0/2586500986 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16585 (secure 0 0 0) 0x7fd9c40557e0 con 0x7fd9dc0c6760 2024-05-21T14:43:59.424 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:43:59.424 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:58.790118+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T14:43:17.088549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T14:43:18.012571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:43:59.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.416+0000 7fd9e2200640 1 -- 172.21.15.78:0/2586500986 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fd9b80678c0 msgr2=0x7fd9b8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.416+0000 7fd9e2200640 1 --2- 172.21.15.78:0/2586500986 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fd9b80678c0 0x7fd9b8069dd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009b10 tx=0x7fd9cc008040 comp rx=0 tx=0).stop 2024-05-21T14:43:59.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.416+0000 7fd9e2200640 1 -- 172.21.15.78:0/2586500986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9dc0c6760 msgr2=0x7fd9dc1474f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.416+0000 7fd9e2200640 1 --2- 172.21.15.78:0/2586500986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9dc0c6760 0x7fd9dc1474f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400c3a0 tx=0x7fd9c400c860 comp rx=0 tx=0).stop 2024-05-21T14:43:59.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.416+0000 7fd9e2200640 1 -- 172.21.15.78:0/2586500986 shutdown_connections 2024-05-21T14:43:59.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.416+0000 7fd9e2200640 1 --2- 172.21.15.78:0/2586500986 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fd9b80678c0 0x7fd9b8069dd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.416+0000 7fd9e2200640 1 --2- 172.21.15.78:0/2586500986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9dc159f20 0x7fd9dc1621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.416+0000 7fd9e2200640 1 --2- 172.21.15.78:0/2586500986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9dc0c6760 0x7fd9dc1474f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.416+0000 7fd9e2200640 1 --2- 172.21.15.78:0/2586500986 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd9dc0736d0 0x7fd9dc1f86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.416+0000 7fd9e2200640 1 -- 172.21.15.78:0/2586500986 >> 172.21.15.78:0/2586500986 conn(0x7fd9dc0c9380 msgr2=0x7fd9dc067580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:59.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.416+0000 7fd9e2200640 1 -- 172.21.15.78:0/2586500986 shutdown_connections 2024-05-21T14:43:59.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.416+0000 7fd9e2200640 1 -- 172.21.15.78:0/2586500986 wait complete. 2024-05-21T14:43:59.446 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-21T14:43:06.569415+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-21T14:43:17.088549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-21T14:43:18.012571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-21T14:43:59.446 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-21T14:43:59.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.584+0000 7faf88a00640 1 Processor -- start 2024-05-21T14:43:59.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.588+0000 7faf88a00640 1 -- start start 2024-05-21T14:43:59.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.588+0000 7faf88a00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faf840c5c30 0x7faf841538d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.588+0000 7faf88a00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faf840c7f90 0x7faf8415cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.588+0000 7faf88a00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf840c7240 con 0x7faf840c6540 2024-05-21T14:43:59.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.588+0000 7faf88a00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7faf84153e10 con 0x7faf840c5c30 2024-05-21T14:43:59.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.588+0000 7faf88a00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7faf840c4370 con 0x7faf840c7f90 2024-05-21T14:43:59.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.588+0000 7faf81e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faf840c5c30 0x7faf841538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.588+0000 7faf82800640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7faf840c6540 0x7faf840735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37040/0 (socket says 172.21.15.78:37040) 2024-05-21T14:43:59.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.588+0000 7faf82800640 1 -- 172.21.15.78:0/3402874141 learned_addr learned my addr 172.21.15.78:0/3402874141 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.588+0000 7faf81400640 1 --2- 172.21.15.78:0/3402874141 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faf840c7f90 0x7faf8415cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.588+0000 7faf81e00640 1 -- 172.21.15.78:0/3402874141 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faf840c7f90 msgr2=0x7faf8415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.588+0000 7faf81e00640 1 --2- 172.21.15.78:0/3402874141 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faf840c7f90 0x7faf8415cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.588+0000 7faf81e00640 1 -- 172.21.15.78:0/3402874141 >> v1:172.21.15.78:6789/0 conn(0x7faf840c6540 legacy=0x7faf840735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.588+0000 7faf81e00640 1 -- 172.21.15.78:0/3402874141 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf840c74e0 con 0x7faf840c5c30 2024-05-21T14:43:59.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.588+0000 7faf80a00640 1 -- 172.21.15.78:0/3402874141 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3242871415 0 0) 0x7faf840c7240 con 0x7faf840c6540 2024-05-21T14:43:59.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.592+0000 7faf81e00640 1 --2- 172.21.15.78:0/3402874141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf840c5c30 0x7faf841538d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faf740097c0 tx=0x7faf7401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2399e9700d1e0a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:59.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.592+0000 7faf80a00640 1 -- 172.21.15.78:0/3402874141 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf740b0070 con 0x7faf840c5c30 2024-05-21T14:43:59.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.592+0000 7faf80a00640 1 -- 172.21.15.78:0/3402874141 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf740ab600 con 0x7faf840c5c30 2024-05-21T14:43:59.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.592+0000 7faf80a00640 1 -- 172.21.15.78:0/3402874141 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf740ab9d0 con 0x7faf840c5c30 2024-05-21T14:43:59.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.592+0000 7faf88a00640 1 -- 172.21.15.78:0/3402874141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf840c5c30 msgr2=0x7faf841538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.592+0000 7faf88a00640 1 --2- 172.21.15.78:0/3402874141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf840c5c30 0x7faf841538d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faf740097c0 tx=0x7faf7401c4a0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.592+0000 7faf88a00640 1 -- 172.21.15.78:0/3402874141 shutdown_connections 2024-05-21T14:43:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.592+0000 7faf88a00640 1 --2- 172.21.15.78:0/3402874141 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faf840c7f90 0x7faf8415cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.592+0000 7faf88a00640 1 --2- 172.21.15.78:0/3402874141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf840c5c30 0x7faf841538d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.592+0000 7faf88a00640 1 -- 172.21.15.78:0/3402874141 >> 172.21.15.78:0/3402874141 conn(0x7faf840cd1e0 msgr2=0x7faf840c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.592+0000 7faf88a00640 1 -- 172.21.15.78:0/3402874141 shutdown_connections 2024-05-21T14:43:59.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.592+0000 7faf88a00640 1 -- 172.21.15.78:0/3402874141 wait complete. 2024-05-21T14:43:59.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf88a00640 1 Processor -- start 2024-05-21T14:43:59.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf88a00640 1 -- start start 2024-05-21T14:43:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf88a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf840c5c30 0x7faf840726c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf88a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf840c6540 0x7faf841474f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf88a00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faf840c7f90 0x7faf840713d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf88a00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7faf84073e70 con 0x7faf840c5c30 2024-05-21T14:43:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf88a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faf84073cf0 con 0x7faf840c6540 2024-05-21T14:43:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf88a00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7faf84166840 con 0x7faf840c7f90 2024-05-21T14:43:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf81e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf840c5c30 0x7faf840726c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf81e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf840c5c30 0x7faf840726c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35456/0 (socket says 172.21.15.78:35456) 2024-05-21T14:43:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf81e00640 1 -- 172.21.15.78:0/1358300025 learned_addr learned my addr 172.21.15.78:0/1358300025 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf81400640 1 --2- 172.21.15.78:0/1358300025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf840c6540 0x7faf841474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf82800640 1 --2- 172.21.15.78:0/1358300025 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faf840c7f90 0x7faf840713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf81e00640 1 -- 172.21.15.78:0/1358300025 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faf840c7f90 msgr2=0x7faf840713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf81e00640 1 --2- 172.21.15.78:0/1358300025 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faf840c7f90 0x7faf840713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf81e00640 1 -- 172.21.15.78:0/1358300025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf840c6540 msgr2=0x7faf841474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf81e00640 1 --2- 172.21.15.78:0/1358300025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf840c6540 0x7faf841474f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf81e00640 1 -- 172.21.15.78:0/1358300025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf84072c00 con 0x7faf840c5c30 2024-05-21T14:43:59.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf81400640 1 --2- 172.21.15.78:0/1358300025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf840c6540 0x7faf841474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:59.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf81e00640 1 --2- 172.21.15.78:0/1358300025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf840c5c30 0x7faf840726c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faf740ae040 tx=0x7faf7401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:59.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf7a000640 1 -- 172.21.15.78:0/1358300025 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf740b0050 con 0x7faf840c5c30 2024-05-21T14:43:59.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf7a000640 1 -- 172.21.15.78:0/1358300025 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf740bc070 con 0x7faf840c5c30 2024-05-21T14:43:59.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf7a000640 1 -- 172.21.15.78:0/1358300025 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf740b5850 con 0x7faf840c5c30 2024-05-21T14:43:59.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.596+0000 7faf88a00640 1 -- 172.21.15.78:0/1358300025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf84147a30 con 0x7faf840c5c30 2024-05-21T14:43:59.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.600+0000 7faf88a00640 1 -- 172.21.15.78:0/1358300025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf841f8b90 con 0x7faf840c5c30 2024-05-21T14:43:59.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.600+0000 7faf88a00640 1 -- 172.21.15.78:0/1358300025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf8414eac0 con 0x7faf840c5c30 2024-05-21T14:43:59.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.600+0000 7faf7a000640 1 -- 172.21.15.78:0/1358300025 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf740b59f0 con 0x7faf840c5c30 2024-05-21T14:43:59.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.600+0000 7faf7a000640 1 --2- 172.21.15.78:0/1358300025 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7faf640678f0 0x7faf64069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.600+0000 7faf7a000640 1 -- 172.21.15.78:0/1358300025 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7faf74120270 con 0x7faf840c5c30 2024-05-21T14:43:59.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.600+0000 7faf81400640 1 --2- 172.21.15.78:0/1358300025 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7faf640678f0 0x7faf64069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.604+0000 7faf81400640 1 --2- 172.21.15.78:0/1358300025 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7faf640678f0 0x7faf64069e00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf84162560 tx=0x7faf70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:59.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.608+0000 7faf7a000640 1 -- 172.21.15.78:0/1358300025 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7faf74016090 con 0x7faf840c5c30 2024-05-21T14:43:59.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.764+0000 7faf88a00640 1 -- 172.21.15.78:0/1358300025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faf84150a80 con 0x7faf840c5c30 2024-05-21T14:43:59.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.764+0000 7faf7a000640 1 -- 172.21.15.78:0/1358300025 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7faf740f0e20 con 0x7faf840c5c30 2024-05-21T14:43:59.774 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-05-21T14:43:59.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.768+0000 7faf88a00640 1 -- 172.21.15.78:0/1358300025 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7faf640678f0 msgr2=0x7faf64069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.768+0000 7faf88a00640 1 --2- 172.21.15.78:0/1358300025 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7faf640678f0 0x7faf64069e00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf84162560 tx=0x7faf70008040 comp rx=0 tx=0).stop 2024-05-21T14:43:59.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.768+0000 7faf88a00640 1 -- 172.21.15.78:0/1358300025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf840c5c30 msgr2=0x7faf840726c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.768+0000 7faf88a00640 1 --2- 172.21.15.78:0/1358300025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf840c5c30 0x7faf840726c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faf740ae040 tx=0x7faf7401ace0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.768+0000 7faf88a00640 1 -- 172.21.15.78:0/1358300025 shutdown_connections 2024-05-21T14:43:59.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.768+0000 7faf88a00640 1 --2- 172.21.15.78:0/1358300025 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7faf640678f0 0x7faf64069e00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.768+0000 7faf88a00640 1 --2- 172.21.15.78:0/1358300025 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faf840c7f90 0x7faf840713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.768+0000 7faf88a00640 1 --2- 172.21.15.78:0/1358300025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf840c6540 0x7faf841474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.768+0000 7faf88a00640 1 --2- 172.21.15.78:0/1358300025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf840c5c30 0x7faf840726c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.768+0000 7faf88a00640 1 -- 172.21.15.78:0/1358300025 >> 172.21.15.78:0/1358300025 conn(0x7faf840cd1e0 msgr2=0x7faf840c32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:59.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.768+0000 7faf88a00640 1 -- 172.21.15.78:0/1358300025 shutdown_connections 2024-05-21T14:43:59.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.768+0000 7faf88a00640 1 -- 172.21.15.78:0/1358300025 wait complete. 2024-05-21T14:43:59.796 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-21T14:43:59.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55b1a00640 1 Processor -- start 2024-05-21T14:43:59.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55b1a00640 1 -- start start 2024-05-21T14:43:59.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55b1a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f55ac1527a0 0x7f55ac0c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55b1a00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f55ac0c5980 0x7f55ac162e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55b1a00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55ac0737e0 con 0x7f55ac0733d0 2024-05-21T14:43:59.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55b1a00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f55ac072980 con 0x7f55ac0c5980 2024-05-21T14:43:59.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55b1a00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f55ac072f40 con 0x7f55ac1527a0 2024-05-21T14:43:59.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55aaa00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f55ac0733d0 0x7f55ac071910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37056/0 (socket says 172.21.15.78:37056) 2024-05-21T14:43:59.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55aaa00640 1 -- 172.21.15.78:0/1664651150 learned_addr learned my addr 172.21.15.78:0/1664651150 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:43:59.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55ab400640 1 --2- 172.21.15.78:0/1664651150 >> v2:172.21.15.78:3300/0 conn(0x7f55ac0c5980 0x7f55ac162e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55a2000640 1 --2- 172.21.15.78:0/1664651150 >> v2:172.21.15.84:3300/0 conn(0x7f55ac1527a0 0x7f55ac0c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55aa000640 1 -- 172.21.15.78:0/1664651150 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 602504026 0 0) 0x7f55ac0737e0 con 0x7f55ac0733d0 2024-05-21T14:43:59.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55aa000640 1 -- 172.21.15.78:0/1664651150 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5590003530 con 0x7f55ac0733d0 2024-05-21T14:43:59.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55ab400640 1 -- 172.21.15.78:0/1664651150 >> v2:172.21.15.84:3300/0 conn(0x7f55ac1527a0 msgr2=0x7f55ac0c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:43:59.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55ab400640 1 --2- 172.21.15.78:0/1664651150 >> v2:172.21.15.84:3300/0 conn(0x7f55ac1527a0 0x7f55ac0c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55ab400640 1 -- 172.21.15.78:0/1664651150 >> v1:172.21.15.78:6789/0 conn(0x7f55ac0733d0 legacy=0x7f55ac071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55ab400640 1 -- 172.21.15.78:0/1664651150 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ac073aa0 con 0x7f55ac0c5980 2024-05-21T14:43:59.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.940+0000 7f55a2000640 1 --2- 172.21.15.78:0/1664651150 >> v2:172.21.15.84:3300/0 conn(0x7f55ac1527a0 0x7f55ac0c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:43:59.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.944+0000 7f55ab400640 1 --2- 172.21.15.78:0/1664651150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ac0c5980 0x7f55ac162e30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f55ac072b00 tx=0x7f55a401f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f5369791d6788 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:59.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.944+0000 7f55aa000640 1 -- 172.21.15.78:0/1664651150 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a40b4070 con 0x7f55ac0c5980 2024-05-21T14:43:59.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.944+0000 7f55aa000640 1 -- 172.21.15.78:0/1664651150 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a40af600 con 0x7f55ac0c5980 2024-05-21T14:43:59.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.944+0000 7f55aa000640 1 -- 172.21.15.78:0/1664651150 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a40af9d0 con 0x7f55ac0c5980 2024-05-21T14:43:59.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.944+0000 7f55b1a00640 1 -- 172.21.15.78:0/1664651150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ac0c5980 msgr2=0x7f55ac162e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.944+0000 7f55b1a00640 1 --2- 172.21.15.78:0/1664651150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ac0c5980 0x7f55ac162e30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f55ac072b00 tx=0x7f55a401f110 comp rx=0 tx=0).stop 2024-05-21T14:43:59.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.944+0000 7f55b1a00640 1 -- 172.21.15.78:0/1664651150 shutdown_connections 2024-05-21T14:43:59.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.944+0000 7f55b1a00640 1 --2- 172.21.15.78:0/1664651150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ac0c5980 0x7f55ac162e30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.944+0000 7f55b1a00640 1 --2- 172.21.15.78:0/1664651150 >> v2:172.21.15.84:3300/0 conn(0x7f55ac1527a0 0x7f55ac0c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.944+0000 7f55b1a00640 1 -- 172.21.15.78:0/1664651150 >> 172.21.15.78:0/1664651150 conn(0x7f55ac0cd1e0 msgr2=0x7f55ac0c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:43:59.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.944+0000 7f55b1a00640 1 -- 172.21.15.78:0/1664651150 shutdown_connections 2024-05-21T14:43:59.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.944+0000 7f55b1a00640 1 -- 172.21.15.78:0/1664651150 wait complete. 2024-05-21T14:43:59.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.948+0000 7f55b1a00640 1 Processor -- start 2024-05-21T14:43:59.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.948+0000 7f55b1a00640 1 -- start start 2024-05-21T14:43:59.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.948+0000 7f55b1a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55ac0733d0 0x7f55ac1f20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.948+0000 7f55b1a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ac0c5980 0x7f55ac157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.948+0000 7f55b1a00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55ac1527a0 0x7f55ac1587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.948+0000 7f55b1a00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac072bd0 con 0x7f55ac0c5980 2024-05-21T14:43:59.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.948+0000 7f55b1a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac074060 con 0x7f55ac0733d0 2024-05-21T14:43:59.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.948+0000 7f55b1a00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f55ac0ca100 con 0x7f55ac1527a0 2024-05-21T14:43:59.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.948+0000 7f55a2000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ac0c5980 0x7f55ac157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.948+0000 7f55a2000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ac0c5980 0x7f55ac157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35470/0 (socket says 172.21.15.78:35470) 2024-05-21T14:43:59.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.948+0000 7f55a2000640 1 -- 172.21.15.78:0/2205190704 learned_addr learned my addr 172.21.15.78:0/2205190704 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:43:59.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.948+0000 7f55ab400640 1 --2- 172.21.15.78:0/2205190704 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55ac1527a0 0x7f55ac1587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.948+0000 7f55aaa00640 1 --2- 172.21.15.78:0/2205190704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55ac0733d0 0x7f55ac1f20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.952+0000 7f55a2000640 1 -- 172.21.15.78:0/2205190704 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55ac1527a0 msgr2=0x7f55ac1587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.952+0000 7f55a2000640 1 --2- 172.21.15.78:0/2205190704 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55ac1527a0 0x7f55ac1587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.952+0000 7f55a2000640 1 -- 172.21.15.78:0/2205190704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55ac0733d0 msgr2=0x7f55ac1f20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:43:59.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.952+0000 7f55a2000640 1 --2- 172.21.15.78:0/2205190704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55ac0733d0 0x7f55ac1f20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:43:59.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.952+0000 7f55a2000640 1 -- 172.21.15.78:0/2205190704 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ac1f2600 con 0x7f55ac0c5980 2024-05-21T14:43:59.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.952+0000 7f55a2000640 1 --2- 172.21.15.78:0/2205190704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ac0c5980 0x7f55ac157a40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f559400d830 tx=0x7f559400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:59.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.952+0000 7f55a3400640 1 -- 172.21.15.78:0/2205190704 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55940096a0 con 0x7f55ac0c5980 2024-05-21T14:43:59.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.952+0000 7f55a3400640 1 -- 172.21.15.78:0/2205190704 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5594019070 con 0x7f55ac0c5980 2024-05-21T14:43:59.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.952+0000 7f55b1a00640 1 -- 172.21.15.78:0/2205190704 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55ac14bd90 con 0x7f55ac0c5980 2024-05-21T14:43:59.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.952+0000 7f55a3400640 1 -- 172.21.15.78:0/2205190704 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5594009a80 con 0x7f55ac0c5980 2024-05-21T14:43:59.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.952+0000 7f55b1a00640 1 -- 172.21.15.78:0/2205190704 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55ac14c630 con 0x7f55ac0c5980 2024-05-21T14:43:59.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.952+0000 7f55b1a00640 1 -- 172.21.15.78:0/2205190704 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55ac14d2c0 con 0x7f55ac0c5980 2024-05-21T14:43:59.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.952+0000 7f55a3400640 1 -- 172.21.15.78:0/2205190704 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f559401e460 con 0x7f55ac0c5980 2024-05-21T14:43:59.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.952+0000 7f55a3400640 1 --2- 172.21.15.78:0/2205190704 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f55880678f0 0x7f5588069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:43:59.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.952+0000 7f55a3400640 1 -- 172.21.15.78:0/2205190704 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f5594086340 con 0x7f55ac0c5980 2024-05-21T14:43:59.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.956+0000 7f55aaa00640 1 --2- 172.21.15.78:0/2205190704 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f55880678f0 0x7f5588069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:43:59.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.956+0000 7f55aaa00640 1 --2- 172.21.15.78:0/2205190704 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f55880678f0 0x7f5588069e00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f559c005890 tx=0x7f559c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:43:59.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:43:59.960+0000 7f55a3400640 1 -- 172.21.15.78:0/2205190704 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f5594056dc0 con 0x7f55ac0c5980 2024-05-21T14:44:00.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.112+0000 7f55b1a00640 1 -- 172.21.15.78:0/2205190704 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f55ac0c8a20 con 0x7f55ac0c5980 2024-05-21T14:44:00.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.116+0000 7f55a3400640 1 -- 172.21.15.78:0/2205190704 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f55940566c0 con 0x7f55ac0c5980 2024-05-21T14:44:00.124 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-05-21T14:44:00.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.116+0000 7f55b1a00640 1 -- 172.21.15.78:0/2205190704 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f55880678f0 msgr2=0x7f5588069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:00.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.116+0000 7f55b1a00640 1 --2- 172.21.15.78:0/2205190704 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f55880678f0 0x7f5588069e00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f559c005890 tx=0x7f559c009040 comp rx=0 tx=0).stop 2024-05-21T14:44:00.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.116+0000 7f55b1a00640 1 -- 172.21.15.78:0/2205190704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ac0c5980 msgr2=0x7f55ac157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:00.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.116+0000 7f55b1a00640 1 --2- 172.21.15.78:0/2205190704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ac0c5980 0x7f55ac157a40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f559400d830 tx=0x7f559400dcf0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.116+0000 7f55b1a00640 1 -- 172.21.15.78:0/2205190704 shutdown_connections 2024-05-21T14:44:00.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.116+0000 7f55b1a00640 1 --2- 172.21.15.78:0/2205190704 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f55880678f0 0x7f5588069e00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.116+0000 7f55b1a00640 1 --2- 172.21.15.78:0/2205190704 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55ac1527a0 0x7f55ac1587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.116+0000 7f55b1a00640 1 --2- 172.21.15.78:0/2205190704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ac0c5980 0x7f55ac157a40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.116+0000 7f55b1a00640 1 --2- 172.21.15.78:0/2205190704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55ac0733d0 0x7f55ac1f20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.116+0000 7f55b1a00640 1 -- 172.21.15.78:0/2205190704 >> 172.21.15.78:0/2205190704 conn(0x7f55ac0cd1e0 msgr2=0x7f55ac0c66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:00.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.116+0000 7f55b1a00640 1 -- 172.21.15.78:0/2205190704 shutdown_connections 2024-05-21T14:44:00.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.116+0000 7f55b1a00640 1 -- 172.21.15.78:0/2205190704 wait complete. 2024-05-21T14:44:00.145 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-21T14:44:00.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.288+0000 7f6604200640 1 Processor -- start 2024-05-21T14:44:00.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.288+0000 7f6604200640 1 -- start start 2024-05-21T14:44:00.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.292+0000 7f6604200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65fc1538d0 0x7f65fc0735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:00.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.292+0000 7f6604200640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65fc0c7240 con 0x7f65fc0c5c30 2024-05-21T14:44:00.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.292+0000 7f6604200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65fc0c6c50 con 0x7f65fc0c7f90 2024-05-21T14:44:00.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.292+0000 7f6604200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f65fc0c4370 con 0x7f65fc1538d0 2024-05-21T14:44:00.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.292+0000 7f6602200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65fc1538d0 0x7f65fc0735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:00.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.292+0000 7f6601800640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f65fc0c5c30 0x7f65fc15cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37072/0 (socket says 172.21.15.78:37072) 2024-05-21T14:44:00.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.292+0000 7f6601800640 1 -- 172.21.15.78:0/4069014608 learned_addr learned my addr 172.21.15.78:0/4069014608 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:44:00.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.292+0000 7f6602200640 1 -- 172.21.15.78:0/4069014608 >> v1:172.21.15.84:6789/0 conn(0x7f65fc0c7f90 legacy=0x7f65fc0c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:00.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.292+0000 7f6602200640 1 -- 172.21.15.78:0/4069014608 >> v1:172.21.15.78:6789/0 conn(0x7f65fc0c5c30 legacy=0x7f65fc15cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:00.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.292+0000 7f6602200640 1 -- 172.21.15.78:0/4069014608 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc0c74e0 con 0x7f65fc1538d0 2024-05-21T14:44:00.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.292+0000 7f65fbe00640 1 -- 172.21.15.78:0/4069014608 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 429911522 0 0) 0x7f65fc0c7240 con 0x7f65fc0c5c30 2024-05-21T14:44:00.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.296+0000 7f6602200640 1 --2- 172.21.15.78:0/4069014608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65fc1538d0 0x7f65fc0735e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0c44f0 tx=0x7f65f401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44c7b5fa141446b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:00.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.296+0000 7f65fbe00640 1 -- 172.21.15.78:0/4069014608 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f40b2070 con 0x7f65fc1538d0 2024-05-21T14:44:00.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.296+0000 7f65fbe00640 1 -- 172.21.15.78:0/4069014608 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f40a5810 con 0x7f65fc1538d0 2024-05-21T14:44:00.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.296+0000 7f65fbe00640 1 -- 172.21.15.78:0/4069014608 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f40a5be0 con 0x7f65fc1538d0 2024-05-21T14:44:00.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.296+0000 7f6604200640 1 -- 172.21.15.78:0/4069014608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65fc1538d0 msgr2=0x7f65fc0735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:00.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.296+0000 7f6604200640 1 --2- 172.21.15.78:0/4069014608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65fc1538d0 0x7f65fc0735e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0c44f0 tx=0x7f65f401c950 comp rx=0 tx=0).stop 2024-05-21T14:44:00.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.296+0000 7f6604200640 1 -- 172.21.15.78:0/4069014608 shutdown_connections 2024-05-21T14:44:00.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.296+0000 7f6604200640 1 --2- 172.21.15.78:0/4069014608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65fc1538d0 0x7f65fc0735e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.296+0000 7f6604200640 1 -- 172.21.15.78:0/4069014608 >> 172.21.15.78:0/4069014608 conn(0x7f65fc0cd1e0 msgr2=0x7f65fc0c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:00.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.296+0000 7f6604200640 1 -- 172.21.15.78:0/4069014608 shutdown_connections 2024-05-21T14:44:00.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.296+0000 7f6604200640 1 -- 172.21.15.78:0/4069014608 wait complete. 2024-05-21T14:44:00.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.296+0000 7f6604200640 1 Processor -- start 2024-05-21T14:44:00.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.296+0000 7f6604200640 1 -- start start 2024-05-21T14:44:00.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6604200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f65fc0c5c30 0x7f65fc146030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:00.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6604200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65fc0c7f90 0x7f65fc157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:00.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6604200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65fc1538d0 0x7f65fc157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:00.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6604200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc167850 con 0x7f65fc1538d0 2024-05-21T14:44:00.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6604200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc153ce0 con 0x7f65fc0c7f90 2024-05-21T14:44:00.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6604200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f65fc1679d0 con 0x7f65fc0c5c30 2024-05-21T14:44:00.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6602200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65fc1538d0 0x7f65fc157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:00.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6602200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65fc1538d0 0x7f65fc157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35494/0 (socket says 172.21.15.78:35494) 2024-05-21T14:44:00.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6602200640 1 -- 172.21.15.78:0/3398346243 learned_addr learned my addr 172.21.15.78:0/3398346243 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:44:00.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6600e00640 1 --2- 172.21.15.78:0/3398346243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65fc0c7f90 0x7f65fc157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:00.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6601800640 1 --2- 172.21.15.78:0/3398346243 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f65fc0c5c30 0x7f65fc146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:00.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6602200640 1 -- 172.21.15.78:0/3398346243 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f65fc0c5c30 msgr2=0x7f65fc146030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:00.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6602200640 1 --2- 172.21.15.78:0/3398346243 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f65fc0c5c30 0x7f65fc146030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6602200640 1 -- 172.21.15.78:0/3398346243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65fc0c7f90 msgr2=0x7f65fc157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6602200640 1 --2- 172.21.15.78:0/3398346243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65fc0c7f90 0x7f65fc157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6602200640 1 -- 172.21.15.78:0/3398346243 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc146570 con 0x7f65fc1538d0 2024-05-21T14:44:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6600e00640 1 --2- 172.21.15.78:0/3398346243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65fc0c7f90 0x7f65fc157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:44:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6602200640 1 --2- 172.21.15.78:0/3398346243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65fc1538d0 0x7f65fc157b40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f65f4019560 tx=0x7f65f40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f65f9600640 1 -- 172.21.15.78:0/3398346243 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f40b2040 con 0x7f65fc1538d0 2024-05-21T14:44:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f65f9600640 1 -- 172.21.15.78:0/3398346243 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f40bf070 con 0x7f65fc1538d0 2024-05-21T14:44:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f65f9600640 1 -- 172.21.15.78:0/3398346243 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f40b88b0 con 0x7f65fc1538d0 2024-05-21T14:44:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6604200640 1 -- 172.21.15.78:0/3398346243 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65fc1f5690 con 0x7f65fc1538d0 2024-05-21T14:44:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6604200640 1 -- 172.21.15.78:0/3398346243 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65fc145550 con 0x7f65fc1538d0 2024-05-21T14:44:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.300+0000 7f6604200640 1 -- 172.21.15.78:0/3398346243 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65fc0c7b40 con 0x7f65fc1538d0 2024-05-21T14:44:00.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.304+0000 7f65f9600640 1 -- 172.21.15.78:0/3398346243 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f65f40b8a50 con 0x7f65fc1538d0 2024-05-21T14:44:00.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.304+0000 7f65f9600640 1 --2- 172.21.15.78:0/3398346243 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f65dc0678f0 0x7f65dc069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:00.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.304+0000 7f65f9600640 1 -- 172.21.15.78:0/3398346243 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f65f41209f0 con 0x7f65fc1538d0 2024-05-21T14:44:00.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.304+0000 7f6601800640 1 --2- 172.21.15.78:0/3398346243 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f65dc0678f0 0x7f65dc069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:00.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.304+0000 7f6601800640 1 --2- 172.21.15.78:0/3398346243 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f65dc0678f0 0x7f65dc069e00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f65f0000f70 tx=0x7f65f0007240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:00.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.308+0000 7f65f9600640 1 -- 172.21.15.78:0/3398346243 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f65f40c8020 con 0x7f65fc1538d0 2024-05-21T14:44:00.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.464+0000 7f6604200640 1 -- 172.21.15.78:0/3398346243 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f65fc150b20 con 0x7f65fc1538d0 2024-05-21T14:44:00.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.464+0000 7f65f9600640 1 -- 172.21.15.78:0/3398346243 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f65f4016540 con 0x7f65fc1538d0 2024-05-21T14:44:00.473 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-05-21T14:44:00.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.468+0000 7f6604200640 1 -- 172.21.15.78:0/3398346243 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f65dc0678f0 msgr2=0x7f65dc069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:00.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.468+0000 7f6604200640 1 --2- 172.21.15.78:0/3398346243 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f65dc0678f0 0x7f65dc069e00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f65f0000f70 tx=0x7f65f0007240 comp rx=0 tx=0).stop 2024-05-21T14:44:00.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.468+0000 7f6604200640 1 -- 172.21.15.78:0/3398346243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65fc1538d0 msgr2=0x7f65fc157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:00.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.468+0000 7f6604200640 1 --2- 172.21.15.78:0/3398346243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65fc1538d0 0x7f65fc157b40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f65f4019560 tx=0x7f65f40196f0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.468+0000 7f6604200640 1 -- 172.21.15.78:0/3398346243 shutdown_connections 2024-05-21T14:44:00.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.468+0000 7f6604200640 1 --2- 172.21.15.78:0/3398346243 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f65dc0678f0 0x7f65dc069e00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.468+0000 7f6604200640 1 --2- 172.21.15.78:0/3398346243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65fc1538d0 0x7f65fc157b40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.468+0000 7f6604200640 1 --2- 172.21.15.78:0/3398346243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65fc0c7f90 0x7f65fc157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.468+0000 7f6604200640 1 --2- 172.21.15.78:0/3398346243 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f65fc0c5c30 0x7f65fc146030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.468+0000 7f6604200640 1 -- 172.21.15.78:0/3398346243 >> 172.21.15.78:0/3398346243 conn(0x7f65fc0cd1e0 msgr2=0x7f65fc159710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:00.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.468+0000 7f6604200640 1 -- 172.21.15.78:0/3398346243 shutdown_connections 2024-05-21T14:44:00.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.468+0000 7f6604200640 1 -- 172.21.15.78:0/3398346243 wait complete. 2024-05-21T14:44:00.496 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2024-05-21T14:44:00.496 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T14:44:00.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.632+0000 7f855f800640 1 Processor -- start 2024-05-21T14:44:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.632+0000 7f855f800640 1 -- start start 2024-05-21T14:44:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f855f800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8558071fe0 0x7f85580723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f855f800640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85580715f0 con 0x7f85580c5640 2024-05-21T14:44:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f855f800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8558072b80 con 0x7f85581529d0 2024-05-21T14:44:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f855f800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f85580c8530 con 0x7f8558071fe0 2024-05-21T14:44:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f855d800640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f85580c5640 0x7f8558162e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37076/0 (socket says 172.21.15.78:37076) 2024-05-21T14:44:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f855d800640 1 -- 172.21.15.78:0/381174651 learned_addr learned my addr 172.21.15.78:0/381174651 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:44:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f854fe00640 1 --2- 172.21.15.78:0/381174651 >> v2:172.21.15.84:3300/0 conn(0x7f8558071fe0 0x7f85580723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f8557e00640 1 -- 172.21.15.78:0/381174651 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4218060600 0 0) 0x7f85580715f0 con 0x7f85580c5640 2024-05-21T14:44:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f8557e00640 1 -- 172.21.15.78:0/381174651 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f853c003530 con 0x7f85580c5640 2024-05-21T14:44:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f8557e00640 1 -- 172.21.15.78:0/381174651 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128138005 0 0) 0x7f8558072b80 con 0x7f85581529d0 2024-05-21T14:44:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f8557e00640 1 -- 172.21.15.78:0/381174651 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85580715f0 con 0x7f85581529d0 2024-05-21T14:44:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f8557e00640 1 -- 172.21.15.78:0/381174651 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2691491726 0 0) 0x7f853c003530 con 0x7f85580c5640 2024-05-21T14:44:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f8557e00640 1 -- 172.21.15.78:0/381174651 >> v2:172.21.15.84:3300/0 conn(0x7f8558071fe0 msgr2=0x7f85580723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:44:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f8557e00640 1 --2- 172.21.15.78:0/381174651 >> v2:172.21.15.84:3300/0 conn(0x7f8558071fe0 0x7f85580723f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f8557e00640 1 -- 172.21.15.78:0/381174651 >> v1:172.21.15.84:6789/0 conn(0x7f85581529d0 legacy=0x7f8558072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f8557e00640 1 -- 172.21.15.78:0/381174651 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85580c8810 con 0x7f85580c5640 2024-05-21T14:44:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f8557e00640 1 -- 172.21.15.78:0/381174651 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7f8550001a00 con 0x7f85580c5640 2024-05-21T14:44:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f8557e00640 1 -- 172.21.15.78:0/381174651 >> v1:172.21.15.78:6789/0 conn(0x7f85580c5640 legacy=0x7f8558162e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f8557e00640 1 --2- 172.21.15.78:0/381174651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f853c003b50 0x7f853c003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f8557e00640 1 --2- 172.21.15.78:0/381174651 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f853c004810 0x7f853c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f8557e00640 1 --2- 172.21.15.78:0/381174651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f853c0051b0 0x7f853c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f8557e00640 1 -- 172.21.15.78:0/381174651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f85580c8530 con 0x7f853c0051b0 2024-05-21T14:44:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f8557e00640 1 -- 172.21.15.78:0/381174651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f853c00c150 con 0x7f853c003b50 2024-05-21T14:44:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f8557e00640 1 -- 172.21.15.78:0/381174651 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f853c00c350 con 0x7f853c004810 2024-05-21T14:44:00.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f855d800640 1 --2- 172.21.15.78:0/381174651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f853c0051b0 0x7f853c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:00.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f855ce00640 1 --2- 172.21.15.78:0/381174651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f853c003b50 0x7f853c003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:00.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f854fe00640 1 --2- 172.21.15.78:0/381174651 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f853c004810 0x7f853c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:00.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f855d800640 1 -- 172.21.15.78:0/381174651 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f853c004810 msgr2=0x7f853c004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:44:00.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f855d800640 1 --2- 172.21.15.78:0/381174651 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f853c004810 0x7f853c004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f855d800640 1 -- 172.21.15.78:0/381174651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f853c003b50 msgr2=0x7f853c003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:44:00.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f855d800640 1 --2- 172.21.15.78:0/381174651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f853c003b50 0x7f853c003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f855d800640 1 -- 172.21.15.78:0/381174651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f853c003530 con 0x7f853c0051b0 2024-05-21T14:44:00.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.636+0000 7f854fe00640 1 --2- 172.21.15.78:0/381174651 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f853c004810 0x7f853c004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:44:00.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.640+0000 7f855d800640 1 -- 172.21.15.78:0/381174651 reap_dead start 2024-05-21T14:44:00.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.640+0000 7f855d800640 1 --2- 172.21.15.78:0/381174651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f853c0051b0 0x7f853c00b9d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f853c0057f0 tx=0x7f855001f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac6e58e84f7aa67 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:00.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.640+0000 7f8557e00640 1 -- 172.21.15.78:0/381174651 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855000a410 con 0x7f853c0051b0 2024-05-21T14:44:00.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.640+0000 7f8557e00640 1 -- 172.21.15.78:0/381174651 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85500ac650 con 0x7f853c0051b0 2024-05-21T14:44:00.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.640+0000 7f8557e00640 1 -- 172.21.15.78:0/381174651 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85500aca40 con 0x7f853c0051b0 2024-05-21T14:44:00.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.640+0000 7f855f800640 1 -- 172.21.15.78:0/381174651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f853c0051b0 msgr2=0x7f853c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:00.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.640+0000 7f855f800640 1 --2- 172.21.15.78:0/381174651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f853c0051b0 0x7f853c00b9d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f853c0057f0 tx=0x7f855001f9a0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.640+0000 7f855f800640 1 -- 172.21.15.78:0/381174651 shutdown_connections 2024-05-21T14:44:00.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.640+0000 7f855f800640 1 --2- 172.21.15.78:0/381174651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f853c0051b0 0x7f853c00b9d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.640+0000 7f855f800640 1 -- 172.21.15.78:0/381174651 >> 172.21.15.78:0/381174651 conn(0x7f85580c9380 msgr2=0x7f85580c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:00.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.640+0000 7f855f800640 1 -- 172.21.15.78:0/381174651 shutdown_connections 2024-05-21T14:44:00.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.640+0000 7f855f800640 1 -- 172.21.15.78:0/381174651 wait complete. 2024-05-21T14:44:00.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855f800640 1 Processor -- start 2024-05-21T14:44:00.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855f800640 1 -- start start 2024-05-21T14:44:00.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855f800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f853c0051b0 0x7f8558150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:00.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855f800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8558153380 0x7f85581f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:00.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855f800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85581520f0 0x7f8558148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:00.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855f800640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f85580c3a20 con 0x7f85581520f0 2024-05-21T14:44:00.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855f800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f85580c38a0 con 0x7f8558153380 2024-05-21T14:44:00.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855f800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f85580723f0 con 0x7f853c0051b0 2024-05-21T14:44:00.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855d800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85581520f0 0x7f8558148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:00.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855d800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85581520f0 0x7f8558148a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35514/0 (socket says 172.21.15.78:35514) 2024-05-21T14:44:00.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855d800640 1 -- 172.21.15.78:0/3012833303 learned_addr learned my addr 172.21.15.78:0/3012833303 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:44:00.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855ce00640 1 --2- 172.21.15.78:0/3012833303 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f853c0051b0 0x7f8558150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:00.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f854fe00640 1 --2- 172.21.15.78:0/3012833303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8558153380 0x7f85581f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:00.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855d800640 1 -- 172.21.15.78:0/3012833303 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f853c0051b0 msgr2=0x7f8558150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:00.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855d800640 1 --2- 172.21.15.78:0/3012833303 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f853c0051b0 0x7f8558150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855d800640 1 -- 172.21.15.78:0/3012833303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8558153380 msgr2=0x7f85581f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:00.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855d800640 1 --2- 172.21.15.78:0/3012833303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8558153380 0x7f85581f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855d800640 1 -- 172.21.15.78:0/3012833303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85581571d0 con 0x7f85581520f0 2024-05-21T14:44:00.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f854fe00640 1 --2- 172.21.15.78:0/3012833303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8558153380 0x7f85581f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:44:00.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.644+0000 7f855d800640 1 --2- 172.21.15.78:0/3012833303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85581520f0 0x7f8558148a70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8550020240 tx=0x7f853c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:00.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.648+0000 7f8555600640 1 -- 172.21.15.78:0/3012833303 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85500bc070 con 0x7f85581520f0 2024-05-21T14:44:00.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.648+0000 7f8555600640 1 -- 172.21.15.78:0/3012833303 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8550001800 con 0x7f85581520f0 2024-05-21T14:44:00.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.648+0000 7f8555600640 1 -- 172.21.15.78:0/3012833303 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855000a410 con 0x7f85581520f0 2024-05-21T14:44:00.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.648+0000 7f855f800640 1 -- 172.21.15.78:0/3012833303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8558151c20 con 0x7f85581520f0 2024-05-21T14:44:00.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.648+0000 7f855f800640 1 -- 172.21.15.78:0/3012833303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8558150610 con 0x7f85581520f0 2024-05-21T14:44:00.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.648+0000 7f855f800640 1 -- 172.21.15.78:0/3012833303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855804f730 con 0x7f85581520f0 2024-05-21T14:44:00.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.648+0000 7f8555600640 1 -- 172.21.15.78:0/3012833303 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f85500b6420 con 0x7f85581520f0 2024-05-21T14:44:00.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.648+0000 7f8555600640 1 --2- 172.21.15.78:0/3012833303 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f85340678f0 0x7f8534069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:00.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.648+0000 7f8555600640 1 -- 172.21.15.78:0/3012833303 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f8550122f40 con 0x7f85581520f0 2024-05-21T14:44:00.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.648+0000 7f855ce00640 1 --2- 172.21.15.78:0/3012833303 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f85340678f0 0x7f8534069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:00.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.652+0000 7f855ce00640 1 --2- 172.21.15.78:0/3012833303 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f85340678f0 0x7f8534069e00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8548007fd0 tx=0x7f8548009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:00.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.652+0000 7f8555600640 1 -- 172.21.15.78:0/3012833303 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f85500196b0 con 0x7f85581520f0 2024-05-21T14:44:00.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.844+0000 7f855f800640 1 -- 172.21.15.78:0/3012833303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85580c8e30 con 0x7f85581520f0 2024-05-21T14:44:00.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.844+0000 7f8555600640 1 -- 172.21.15.78:0/3012833303 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6906 (secure 0 0 0) 0x7f85500f3930 con 0x7f85581520f0 2024-05-21T14:44:00.853 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:44:00.854 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1952345794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1952345794},{"type":"v1","addr":"172.21.15.78:6833","nonce":1952345794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T14:43:18.985546+0000","modified":"2024-05-21T14:43:48.761495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4321,"mds_1":4300,"mds_2":4297,"mds_3":4294,"mds_4":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6836/3517628193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3517628193},{"type":"v1","addr":"172.21.15.78:6836","nonce":3517628193}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":9,"addr":"172.21.15.84:6835/3155872080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3155872080},{"type":"v1","addr":"172.21.15.84:6835","nonce":3155872080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6838/1750816366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1750816366},{"type":"v1","addr":"172.21.15.84:6838","nonce":1750816366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6839/4232079477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6837","nonce":4232079477},{"type":"v1","addr":"172.21.15.84:6839","nonce":4232079477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6837/1924967428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1924967428},{"type":"v1","addr":"172.21.15.78:6837","nonce":1924967428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4272,4294,4297,4300,4321]},"id":1}]} 2024-05-21T14:44:00.854 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 16 2024-05-21T14:44:00.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.848+0000 7f855f800640 1 -- 172.21.15.78:0/3012833303 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f85340678f0 msgr2=0x7f8534069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:00.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.848+0000 7f855f800640 1 --2- 172.21.15.78:0/3012833303 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f85340678f0 0x7f8534069e00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8548007fd0 tx=0x7f8548009040 comp rx=0 tx=0).stop 2024-05-21T14:44:00.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.848+0000 7f855f800640 1 -- 172.21.15.78:0/3012833303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85581520f0 msgr2=0x7f8558148a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:00.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.848+0000 7f855f800640 1 --2- 172.21.15.78:0/3012833303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85581520f0 0x7f8558148a70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8550020240 tx=0x7f853c005840 comp rx=0 tx=0).stop 2024-05-21T14:44:00.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.848+0000 7f855f800640 1 -- 172.21.15.78:0/3012833303 shutdown_connections 2024-05-21T14:44:00.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.848+0000 7f855f800640 1 --2- 172.21.15.78:0/3012833303 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f85340678f0 0x7f8534069e00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.848+0000 7f855f800640 1 --2- 172.21.15.78:0/3012833303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85581520f0 0x7f8558148a70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.848+0000 7f855f800640 1 --2- 172.21.15.78:0/3012833303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8558153380 0x7f85581f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.848+0000 7f855f800640 1 --2- 172.21.15.78:0/3012833303 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f853c0051b0 0x7f8558150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:00.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.848+0000 7f855f800640 1 -- 172.21.15.78:0/3012833303 >> 172.21.15.78:0/3012833303 conn(0x7f85580c9380 msgr2=0x7f855806ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:00.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.848+0000 7f855f800640 1 -- 172.21.15.78:0/3012833303 shutdown_connections 2024-05-21T14:44:00.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:00.848+0000 7f855f800640 1 -- 172.21.15.78:0/3012833303 wait complete. 2024-05-21T14:44:00.876 INFO:tasks.mds_thrash:Ready to start thrashing 2024-05-21T14:44:00.876 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2024-05-21T14:44:00.876 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T14:44:01.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.012+0000 7f4d74000640 1 Processor -- start 2024-05-21T14:44:01.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.012+0000 7f4d74000640 1 -- start start 2024-05-21T14:44:01.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.016+0000 7f4d74000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4d6c1529d0 0x7f4d6c072e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:01.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.016+0000 7f4d74000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4d6c071fe0 0x7f4d6c0723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:01.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.016+0000 7f4d74000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6c073380 con 0x7f4d6c0c5640 2024-05-21T14:44:01.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.016+0000 7f4d74000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f4d6c0715f0 con 0x7f4d6c071fe0 2024-05-21T14:44:01.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.016+0000 7f4d74000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f4d6c072b80 con 0x7f4d6c1529d0 2024-05-21T14:44:01.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.016+0000 7f4d70c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4d6c071fe0 0x7f4d6c0723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:01.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.016+0000 7f4d71600640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4d6c1529d0 0x7f4d6c072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:01.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.016+0000 7f4d72000640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4d6c0c5640 0x7f4d6c06b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.78:47228/0 (socket says 172.21.15.78:47228) 2024-05-21T14:44:01.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.016+0000 7f4d72000640 1 -- 172.21.15.78:0/3474319652 learned_addr learned my addr 172.21.15.78:0/3474319652 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:44:01.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.016+0000 7f4d6be00640 1 -- 172.21.15.78:0/3474319652 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1514429408 0 0) 0x7f4d640014a0 con 0x7f4d6c0c5640 2024-05-21T14:44:01.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.016+0000 7f4d6be00640 1 -- 172.21.15.78:0/3474319652 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d54003530 con 0x7f4d6c0c5640 2024-05-21T14:44:01.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.016+0000 7f4d70c00640 1 -- 172.21.15.78:0/3474319652 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4d6c1529d0 msgr2=0x7f4d6c072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:44:01.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.016+0000 7f4d70c00640 1 --2- 172.21.15.78:0/3474319652 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4d6c1529d0 0x7f4d6c072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.016+0000 7f4d70c00640 1 -- 172.21.15.78:0/3474319652 >> v1:172.21.15.84:6789/0 conn(0x7f4d6c0c5640 legacy=0x7f4d6c06b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:01.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.016+0000 7f4d70c00640 1 -- 172.21.15.78:0/3474319652 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c0c8530 con 0x7f4d6c071fe0 2024-05-21T14:44:01.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.020+0000 7f4d70c00640 1 --2- 172.21.15.78:0/3474319652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d6c071fe0 0x7f4d6c0723f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4d580097c0 tx=0x7f4d5801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86e833be519b84d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:01.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.020+0000 7f4d6be00640 1 -- 172.21.15.78:0/3474319652 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d580b0070 con 0x7f4d6c071fe0 2024-05-21T14:44:01.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.020+0000 7f4d6be00640 1 -- 172.21.15.78:0/3474319652 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d580ab600 con 0x7f4d6c071fe0 2024-05-21T14:44:01.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.020+0000 7f4d6be00640 1 -- 172.21.15.78:0/3474319652 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d580ab9d0 con 0x7f4d6c071fe0 2024-05-21T14:44:01.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.020+0000 7f4d74000640 1 -- 172.21.15.78:0/3474319652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d6c071fe0 msgr2=0x7f4d6c0723f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:01.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.020+0000 7f4d74000640 1 --2- 172.21.15.78:0/3474319652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d6c071fe0 0x7f4d6c0723f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4d580097c0 tx=0x7f4d5801c4a0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.020+0000 7f4d74000640 1 -- 172.21.15.78:0/3474319652 shutdown_connections 2024-05-21T14:44:01.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.020+0000 7f4d74000640 1 --2- 172.21.15.78:0/3474319652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d6c071fe0 0x7f4d6c0723f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.020+0000 7f4d74000640 1 --2- 172.21.15.78:0/3474319652 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4d6c1529d0 0x7f4d6c072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.020+0000 7f4d74000640 1 -- 172.21.15.78:0/3474319652 >> 172.21.15.78:0/3474319652 conn(0x7f4d6c0c9380 msgr2=0x7f4d6c0c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:01.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.020+0000 7f4d74000640 1 -- 172.21.15.78:0/3474319652 shutdown_connections 2024-05-21T14:44:01.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.020+0000 7f4d74000640 1 -- 172.21.15.78:0/3474319652 wait complete. 2024-05-21T14:44:01.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d74000640 1 Processor -- start 2024-05-21T14:44:01.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d74000640 1 -- start start 2024-05-21T14:44:01.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d74000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d6c071fe0 0x7f4d6c14da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:01.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d74000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d6c0c5640 0x7f4d6c1f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:01.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d74000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4d6c1529d0 0x7f4d6c0cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:01.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d74000640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c0c3a20 con 0x7f4d6c071fe0 2024-05-21T14:44:01.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d74000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c0c38a0 con 0x7f4d6c0c5640 2024-05-21T14:44:01.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d74000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f4d6c0c7280 con 0x7f4d6c1529d0 2024-05-21T14:44:01.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d71600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d6c071fe0 0x7f4d6c14da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:01.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d71600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d6c071fe0 0x7f4d6c14da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35524/0 (socket says 172.21.15.78:35524) 2024-05-21T14:44:01.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d71600640 1 -- 172.21.15.78:0/3846529232 learned_addr learned my addr 172.21.15.78:0/3846529232 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:44:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d70c00640 1 --2- 172.21.15.78:0/3846529232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d6c0c5640 0x7f4d6c1f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d72000640 1 --2- 172.21.15.78:0/3846529232 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4d6c1529d0 0x7f4d6c0cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d71600640 1 -- 172.21.15.78:0/3846529232 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4d6c1529d0 msgr2=0x7f4d6c0cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d71600640 1 --2- 172.21.15.78:0/3846529232 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4d6c1529d0 0x7f4d6c0cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d71600640 1 -- 172.21.15.78:0/3846529232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d6c0c5640 msgr2=0x7f4d6c1f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d71600640 1 --2- 172.21.15.78:0/3846529232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d6c0c5640 0x7f4d6c1f5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d71600640 1 -- 172.21.15.78:0/3846529232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c14c150 con 0x7f4d6c071fe0 2024-05-21T14:44:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d71600640 1 --2- 172.21.15.78:0/3846529232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d6c071fe0 0x7f4d6c14da00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000e8a0 tx=0x7f4d6000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d69600640 1 -- 172.21.15.78:0/3846529232 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60017070 con 0x7f4d6c071fe0 2024-05-21T14:44:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d69600640 1 -- 172.21.15.78:0/3846529232 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d6000c940 con 0x7f4d6c071fe0 2024-05-21T14:44:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d69600640 1 -- 172.21.15.78:0/3846529232 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6000ccf0 con 0x7f4d6c071fe0 2024-05-21T14:44:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.024+0000 7f4d74000640 1 -- 172.21.15.78:0/3846529232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6c14d430 con 0x7f4d6c071fe0 2024-05-21T14:44:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.028+0000 7f4d74000640 1 -- 172.21.15.78:0/3846529232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d6c14c6d0 con 0x7f4d6c071fe0 2024-05-21T14:44:01.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.028+0000 7f4d74000640 1 -- 172.21.15.78:0/3846529232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d6c04f730 con 0x7f4d6c071fe0 2024-05-21T14:44:01.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.028+0000 7f4d69600640 1 -- 172.21.15.78:0/3846529232 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4d6001a070 con 0x7f4d6c071fe0 2024-05-21T14:44:01.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.028+0000 7f4d69600640 1 --2- 172.21.15.78:0/3846529232 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f4d4c0678f0 0x7f4d4c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:01.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.028+0000 7f4d69600640 1 -- 172.21.15.78:0/3846529232 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f4d60085b90 con 0x7f4d6c071fe0 2024-05-21T14:44:01.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.028+0000 7f4d70c00640 1 --2- 172.21.15.78:0/3846529232 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f4d4c0678f0 0x7f4d4c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:01.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.032+0000 7f4d70c00640 1 --2- 172.21.15.78:0/3846529232 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f4d4c0678f0 0x7f4d4c069e00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4d580ad000 tx=0x7f4d58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:01.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.032+0000 7f4d69600640 1 -- 172.21.15.78:0/3846529232 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f4d60055fc0 con 0x7f4d6c071fe0 2024-05-21T14:44:01.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.192+0000 7f4d74000640 1 -- 172.21.15.78:0/3846529232 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d6c1504c0 con 0x7f4d4c0678f0 2024-05-21T14:44:01.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.208+0000 7f4d69600640 1 -- 172.21.15.78:0/3846529232 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252019 (secure 0 0 0) 0x7f4d6c1504c0 con 0x7f4d4c0678f0 2024-05-21T14:44:01.221 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:44:01.223 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-05-21T14:44:01.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.212+0000 7f4d74000640 1 -- 172.21.15.78:0/3846529232 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f4d4c0678f0 msgr2=0x7f4d4c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:01.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.212+0000 7f4d74000640 1 --2- 172.21.15.78:0/3846529232 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f4d4c0678f0 0x7f4d4c069e00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4d580ad000 tx=0x7f4d58008040 comp rx=0 tx=0).stop 2024-05-21T14:44:01.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.212+0000 7f4d74000640 1 -- 172.21.15.78:0/3846529232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d6c071fe0 msgr2=0x7f4d6c14da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:01.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.212+0000 7f4d74000640 1 --2- 172.21.15.78:0/3846529232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d6c071fe0 0x7f4d6c14da00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000e8a0 tx=0x7f4d6000eca0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.212+0000 7f4d74000640 1 -- 172.21.15.78:0/3846529232 shutdown_connections 2024-05-21T14:44:01.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.212+0000 7f4d74000640 1 --2- 172.21.15.78:0/3846529232 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f4d4c0678f0 0x7f4d4c069e00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.212+0000 7f4d74000640 1 --2- 172.21.15.78:0/3846529232 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4d6c1529d0 0x7f4d6c0cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.212+0000 7f4d74000640 1 --2- 172.21.15.78:0/3846529232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d6c0c5640 0x7f4d6c1f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.212+0000 7f4d74000640 1 --2- 172.21.15.78:0/3846529232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d6c071fe0 0x7f4d6c14da00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.212+0000 7f4d74000640 1 -- 172.21.15.78:0/3846529232 >> 172.21.15.78:0/3846529232 conn(0x7f4d6c0c9380 msgr2=0x7f4d6c151840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:01.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.212+0000 7f4d74000640 1 -- 172.21.15.78:0/3846529232 shutdown_connections 2024-05-21T14:44:01.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.212+0000 7f4d74000640 1 -- 172.21.15.78:0/3846529232 wait complete. 2024-05-21T14:44:01.242 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-05-21T14:44:00.502922+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598402,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":364,"num_write_kb":2478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218336,"kb_used_data":2208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756384,"statfs":{"total":773094113280,"available":772870537216,"internally_reserved":0,"allocated":2260992,"data_stored":1846684,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003457"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067056+0000","last_change":"2024-05-21T14:43:19.606707+0000","last_active":"2024-05-21T14:43:21.067056+0000","last_peered":"2024-05-21T14:43:21.067056+0000","last_clean":"2024-05-21T14:43:21.067056+0000","last_became_active":"2024-05-21T14:43:19.606365+0000","last_became_peered":"2024-05-21T14:43:19.606365+0000","last_unstale":"2024-05-21T14:43:21.067056+0000","last_undegraded":"2024-05-21T14:43:21.067056+0000","last_fullsized":"2024-05-21T14:43:21.067056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:26.135357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067577+0000","last_change":"2024-05-21T14:43:19.632879+0000","last_active":"2024-05-21T14:43:21.067577+0000","last_peered":"2024-05-21T14:43:21.067577+0000","last_clean":"2024-05-21T14:43:21.067577+0000","last_became_active":"2024-05-21T14:43:19.632218+0000","last_became_peered":"2024-05-21T14:43:19.632218+0000","last_unstale":"2024-05-21T14:43:21.067577+0000","last_undegraded":"2024-05-21T14:43:21.067577+0000","last_fullsized":"2024-05-21T14:43:21.067577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:35:49.461861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066825+0000","last_change":"2024-05-21T14:43:19.620214+0000","last_active":"2024-05-21T14:43:21.066825+0000","last_peered":"2024-05-21T14:43:21.066825+0000","last_clean":"2024-05-21T14:43:21.066825+0000","last_became_active":"2024-05-21T14:43:19.619012+0000","last_became_peered":"2024-05-21T14:43:19.619012+0000","last_unstale":"2024-05-21T14:43:21.066825+0000","last_undegraded":"2024-05-21T14:43:21.066825+0000","last_fullsized":"2024-05-21T14:43:21.066825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:40:22.415178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066035+0000","last_change":"2024-05-21T14:43:19.602199+0000","last_active":"2024-05-21T14:43:21.066035+0000","last_peered":"2024-05-21T14:43:21.066035+0000","last_clean":"2024-05-21T14:43:21.066035+0000","last_became_active":"2024-05-21T14:43:19.601797+0000","last_became_peered":"2024-05-21T14:43:19.601797+0000","last_unstale":"2024-05-21T14:43:21.066035+0000","last_undegraded":"2024-05-21T14:43:21.066035+0000","last_fullsized":"2024-05-21T14:43:21.066035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:33:00.071681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066510+0000","last_change":"2024-05-21T14:43:19.623449+0000","last_active":"2024-05-21T14:43:21.066510+0000","last_peered":"2024-05-21T14:43:21.066510+0000","last_clean":"2024-05-21T14:43:21.066510+0000","last_became_active":"2024-05-21T14:43:19.623125+0000","last_became_peered":"2024-05-21T14:43:19.623125+0000","last_unstale":"2024-05-21T14:43:21.066510+0000","last_undegraded":"2024-05-21T14:43:21.066510+0000","last_fullsized":"2024-05-21T14:43:21.066510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:42.178156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.065985+0000","last_change":"2024-05-21T14:43:19.591222+0000","last_active":"2024-05-21T14:43:21.065985+0000","last_peered":"2024-05-21T14:43:21.065985+0000","last_clean":"2024-05-21T14:43:21.065985+0000","last_became_active":"2024-05-21T14:43:19.590858+0000","last_became_peered":"2024-05-21T14:43:19.590858+0000","last_unstale":"2024-05-21T14:43:21.065985+0000","last_undegraded":"2024-05-21T14:43:21.065985+0000","last_fullsized":"2024-05-21T14:43:21.065985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:21:15.737192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066173+0000","last_change":"2024-05-21T14:43:19.614716+0000","last_active":"2024-05-21T14:43:21.066173+0000","last_peered":"2024-05-21T14:43:21.066173+0000","last_clean":"2024-05-21T14:43:21.066173+0000","last_became_active":"2024-05-21T14:43:19.614451+0000","last_became_peered":"2024-05-21T14:43:19.614451+0000","last_unstale":"2024-05-21T14:43:21.066173+0000","last_undegraded":"2024-05-21T14:43:21.066173+0000","last_fullsized":"2024-05-21T14:43:21.066173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:07:01.524574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066544+0000","last_change":"2024-05-21T14:43:19.604029+0000","last_active":"2024-05-21T14:43:21.066544+0000","last_peered":"2024-05-21T14:43:21.066544+0000","last_clean":"2024-05-21T14:43:21.066544+0000","last_became_active":"2024-05-21T14:43:19.603164+0000","last_became_peered":"2024-05-21T14:43:19.603164+0000","last_unstale":"2024-05-21T14:43:21.066544+0000","last_undegraded":"2024-05-21T14:43:21.066544+0000","last_fullsized":"2024-05-21T14:43:21.066544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:14:27.286952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578218+0000","last_change":"2024-05-21T14:43:19.613765+0000","last_active":"2024-05-21T14:43:20.578218+0000","last_peered":"2024-05-21T14:43:20.578218+0000","last_clean":"2024-05-21T14:43:20.578218+0000","last_became_active":"2024-05-21T14:43:19.613429+0000","last_became_peered":"2024-05-21T14:43:19.613429+0000","last_unstale":"2024-05-21T14:43:20.578218+0000","last_undegraded":"2024-05-21T14:43:20.578218+0000","last_fullsized":"2024-05-21T14:43:20.578218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:29:16.905434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066956+0000","last_change":"2024-05-21T14:43:19.607400+0000","last_active":"2024-05-21T14:43:21.066956+0000","last_peered":"2024-05-21T14:43:21.066956+0000","last_clean":"2024-05-21T14:43:21.066956+0000","last_became_active":"2024-05-21T14:43:19.607105+0000","last_became_peered":"2024-05-21T14:43:19.607105+0000","last_unstale":"2024-05-21T14:43:21.066956+0000","last_undegraded":"2024-05-21T14:43:21.066956+0000","last_fullsized":"2024-05-21T14:43:21.066956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:26:22.366105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066810+0000","last_change":"2024-05-21T14:43:19.606534+0000","last_active":"2024-05-21T14:43:21.066810+0000","last_peered":"2024-05-21T14:43:21.066810+0000","last_clean":"2024-05-21T14:43:21.066810+0000","last_became_active":"2024-05-21T14:43:19.606029+0000","last_became_peered":"2024-05-21T14:43:19.606029+0000","last_unstale":"2024-05-21T14:43:21.066810+0000","last_undegraded":"2024-05-21T14:43:21.066810+0000","last_fullsized":"2024-05-21T14:43:21.066810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:33:48.849701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066546+0000","last_change":"2024-05-21T14:43:19.609910+0000","last_active":"2024-05-21T14:43:21.066546+0000","last_peered":"2024-05-21T14:43:21.066546+0000","last_clean":"2024-05-21T14:43:21.066546+0000","last_became_active":"2024-05-21T14:43:19.609616+0000","last_became_peered":"2024-05-21T14:43:19.609616+0000","last_unstale":"2024-05-21T14:43:21.066546+0000","last_undegraded":"2024-05-21T14:43:21.066546+0000","last_fullsized":"2024-05-21T14:43:21.066546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:36:16.637620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581855+0000","last_change":"2024-05-21T14:43:19.604001+0000","last_active":"2024-05-21T14:43:20.581855+0000","last_peered":"2024-05-21T14:43:20.581855+0000","last_clean":"2024-05-21T14:43:20.581855+0000","last_became_active":"2024-05-21T14:43:19.596859+0000","last_became_peered":"2024-05-21T14:43:19.596859+0000","last_unstale":"2024-05-21T14:43:20.581855+0000","last_undegraded":"2024-05-21T14:43:20.581855+0000","last_fullsized":"2024-05-21T14:43:20.581855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:45:43.431420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580379+0000","last_change":"2024-05-21T14:43:19.626837+0000","last_active":"2024-05-21T14:43:20.580379+0000","last_peered":"2024-05-21T14:43:20.580379+0000","last_clean":"2024-05-21T14:43:20.580379+0000","last_became_active":"2024-05-21T14:43:19.626213+0000","last_became_peered":"2024-05-21T14:43:19.626213+0000","last_unstale":"2024-05-21T14:43:20.580379+0000","last_undegraded":"2024-05-21T14:43:20.580379+0000","last_fullsized":"2024-05-21T14:43:20.580379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:51.705474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066538+0000","last_change":"2024-05-21T14:43:19.613483+0000","last_active":"2024-05-21T14:43:21.066538+0000","last_peered":"2024-05-21T14:43:21.066538+0000","last_clean":"2024-05-21T14:43:21.066538+0000","last_became_active":"2024-05-21T14:43:19.612581+0000","last_became_peered":"2024-05-21T14:43:19.612581+0000","last_unstale":"2024-05-21T14:43:21.066538+0000","last_undegraded":"2024-05-21T14:43:21.066538+0000","last_fullsized":"2024-05-21T14:43:21.066538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:41:15.797196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797569+0000","last_change":"2024-05-21T14:43:19.609126+0000","last_active":"2024-05-21T14:43:20.797569+0000","last_peered":"2024-05-21T14:43:20.797569+0000","last_clean":"2024-05-21T14:43:20.797569+0000","last_became_active":"2024-05-21T14:43:19.607967+0000","last_became_peered":"2024-05-21T14:43:19.607967+0000","last_unstale":"2024-05-21T14:43:20.797569+0000","last_undegraded":"2024-05-21T14:43:20.797569+0000","last_fullsized":"2024-05-21T14:43:20.797569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:35.881039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798283+0000","last_change":"2024-05-21T14:43:19.613487+0000","last_active":"2024-05-21T14:43:20.798283+0000","last_peered":"2024-05-21T14:43:20.798283+0000","last_clean":"2024-05-21T14:43:20.798283+0000","last_became_active":"2024-05-21T14:43:19.611280+0000","last_became_peered":"2024-05-21T14:43:19.611280+0000","last_unstale":"2024-05-21T14:43:20.798283+0000","last_undegraded":"2024-05-21T14:43:20.798283+0000","last_fullsized":"2024-05-21T14:43:20.798283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:51:21.887715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.807337+0000","last_change":"2024-05-21T14:43:19.607601+0000","last_active":"2024-05-21T14:43:58.807337+0000","last_peered":"2024-05-21T14:43:58.807337+0000","last_clean":"2024-05-21T14:43:58.807337+0000","last_became_active":"2024-05-21T14:43:19.606719+0000","last_became_peered":"2024-05-21T14:43:19.606719+0000","last_unstale":"2024-05-21T14:43:58.807337+0000","last_undegraded":"2024-05-21T14:43:58.807337+0000","last_fullsized":"2024-05-21T14:43:58.807337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:04:32.310805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798234+0000","last_change":"2024-05-21T14:43:19.618470+0000","last_active":"2024-05-21T14:43:20.798234+0000","last_peered":"2024-05-21T14:43:20.798234+0000","last_clean":"2024-05-21T14:43:20.798234+0000","last_became_active":"2024-05-21T14:43:19.617408+0000","last_became_peered":"2024-05-21T14:43:19.617408+0000","last_unstale":"2024-05-21T14:43:20.798234+0000","last_undegraded":"2024-05-21T14:43:20.798234+0000","last_fullsized":"2024-05-21T14:43:20.798234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:53:58.877306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066709+0000","last_change":"2024-05-21T14:43:19.609835+0000","last_active":"2024-05-21T14:43:21.066709+0000","last_peered":"2024-05-21T14:43:21.066709+0000","last_clean":"2024-05-21T14:43:21.066709+0000","last_became_active":"2024-05-21T14:43:19.609525+0000","last_became_peered":"2024-05-21T14:43:19.609525+0000","last_unstale":"2024-05-21T14:43:21.066709+0000","last_undegraded":"2024-05-21T14:43:21.066709+0000","last_fullsized":"2024-05-21T14:43:21.066709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:57:04.748898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963454+0000","last_change":"2024-05-21T14:43:19.607732+0000","last_active":"2024-05-21T14:43:20.963454+0000","last_peered":"2024-05-21T14:43:20.963454+0000","last_clean":"2024-05-21T14:43:20.963454+0000","last_became_active":"2024-05-21T14:43:19.606839+0000","last_became_peered":"2024-05-21T14:43:19.606839+0000","last_unstale":"2024-05-21T14:43:20.963454+0000","last_undegraded":"2024-05-21T14:43:20.963454+0000","last_fullsized":"2024-05-21T14:43:20.963454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:43:15.675663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578145+0000","last_change":"2024-05-21T14:43:19.601108+0000","last_active":"2024-05-21T14:43:20.578145+0000","last_peered":"2024-05-21T14:43:20.578145+0000","last_clean":"2024-05-21T14:43:20.578145+0000","last_became_active":"2024-05-21T14:43:19.600780+0000","last_became_peered":"2024-05-21T14:43:19.600780+0000","last_unstale":"2024-05-21T14:43:20.578145+0000","last_undegraded":"2024-05-21T14:43:20.578145+0000","last_fullsized":"2024-05-21T14:43:20.578145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:47:19.062733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067184+0000","last_change":"2024-05-21T14:43:19.620463+0000","last_active":"2024-05-21T14:43:21.067184+0000","last_peered":"2024-05-21T14:43:21.067184+0000","last_clean":"2024-05-21T14:43:21.067184+0000","last_became_active":"2024-05-21T14:43:19.614489+0000","last_became_peered":"2024-05-21T14:43:19.614489+0000","last_unstale":"2024-05-21T14:43:21.067184+0000","last_undegraded":"2024-05-21T14:43:21.067184+0000","last_fullsized":"2024-05-21T14:43:21.067184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:51:07.953352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797590+0000","last_change":"2024-05-21T14:43:19.624683+0000","last_active":"2024-05-21T14:43:20.797590+0000","last_peered":"2024-05-21T14:43:20.797590+0000","last_clean":"2024-05-21T14:43:20.797590+0000","last_became_active":"2024-05-21T14:43:19.624304+0000","last_became_peered":"2024-05-21T14:43:19.624304+0000","last_unstale":"2024-05-21T14:43:20.797590+0000","last_undegraded":"2024-05-21T14:43:20.797590+0000","last_fullsized":"2024-05-21T14:43:20.797590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:53.874968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067763+0000","last_change":"2024-05-21T14:43:19.621030+0000","last_active":"2024-05-21T14:43:21.067763+0000","last_peered":"2024-05-21T14:43:21.067763+0000","last_clean":"2024-05-21T14:43:21.067763+0000","last_became_active":"2024-05-21T14:43:19.619072+0000","last_became_peered":"2024-05-21T14:43:19.619072+0000","last_unstale":"2024-05-21T14:43:21.067763+0000","last_undegraded":"2024-05-21T14:43:21.067763+0000","last_fullsized":"2024-05-21T14:43:21.067763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:22:09.423661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066417+0000","last_change":"2024-05-21T14:43:19.602880+0000","last_active":"2024-05-21T14:43:21.066417+0000","last_peered":"2024-05-21T14:43:21.066417+0000","last_clean":"2024-05-21T14:43:21.066417+0000","last_became_active":"2024-05-21T14:43:19.602577+0000","last_became_peered":"2024-05-21T14:43:19.602577+0000","last_unstale":"2024-05-21T14:43:21.066417+0000","last_undegraded":"2024-05-21T14:43:21.066417+0000","last_fullsized":"2024-05-21T14:43:21.066417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:04:10.094373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582914+0000","last_change":"2024-05-21T14:43:19.632328+0000","last_active":"2024-05-21T14:43:20.582914+0000","last_peered":"2024-05-21T14:43:20.582914+0000","last_clean":"2024-05-21T14:43:20.582914+0000","last_became_active":"2024-05-21T14:43:19.631351+0000","last_became_peered":"2024-05-21T14:43:19.631351+0000","last_unstale":"2024-05-21T14:43:20.582914+0000","last_undegraded":"2024-05-21T14:43:20.582914+0000","last_fullsized":"2024-05-21T14:43:20.582914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:36:18.467070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582481+0000","last_change":"2024-05-21T14:43:19.632282+0000","last_active":"2024-05-21T14:43:20.582481+0000","last_peered":"2024-05-21T14:43:20.582481+0000","last_clean":"2024-05-21T14:43:20.582481+0000","last_became_active":"2024-05-21T14:43:19.631522+0000","last_became_peered":"2024-05-21T14:43:19.631522+0000","last_unstale":"2024-05-21T14:43:20.582481+0000","last_undegraded":"2024-05-21T14:43:20.582481+0000","last_fullsized":"2024-05-21T14:43:20.582481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:23:32.646087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067227+0000","last_change":"2024-05-21T14:43:19.620046+0000","last_active":"2024-05-21T14:43:21.067227+0000","last_peered":"2024-05-21T14:43:21.067227+0000","last_clean":"2024-05-21T14:43:21.067227+0000","last_became_active":"2024-05-21T14:43:19.612428+0000","last_became_peered":"2024-05-21T14:43:19.612428+0000","last_unstale":"2024-05-21T14:43:21.067227+0000","last_undegraded":"2024-05-21T14:43:21.067227+0000","last_fullsized":"2024-05-21T14:43:21.067227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:08:33.785399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797667+0000","last_change":"2024-05-21T14:43:19.618198+0000","last_active":"2024-05-21T14:43:20.797667+0000","last_peered":"2024-05-21T14:43:20.797667+0000","last_clean":"2024-05-21T14:43:20.797667+0000","last_became_active":"2024-05-21T14:43:19.617903+0000","last_became_peered":"2024-05-21T14:43:19.617903+0000","last_unstale":"2024-05-21T14:43:20.797667+0000","last_undegraded":"2024-05-21T14:43:20.797667+0000","last_fullsized":"2024-05-21T14:43:20.797667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:59.606862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.805397+0000","last_change":"2024-05-21T14:43:19.613942+0000","last_active":"2024-05-21T14:43:58.805397+0000","last_peered":"2024-05-21T14:43:58.805397+0000","last_clean":"2024-05-21T14:43:58.805397+0000","last_became_active":"2024-05-21T14:43:19.613035+0000","last_became_peered":"2024-05-21T14:43:19.613035+0000","last_unstale":"2024-05-21T14:43:58.805397+0000","last_undegraded":"2024-05-21T14:43:58.805397+0000","last_fullsized":"2024-05-21T14:43:58.805397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:47:46.462547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.065907+0000","last_change":"2024-05-21T14:43:19.626414+0000","last_active":"2024-05-21T14:43:21.065907+0000","last_peered":"2024-05-21T14:43:21.065907+0000","last_clean":"2024-05-21T14:43:21.065907+0000","last_became_active":"2024-05-21T14:43:19.626080+0000","last_became_peered":"2024-05-21T14:43:19.626080+0000","last_unstale":"2024-05-21T14:43:21.065907+0000","last_undegraded":"2024-05-21T14:43:21.065907+0000","last_fullsized":"2024-05-21T14:43:21.065907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:37:38.449284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578382+0000","last_change":"2024-05-21T14:43:19.620806+0000","last_active":"2024-05-21T14:43:20.578382+0000","last_peered":"2024-05-21T14:43:20.578382+0000","last_clean":"2024-05-21T14:43:20.578382+0000","last_became_active":"2024-05-21T14:43:19.620449+0000","last_became_peered":"2024-05-21T14:43:19.620449+0000","last_unstale":"2024-05-21T14:43:20.578382+0000","last_undegraded":"2024-05-21T14:43:20.578382+0000","last_fullsized":"2024-05-21T14:43:20.578382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:43:52.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:29.674250+0000","last_change":"2024-05-21T14:43:18.603028+0000","last_active":"2024-05-21T14:43:29.674250+0000","last_peered":"2024-05-21T14:43:29.674250+0000","last_clean":"2024-05-21T14:43:29.674250+0000","last_became_active":"2024-05-21T14:43:18.602036+0000","last_became_peered":"2024-05-21T14:43:18.602036+0000","last_unstale":"2024-05-21T14:43:29.674250+0000","last_undegraded":"2024-05-21T14:43:29.674250+0000","last_fullsized":"2024-05-21T14:43:29.674250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:15:25.384197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963922+0000","last_change":"2024-05-21T14:43:19.599725+0000","last_active":"2024-05-21T14:43:20.963922+0000","last_peered":"2024-05-21T14:43:20.963922+0000","last_clean":"2024-05-21T14:43:20.963922+0000","last_became_active":"2024-05-21T14:43:19.598972+0000","last_became_peered":"2024-05-21T14:43:19.598972+0000","last_unstale":"2024-05-21T14:43:20.963922+0000","last_undegraded":"2024-05-21T14:43:20.963922+0000","last_fullsized":"2024-05-21T14:43:20.963922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:54:00.871046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'7","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.746826+0000","last_change":"2024-05-21T14:43:18.615934+0000","last_active":"2024-05-21T14:43:41.746826+0000","last_peered":"2024-05-21T14:43:41.746826+0000","last_clean":"2024-05-21T14:43:41.746826+0000","last_became_active":"2024-05-21T14:43:18.615568+0000","last_became_peered":"2024-05-21T14:43:18.615568+0000","last_unstale":"2024-05-21T14:43:41.746826+0000","last_undegraded":"2024-05-21T14:43:41.746826+0000","last_fullsized":"2024-05-21T14:43:41.746826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:28:54.494319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:35.724343+0000","last_change":"2024-05-21T14:43:18.615154+0000","last_active":"2024-05-21T14:43:35.724343+0000","last_peered":"2024-05-21T14:43:35.724343+0000","last_clean":"2024-05-21T14:43:35.724343+0000","last_became_active":"2024-05-21T14:43:18.613838+0000","last_became_peered":"2024-05-21T14:43:18.613838+0000","last_unstale":"2024-05-21T14:43:35.724343+0000","last_undegraded":"2024-05-21T14:43:35.724343+0000","last_fullsized":"2024-05-21T14:43:35.724343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:32:09.174124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067194+0000","last_change":"2024-05-21T14:43:19.633585+0000","last_active":"2024-05-21T14:43:21.067194+0000","last_peered":"2024-05-21T14:43:21.067194+0000","last_clean":"2024-05-21T14:43:21.067194+0000","last_became_active":"2024-05-21T14:43:19.632476+0000","last_became_peered":"2024-05-21T14:43:19.632476+0000","last_unstale":"2024-05-21T14:43:21.067194+0000","last_undegraded":"2024-05-21T14:43:21.067194+0000","last_fullsized":"2024-05-21T14:43:21.067194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:53.023931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.745819+0000","last_change":"2024-05-21T14:43:18.585548+0000","last_active":"2024-05-21T14:43:41.745819+0000","last_peered":"2024-05-21T14:43:41.745819+0000","last_clean":"2024-05-21T14:43:41.745819+0000","last_became_active":"2024-05-21T14:43:18.585099+0000","last_became_peered":"2024-05-21T14:43:18.585099+0000","last_unstale":"2024-05-21T14:43:41.745819+0000","last_undegraded":"2024-05-21T14:43:41.745819+0000","last_fullsized":"2024-05-21T14:43:41.745819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:20:16.856225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963459+0000","last_change":"2024-05-21T14:43:19.614884+0000","last_active":"2024-05-21T14:43:20.963459+0000","last_peered":"2024-05-21T14:43:20.963459+0000","last_clean":"2024-05-21T14:43:20.963459+0000","last_became_active":"2024-05-21T14:43:19.614064+0000","last_became_peered":"2024-05-21T14:43:19.614064+0000","last_unstale":"2024-05-21T14:43:20.963459+0000","last_undegraded":"2024-05-21T14:43:20.963459+0000","last_fullsized":"2024-05-21T14:43:20.963459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:42:17.091043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:29.681041+0000","last_change":"2024-05-21T14:43:18.602794+0000","last_active":"2024-05-21T14:43:29.681041+0000","last_peered":"2024-05-21T14:43:29.681041+0000","last_clean":"2024-05-21T14:43:29.681041+0000","last_became_active":"2024-05-21T14:43:18.602429+0000","last_became_peered":"2024-05-21T14:43:18.602429+0000","last_unstale":"2024-05-21T14:43:29.681041+0000","last_undegraded":"2024-05-21T14:43:29.681041+0000","last_fullsized":"2024-05-21T14:43:29.681041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:50:14.465202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066483+0000","last_change":"2024-05-21T14:43:19.602663+0000","last_active":"2024-05-21T14:43:21.066483+0000","last_peered":"2024-05-21T14:43:21.066483+0000","last_clean":"2024-05-21T14:43:21.066483+0000","last_became_active":"2024-05-21T14:43:19.602294+0000","last_became_peered":"2024-05-21T14:43:19.602294+0000","last_unstale":"2024-05-21T14:43:21.066483+0000","last_undegraded":"2024-05-21T14:43:21.066483+0000","last_fullsized":"2024-05-21T14:43:21.066483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:48:56.271741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.769548+0000","last_change":"2024-05-21T14:43:18.604601+0000","last_active":"2024-05-21T14:43:47.769548+0000","last_peered":"2024-05-21T14:43:47.769548+0000","last_clean":"2024-05-21T14:43:47.769548+0000","last_became_active":"2024-05-21T14:43:18.604262+0000","last_became_peered":"2024-05-21T14:43:18.604262+0000","last_unstale":"2024-05-21T14:43:47.769548+0000","last_undegraded":"2024-05-21T14:43:47.769548+0000","last_fullsized":"2024-05-21T14:43:47.769548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:15.490579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.068019+0000","last_change":"2024-05-21T14:43:19.613952+0000","last_active":"2024-05-21T14:43:21.068019+0000","last_peered":"2024-05-21T14:43:21.068019+0000","last_clean":"2024-05-21T14:43:21.068019+0000","last_became_active":"2024-05-21T14:43:19.613093+0000","last_became_peered":"2024-05-21T14:43:19.613093+0000","last_unstale":"2024-05-21T14:43:21.068019+0000","last_undegraded":"2024-05-21T14:43:21.068019+0000","last_fullsized":"2024-05-21T14:43:21.068019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:03:44.925212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'5","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.806914+0000","last_change":"2024-05-21T14:43:18.602343+0000","last_active":"2024-05-21T14:43:58.806914+0000","last_peered":"2024-05-21T14:43:58.806914+0000","last_clean":"2024-05-21T14:43:58.806914+0000","last_became_active":"2024-05-21T14:43:18.601500+0000","last_became_peered":"2024-05-21T14:43:18.601500+0000","last_unstale":"2024-05-21T14:43:58.806914+0000","last_undegraded":"2024-05-21T14:43:58.806914+0000","last_fullsized":"2024-05-21T14:43:58.806914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:54:21.960430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798025+0000","last_change":"2024-05-21T14:43:19.608580+0000","last_active":"2024-05-21T14:43:20.798025+0000","last_peered":"2024-05-21T14:43:20.798025+0000","last_clean":"2024-05-21T14:43:20.798025+0000","last_became_active":"2024-05-21T14:43:19.608038+0000","last_became_peered":"2024-05-21T14:43:19.608038+0000","last_unstale":"2024-05-21T14:43:20.798025+0000","last_undegraded":"2024-05-21T14:43:20.798025+0000","last_fullsized":"2024-05-21T14:43:20.798025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:19.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'10","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.768673+0000","last_change":"2024-05-21T14:43:18.606824+0000","last_active":"2024-05-21T14:43:47.768673+0000","last_peered":"2024-05-21T14:43:47.768673+0000","last_clean":"2024-05-21T14:43:47.768673+0000","last_became_active":"2024-05-21T14:43:18.606449+0000","last_became_peered":"2024-05-21T14:43:18.606449+0000","last_unstale":"2024-05-21T14:43:47.768673+0000","last_undegraded":"2024-05-21T14:43:47.768673+0000","last_fullsized":"2024-05-21T14:43:47.768673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:43:41.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066889+0000","last_change":"2024-05-21T14:43:19.634014+0000","last_active":"2024-05-21T14:43:21.066889+0000","last_peered":"2024-05-21T14:43:21.066889+0000","last_clean":"2024-05-21T14:43:21.066889+0000","last_became_active":"2024-05-21T14:43:19.633664+0000","last_became_peered":"2024-05-21T14:43:19.633664+0000","last_unstale":"2024-05-21T14:43:21.066889+0000","last_undegraded":"2024-05-21T14:43:21.066889+0000","last_fullsized":"2024-05-21T14:43:21.066889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:36:07.708164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.806114+0000","last_change":"2024-05-21T14:43:18.614764+0000","last_active":"2024-05-21T14:43:58.806114+0000","last_peered":"2024-05-21T14:43:58.806114+0000","last_clean":"2024-05-21T14:43:58.806114+0000","last_became_active":"2024-05-21T14:43:18.614214+0000","last_became_peered":"2024-05-21T14:43:18.614214+0000","last_unstale":"2024-05-21T14:43:58.806114+0000","last_undegraded":"2024-05-21T14:43:58.806114+0000","last_fullsized":"2024-05-21T14:43:58.806114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:34:40.294756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580771+0000","last_change":"2024-05-21T14:43:19.625313+0000","last_active":"2024-05-21T14:43:20.580771+0000","last_peered":"2024-05-21T14:43:20.580771+0000","last_clean":"2024-05-21T14:43:20.580771+0000","last_became_active":"2024-05-21T14:43:19.624474+0000","last_became_peered":"2024-05-21T14:43:19.624474+0000","last_unstale":"2024-05-21T14:43:20.580771+0000","last_undegraded":"2024-05-21T14:43:20.580771+0000","last_fullsized":"2024-05-21T14:43:20.580771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:28.280456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.746478+0000","last_change":"2024-05-21T14:43:18.600736+0000","last_active":"2024-05-21T14:43:41.746478+0000","last_peered":"2024-05-21T14:43:41.746478+0000","last_clean":"2024-05-21T14:43:41.746478+0000","last_became_active":"2024-05-21T14:43:18.600415+0000","last_became_peered":"2024-05-21T14:43:18.600415+0000","last_unstale":"2024-05-21T14:43:41.746478+0000","last_undegraded":"2024-05-21T14:43:41.746478+0000","last_fullsized":"2024-05-21T14:43:41.746478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:03:57.207603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797724+0000","last_change":"2024-05-21T14:43:19.599637+0000","last_active":"2024-05-21T14:43:20.797724+0000","last_peered":"2024-05-21T14:43:20.797724+0000","last_clean":"2024-05-21T14:43:20.797724+0000","last_became_active":"2024-05-21T14:43:19.599195+0000","last_became_peered":"2024-05-21T14:43:19.599195+0000","last_unstale":"2024-05-21T14:43:20.797724+0000","last_undegraded":"2024-05-21T14:43:20.797724+0000","last_fullsized":"2024-05-21T14:43:20.797724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:17.350821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.739415+0000","last_change":"2024-05-21T14:43:18.603064+0000","last_active":"2024-05-21T14:43:41.739415+0000","last_peered":"2024-05-21T14:43:41.739415+0000","last_clean":"2024-05-21T14:43:41.739415+0000","last_became_active":"2024-05-21T14:43:18.602658+0000","last_became_peered":"2024-05-21T14:43:18.602658+0000","last_unstale":"2024-05-21T14:43:41.739415+0000","last_undegraded":"2024-05-21T14:43:41.739415+0000","last_fullsized":"2024-05-21T14:43:41.739415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:09:28.623131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.577809+0000","last_change":"2024-05-21T14:43:19.620760+0000","last_active":"2024-05-21T14:43:20.577809+0000","last_peered":"2024-05-21T14:43:20.577809+0000","last_clean":"2024-05-21T14:43:20.577809+0000","last_became_active":"2024-05-21T14:43:19.620409+0000","last_became_peered":"2024-05-21T14:43:19.620409+0000","last_unstale":"2024-05-21T14:43:20.577809+0000","last_undegraded":"2024-05-21T14:43:20.577809+0000","last_fullsized":"2024-05-21T14:43:20.577809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:49:59.051131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'17","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.743219+0000","last_change":"2024-05-21T14:43:18.594225+0000","last_active":"2024-05-21T14:43:41.743219+0000","last_peered":"2024-05-21T14:43:41.743219+0000","last_clean":"2024-05-21T14:43:41.743219+0000","last_became_active":"2024-05-21T14:43:18.592335+0000","last_became_peered":"2024-05-21T14:43:18.592335+0000","last_unstale":"2024-05-21T14:43:41.743219+0000","last_undegraded":"2024-05-21T14:43:41.743219+0000","last_fullsized":"2024-05-21T14:43:41.743219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:00:58.772091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797667+0000","last_change":"2024-05-21T14:43:19.612442+0000","last_active":"2024-05-21T14:43:20.797667+0000","last_peered":"2024-05-21T14:43:20.797667+0000","last_clean":"2024-05-21T14:43:20.797667+0000","last_became_active":"2024-05-21T14:43:19.612110+0000","last_became_peered":"2024-05-21T14:43:19.612110+0000","last_unstale":"2024-05-21T14:43:20.797667+0000","last_undegraded":"2024-05-21T14:43:20.797667+0000","last_fullsized":"2024-05-21T14:43:20.797667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:53.451513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.590887+0000","last_change":"2024-05-21T14:43:18.613433+0000","last_active":"2024-05-21T14:43:24.590887+0000","last_peered":"2024-05-21T14:43:24.590887+0000","last_clean":"2024-05-21T14:43:24.590887+0000","last_became_active":"2024-05-21T14:43:18.613048+0000","last_became_peered":"2024-05-21T14:43:18.613048+0000","last_unstale":"2024-05-21T14:43:24.590887+0000","last_undegraded":"2024-05-21T14:43:24.590887+0000","last_fullsized":"2024-05-21T14:43:24.590887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:00:16.454574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066572+0000","last_change":"2024-05-21T14:43:19.597079+0000","last_active":"2024-05-21T14:43:21.066572+0000","last_peered":"2024-05-21T14:43:21.066572+0000","last_clean":"2024-05-21T14:43:21.066572+0000","last_became_active":"2024-05-21T14:43:19.596736+0000","last_became_peered":"2024-05-21T14:43:19.596736+0000","last_unstale":"2024-05-21T14:43:21.066572+0000","last_undegraded":"2024-05-21T14:43:21.066572+0000","last_fullsized":"2024-05-21T14:43:21.066572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:09:03.687971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.770686+0000","last_change":"2024-05-21T14:43:18.620603+0000","last_active":"2024-05-21T14:43:47.770686+0000","last_peered":"2024-05-21T14:43:47.770686+0000","last_clean":"2024-05-21T14:43:47.770686+0000","last_became_active":"2024-05-21T14:43:18.619762+0000","last_became_peered":"2024-05-21T14:43:18.619762+0000","last_unstale":"2024-05-21T14:43:47.770686+0000","last_undegraded":"2024-05-21T14:43:47.770686+0000","last_fullsized":"2024-05-21T14:43:47.770686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:31:49.257435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067100+0000","last_change":"2024-05-21T14:43:19.611608+0000","last_active":"2024-05-21T14:43:21.067100+0000","last_peered":"2024-05-21T14:43:21.067100+0000","last_clean":"2024-05-21T14:43:21.067100+0000","last_became_active":"2024-05-21T14:43:19.610774+0000","last_became_peered":"2024-05-21T14:43:19.610774+0000","last_unstale":"2024-05-21T14:43:21.067100+0000","last_undegraded":"2024-05-21T14:43:21.067100+0000","last_fullsized":"2024-05-21T14:43:21.067100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:19:00.383286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.741997+0000","last_change":"2024-05-21T14:43:18.610121+0000","last_active":"2024-05-21T14:43:41.741997+0000","last_peered":"2024-05-21T14:43:41.741997+0000","last_clean":"2024-05-21T14:43:41.741997+0000","last_became_active":"2024-05-21T14:43:18.609349+0000","last_became_peered":"2024-05-21T14:43:18.609349+0000","last_unstale":"2024-05-21T14:43:41.741997+0000","last_undegraded":"2024-05-21T14:43:41.741997+0000","last_fullsized":"2024-05-21T14:43:41.741997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:48.330067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066734+0000","last_change":"2024-05-21T14:43:19.605193+0000","last_active":"2024-05-21T14:43:21.066734+0000","last_peered":"2024-05-21T14:43:21.066734+0000","last_clean":"2024-05-21T14:43:21.066734+0000","last_became_active":"2024-05-21T14:43:19.604869+0000","last_became_peered":"2024-05-21T14:43:19.604869+0000","last_unstale":"2024-05-21T14:43:21.066734+0000","last_undegraded":"2024-05-21T14:43:21.066734+0000","last_fullsized":"2024-05-21T14:43:21.066734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:58:05.078363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.738314+0000","last_change":"2024-05-21T14:43:18.616535+0000","last_active":"2024-05-21T14:43:41.738314+0000","last_peered":"2024-05-21T14:43:41.738314+0000","last_clean":"2024-05-21T14:43:41.738314+0000","last_became_active":"2024-05-21T14:43:18.615734+0000","last_became_peered":"2024-05-21T14:43:18.615734+0000","last_unstale":"2024-05-21T14:43:41.738314+0000","last_undegraded":"2024-05-21T14:43:41.738314+0000","last_fullsized":"2024-05-21T14:43:41.738314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:10:27.821535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798116+0000","last_change":"2024-05-21T14:43:19.615424+0000","last_active":"2024-05-21T14:43:20.798116+0000","last_peered":"2024-05-21T14:43:20.798116+0000","last_clean":"2024-05-21T14:43:20.798116+0000","last_became_active":"2024-05-21T14:43:19.614915+0000","last_became_peered":"2024-05-21T14:43:19.614915+0000","last_unstale":"2024-05-21T14:43:20.798116+0000","last_undegraded":"2024-05-21T14:43:20.798116+0000","last_fullsized":"2024-05-21T14:43:20.798116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:25:09.153430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.577738+0000","last_change":"2024-05-21T14:43:08.080234+0000","last_active":"2024-05-21T14:43:20.577738+0000","last_peered":"2024-05-21T14:43:20.577738+0000","last_clean":"2024-05-21T14:43:20.577738+0000","last_became_active":"2024-05-21T14:43:08.079934+0000","last_became_peered":"2024-05-21T14:43:08.079934+0000","last_unstale":"2024-05-21T14:43:20.577738+0000","last_undegraded":"2024-05-21T14:43:20.577738+0000","last_fullsized":"2024-05-21T14:43:20.577738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_clean_scrub_stamp":"2024-05-21T14:43:07.046978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:54:57.347768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.746452+0000","last_change":"2024-05-21T14:43:18.599850+0000","last_active":"2024-05-21T14:43:41.746452+0000","last_peered":"2024-05-21T14:43:41.746452+0000","last_clean":"2024-05-21T14:43:41.746452+0000","last_became_active":"2024-05-21T14:43:18.599347+0000","last_became_peered":"2024-05-21T14:43:18.599347+0000","last_unstale":"2024-05-21T14:43:41.746452+0000","last_undegraded":"2024-05-21T14:43:41.746452+0000","last_fullsized":"2024-05-21T14:43:41.746452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:01:06.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963423+0000","last_change":"2024-05-21T14:43:19.613056+0000","last_active":"2024-05-21T14:43:20.963423+0000","last_peered":"2024-05-21T14:43:20.963423+0000","last_clean":"2024-05-21T14:43:20.963423+0000","last_became_active":"2024-05-21T14:43:19.611889+0000","last_became_peered":"2024-05-21T14:43:19.611889+0000","last_unstale":"2024-05-21T14:43:20.963423+0000","last_undegraded":"2024-05-21T14:43:20.963423+0000","last_fullsized":"2024-05-21T14:43:20.963423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:46:20.105282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:35.726262+0000","last_change":"2024-05-21T14:43:18.621482+0000","last_active":"2024-05-21T14:43:35.726262+0000","last_peered":"2024-05-21T14:43:35.726262+0000","last_clean":"2024-05-21T14:43:35.726262+0000","last_became_active":"2024-05-21T14:43:18.621229+0000","last_became_peered":"2024-05-21T14:43:18.621229+0000","last_unstale":"2024-05-21T14:43:35.726262+0000","last_undegraded":"2024-05-21T14:43:35.726262+0000","last_fullsized":"2024-05-21T14:43:35.726262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:30:04.326588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580381+0000","last_change":"2024-05-21T14:43:19.625038+0000","last_active":"2024-05-21T14:43:20.580381+0000","last_peered":"2024-05-21T14:43:20.580381+0000","last_clean":"2024-05-21T14:43:20.580381+0000","last_became_active":"2024-05-21T14:43:19.624114+0000","last_became_peered":"2024-05-21T14:43:19.624114+0000","last_unstale":"2024-05-21T14:43:20.580381+0000","last_undegraded":"2024-05-21T14:43:20.580381+0000","last_fullsized":"2024-05-21T14:43:20.580381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:11.854243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'5","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.805088+0000","last_change":"2024-05-21T14:43:18.618518+0000","last_active":"2024-05-21T14:43:58.805088+0000","last_peered":"2024-05-21T14:43:58.805088+0000","last_clean":"2024-05-21T14:43:58.805088+0000","last_became_active":"2024-05-21T14:43:18.617756+0000","last_became_peered":"2024-05-21T14:43:18.617756+0000","last_unstale":"2024-05-21T14:43:58.805088+0000","last_undegraded":"2024-05-21T14:43:58.805088+0000","last_fullsized":"2024-05-21T14:43:58.805088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:52:12.999877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066783+0000","last_change":"2024-05-21T14:43:19.613595+0000","last_active":"2024-05-21T14:43:21.066783+0000","last_peered":"2024-05-21T14:43:21.066783+0000","last_clean":"2024-05-21T14:43:21.066783+0000","last_became_active":"2024-05-21T14:43:19.612730+0000","last_became_peered":"2024-05-21T14:43:19.612730+0000","last_unstale":"2024-05-21T14:43:21.066783+0000","last_undegraded":"2024-05-21T14:43:21.066783+0000","last_fullsized":"2024-05-21T14:43:21.066783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:01:02.847071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.773237+0000","last_change":"2024-05-21T14:43:18.608596+0000","last_active":"2024-05-21T14:43:47.773237+0000","last_peered":"2024-05-21T14:43:47.773237+0000","last_clean":"2024-05-21T14:43:47.773237+0000","last_became_active":"2024-05-21T14:43:18.608262+0000","last_became_peered":"2024-05-21T14:43:18.608262+0000","last_unstale":"2024-05-21T14:43:47.773237+0000","last_undegraded":"2024-05-21T14:43:47.773237+0000","last_fullsized":"2024-05-21T14:43:47.773237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:14.962554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066581+0000","last_change":"2024-05-21T14:43:19.607815+0000","last_active":"2024-05-21T14:43:21.066581+0000","last_peered":"2024-05-21T14:43:21.066581+0000","last_clean":"2024-05-21T14:43:21.066581+0000","last_became_active":"2024-05-21T14:43:19.607513+0000","last_became_peered":"2024-05-21T14:43:19.607513+0000","last_unstale":"2024-05-21T14:43:21.066581+0000","last_undegraded":"2024-05-21T14:43:21.066581+0000","last_fullsized":"2024-05-21T14:43:21.066581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:01:35.332981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066943+0000","last_change":"2024-05-21T14:43:18.603626+0000","last_active":"2024-05-21T14:43:21.066943+0000","last_peered":"2024-05-21T14:43:21.066943+0000","last_clean":"2024-05-21T14:43:21.066943+0000","last_became_active":"2024-05-21T14:43:18.602704+0000","last_became_peered":"2024-05-21T14:43:18.602704+0000","last_unstale":"2024-05-21T14:43:21.066943+0000","last_undegraded":"2024-05-21T14:43:21.066943+0000","last_fullsized":"2024-05-21T14:43:21.066943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:03.976820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066240+0000","last_change":"2024-05-21T14:43:19.634449+0000","last_active":"2024-05-21T14:43:21.066240+0000","last_peered":"2024-05-21T14:43:21.066240+0000","last_clean":"2024-05-21T14:43:21.066240+0000","last_became_active":"2024-05-21T14:43:19.633751+0000","last_became_peered":"2024-05-21T14:43:19.633751+0000","last_unstale":"2024-05-21T14:43:21.066240+0000","last_undegraded":"2024-05-21T14:43:21.066240+0000","last_fullsized":"2024-05-21T14:43:21.066240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:04:51.415303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.747266+0000","last_change":"2024-05-21T14:43:18.608335+0000","last_active":"2024-05-21T14:43:41.747266+0000","last_peered":"2024-05-21T14:43:41.747266+0000","last_clean":"2024-05-21T14:43:41.747266+0000","last_became_active":"2024-05-21T14:43:18.607999+0000","last_became_peered":"2024-05-21T14:43:18.607999+0000","last_unstale":"2024-05-21T14:43:41.747266+0000","last_undegraded":"2024-05-21T14:43:41.747266+0000","last_fullsized":"2024-05-21T14:43:41.747266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:21.325953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582549+0000","last_change":"2024-05-21T14:43:19.626742+0000","last_active":"2024-05-21T14:43:20.582549+0000","last_peered":"2024-05-21T14:43:20.582549+0000","last_clean":"2024-05-21T14:43:20.582549+0000","last_became_active":"2024-05-21T14:43:19.626024+0000","last_became_peered":"2024-05-21T14:43:19.626024+0000","last_unstale":"2024-05-21T14:43:20.582549+0000","last_undegraded":"2024-05-21T14:43:20.582549+0000","last_fullsized":"2024-05-21T14:43:20.582549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:48:15.426224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'7","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.743462+0000","last_change":"2024-05-21T14:43:18.616913+0000","last_active":"2024-05-21T14:43:41.743462+0000","last_peered":"2024-05-21T14:43:41.743462+0000","last_clean":"2024-05-21T14:43:41.743462+0000","last_became_active":"2024-05-21T14:43:18.616214+0000","last_became_peered":"2024-05-21T14:43:18.616214+0000","last_unstale":"2024-05-21T14:43:41.743462+0000","last_undegraded":"2024-05-21T14:43:41.743462+0000","last_fullsized":"2024-05-21T14:43:41.743462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:22.112018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963796+0000","last_change":"2024-05-21T14:43:19.607521+0000","last_active":"2024-05-21T14:43:20.963796+0000","last_peered":"2024-05-21T14:43:20.963796+0000","last_clean":"2024-05-21T14:43:20.963796+0000","last_became_active":"2024-05-21T14:43:19.606673+0000","last_became_peered":"2024-05-21T14:43:19.606673+0000","last_unstale":"2024-05-21T14:43:20.963796+0000","last_undegraded":"2024-05-21T14:43:20.963796+0000","last_fullsized":"2024-05-21T14:43:20.963796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:50:50.373410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'7","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.768063+0000","last_change":"2024-05-21T14:43:18.615846+0000","last_active":"2024-05-21T14:43:47.768063+0000","last_peered":"2024-05-21T14:43:47.768063+0000","last_clean":"2024-05-21T14:43:47.768063+0000","last_became_active":"2024-05-21T14:43:18.615506+0000","last_became_peered":"2024-05-21T14:43:18.615506+0000","last_unstale":"2024-05-21T14:43:47.768063+0000","last_undegraded":"2024-05-21T14:43:47.768063+0000","last_fullsized":"2024-05-21T14:43:47.768063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:07:17.030757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.964252+0000","last_change":"2024-05-21T14:43:19.611473+0000","last_active":"2024-05-21T14:43:20.964252+0000","last_peered":"2024-05-21T14:43:20.964252+0000","last_clean":"2024-05-21T14:43:20.964252+0000","last_became_active":"2024-05-21T14:43:19.610600+0000","last_became_peered":"2024-05-21T14:43:19.610600+0000","last_unstale":"2024-05-21T14:43:20.964252+0000","last_undegraded":"2024-05-21T14:43:20.964252+0000","last_fullsized":"2024-05-21T14:43:20.964252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:48:07.659795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:29.679809+0000","last_change":"2024-05-21T14:43:18.604951+0000","last_active":"2024-05-21T14:43:29.679809+0000","last_peered":"2024-05-21T14:43:29.679809+0000","last_clean":"2024-05-21T14:43:29.679809+0000","last_became_active":"2024-05-21T14:43:18.602186+0000","last_became_peered":"2024-05-21T14:43:18.602186+0000","last_unstale":"2024-05-21T14:43:29.679809+0000","last_undegraded":"2024-05-21T14:43:29.679809+0000","last_fullsized":"2024-05-21T14:43:29.679809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:34:10.395484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797647+0000","last_change":"2024-05-21T14:43:19.600827+0000","last_active":"2024-05-21T14:43:20.797647+0000","last_peered":"2024-05-21T14:43:20.797647+0000","last_clean":"2024-05-21T14:43:20.797647+0000","last_became_active":"2024-05-21T14:43:19.600499+0000","last_became_peered":"2024-05-21T14:43:19.600499+0000","last_unstale":"2024-05-21T14:43:20.797647+0000","last_undegraded":"2024-05-21T14:43:20.797647+0000","last_fullsized":"2024-05-21T14:43:20.797647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:55:36.231321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'7","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.769353+0000","last_change":"2024-05-21T14:43:18.615190+0000","last_active":"2024-05-21T14:43:47.769353+0000","last_peered":"2024-05-21T14:43:47.769353+0000","last_clean":"2024-05-21T14:43:47.769353+0000","last_became_active":"2024-05-21T14:43:18.614306+0000","last_became_peered":"2024-05-21T14:43:18.614306+0000","last_unstale":"2024-05-21T14:43:47.769353+0000","last_undegraded":"2024-05-21T14:43:47.769353+0000","last_fullsized":"2024-05-21T14:43:47.769353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:53.472559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.962948+0000","last_change":"2024-05-21T14:43:19.610903+0000","last_active":"2024-05-21T14:43:20.962948+0000","last_peered":"2024-05-21T14:43:20.962948+0000","last_clean":"2024-05-21T14:43:20.962948+0000","last_became_active":"2024-05-21T14:43:19.610101+0000","last_became_peered":"2024-05-21T14:43:19.610101+0000","last_unstale":"2024-05-21T14:43:20.962948+0000","last_undegraded":"2024-05-21T14:43:20.962948+0000","last_fullsized":"2024-05-21T14:43:20.962948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:16:24.580581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.740216+0000","last_change":"2024-05-21T14:43:18.617785+0000","last_active":"2024-05-21T14:43:41.740216+0000","last_peered":"2024-05-21T14:43:41.740216+0000","last_clean":"2024-05-21T14:43:41.740216+0000","last_became_active":"2024-05-21T14:43:18.617041+0000","last_became_peered":"2024-05-21T14:43:18.617041+0000","last_unstale":"2024-05-21T14:43:41.740216+0000","last_undegraded":"2024-05-21T14:43:41.740216+0000","last_fullsized":"2024-05-21T14:43:41.740216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:02:50.837158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.805753+0000","last_change":"2024-05-21T14:43:19.627096+0000","last_active":"2024-05-21T14:43:58.805753+0000","last_peered":"2024-05-21T14:43:58.805753+0000","last_clean":"2024-05-21T14:43:58.805753+0000","last_became_active":"2024-05-21T14:43:19.626265+0000","last_became_peered":"2024-05-21T14:43:19.626265+0000","last_unstale":"2024-05-21T14:43:58.805753+0000","last_undegraded":"2024-05-21T14:43:58.805753+0000","last_fullsized":"2024-05-21T14:43:58.805753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:23:47.818120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:29.698283+0000","last_change":"2024-05-21T14:43:18.599635+0000","last_active":"2024-05-21T14:43:29.698283+0000","last_peered":"2024-05-21T14:43:29.698283+0000","last_clean":"2024-05-21T14:43:29.698283+0000","last_became_active":"2024-05-21T14:43:18.598996+0000","last_became_peered":"2024-05-21T14:43:18.598996+0000","last_unstale":"2024-05-21T14:43:29.698283+0000","last_undegraded":"2024-05-21T14:43:29.698283+0000","last_fullsized":"2024-05-21T14:43:29.698283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:17:09.383291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797767+0000","last_change":"2024-05-21T14:43:19.617686+0000","last_active":"2024-05-21T14:43:20.797767+0000","last_peered":"2024-05-21T14:43:20.797767+0000","last_clean":"2024-05-21T14:43:20.797767+0000","last_became_active":"2024-05-21T14:43:19.617398+0000","last_became_peered":"2024-05-21T14:43:19.617398+0000","last_unstale":"2024-05-21T14:43:20.797767+0000","last_undegraded":"2024-05-21T14:43:20.797767+0000","last_fullsized":"2024-05-21T14:43:20.797767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:21:06.527871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798047+0000","last_change":"2024-05-21T14:43:19.601673+0000","last_active":"2024-05-21T14:43:20.798047+0000","last_peered":"2024-05-21T14:43:20.798047+0000","last_clean":"2024-05-21T14:43:20.798047+0000","last_became_active":"2024-05-21T14:43:19.601286+0000","last_became_peered":"2024-05-21T14:43:19.601286+0000","last_unstale":"2024-05-21T14:43:20.798047+0000","last_undegraded":"2024-05-21T14:43:20.798047+0000","last_fullsized":"2024-05-21T14:43:20.798047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:21:22.955055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.769432+0000","last_change":"2024-05-21T14:43:18.613555+0000","last_active":"2024-05-21T14:43:47.769432+0000","last_peered":"2024-05-21T14:43:47.769432+0000","last_clean":"2024-05-21T14:43:47.769432+0000","last_became_active":"2024-05-21T14:43:18.613117+0000","last_became_peered":"2024-05-21T14:43:18.613117+0000","last_unstale":"2024-05-21T14:43:47.769432+0000","last_undegraded":"2024-05-21T14:43:47.769432+0000","last_fullsized":"2024-05-21T14:43:47.769432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:38.151165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578450+0000","last_change":"2024-05-21T14:43:19.596736+0000","last_active":"2024-05-21T14:43:20.578450+0000","last_peered":"2024-05-21T14:43:20.578450+0000","last_clean":"2024-05-21T14:43:20.578450+0000","last_became_active":"2024-05-21T14:43:19.596157+0000","last_became_peered":"2024-05-21T14:43:19.596157+0000","last_unstale":"2024-05-21T14:43:20.578450+0000","last_undegraded":"2024-05-21T14:43:20.578450+0000","last_fullsized":"2024-05-21T14:43:20.578450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:22:14.002930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'12","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.770421+0000","last_change":"2024-05-21T14:43:18.614044+0000","last_active":"2024-05-21T14:43:47.770421+0000","last_peered":"2024-05-21T14:43:47.770421+0000","last_clean":"2024-05-21T14:43:47.770421+0000","last_became_active":"2024-05-21T14:43:18.613730+0000","last_became_peered":"2024-05-21T14:43:18.613730+0000","last_unstale":"2024-05-21T14:43:47.770421+0000","last_undegraded":"2024-05-21T14:43:47.770421+0000","last_fullsized":"2024-05-21T14:43:47.770421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:41:34.787779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067780+0000","last_change":"2024-05-21T14:43:19.621999+0000","last_active":"2024-05-21T14:43:21.067780+0000","last_peered":"2024-05-21T14:43:21.067780+0000","last_clean":"2024-05-21T14:43:21.067780+0000","last_became_active":"2024-05-21T14:43:19.614744+0000","last_became_peered":"2024-05-21T14:43:19.614744+0000","last_unstale":"2024-05-21T14:43:21.067780+0000","last_undegraded":"2024-05-21T14:43:21.067780+0000","last_fullsized":"2024-05-21T14:43:21.067780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:32:37.316833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.592331+0000","last_change":"2024-05-21T14:43:18.614193+0000","last_active":"2024-05-21T14:43:24.592331+0000","last_peered":"2024-05-21T14:43:24.592331+0000","last_clean":"2024-05-21T14:43:24.592331+0000","last_became_active":"2024-05-21T14:43:18.609797+0000","last_became_peered":"2024-05-21T14:43:18.609797+0000","last_unstale":"2024-05-21T14:43:24.592331+0000","last_undegraded":"2024-05-21T14:43:24.592331+0000","last_fullsized":"2024-05-21T14:43:24.592331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:39:55.623816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067766+0000","last_change":"2024-05-21T14:43:19.610578+0000","last_active":"2024-05-21T14:43:21.067766+0000","last_peered":"2024-05-21T14:43:21.067766+0000","last_clean":"2024-05-21T14:43:21.067766+0000","last_became_active":"2024-05-21T14:43:19.606575+0000","last_became_peered":"2024-05-21T14:43:19.606575+0000","last_unstale":"2024-05-21T14:43:21.067766+0000","last_undegraded":"2024-05-21T14:43:21.067766+0000","last_fullsized":"2024-05-21T14:43:21.067766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:50:06.088520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'13","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.769562+0000","last_change":"2024-05-21T14:43:18.601862+0000","last_active":"2024-05-21T14:43:47.769562+0000","last_peered":"2024-05-21T14:43:47.769562+0000","last_clean":"2024-05-21T14:43:47.769562+0000","last_became_active":"2024-05-21T14:43:18.601311+0000","last_became_peered":"2024-05-21T14:43:18.601311+0000","last_unstale":"2024-05-21T14:43:47.769562+0000","last_undegraded":"2024-05-21T14:43:47.769562+0000","last_fullsized":"2024-05-21T14:43:47.769562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:02.736061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8034,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":16068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":83615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":672429,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509452,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":84685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":83957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":82915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":673017,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":83777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":82289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T14:44:01.246 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T14:44:01.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.420+0000 7fa472400640 1 Processor -- start 2024-05-21T14:44:01.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.420+0000 7fa472400640 1 -- start start 2024-05-21T14:44:01.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.420+0000 7fa472400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa46c1536f0 0x7fa46c15cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:01.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.420+0000 7fa472400640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa46c0c4f60 con 0x7fa46c0c7b00 2024-05-21T14:44:01.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.420+0000 7fa472400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa46c0c5200 con 0x7fa46c0c76f0 2024-05-21T14:44:01.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.420+0000 7fa472400640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fa46c06d270 con 0x7fa46c1536f0 2024-05-21T14:44:01.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.420+0000 7fa46b400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa46c1536f0 0x7fa46c15cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:01.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.420+0000 7fa46be00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa46c0c7b00 0x7fa46c163e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37092/0 (socket says 172.21.15.78:37092) 2024-05-21T14:44:01.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.420+0000 7fa46be00640 1 -- 172.21.15.78:0/366188677 learned_addr learned my addr 172.21.15.78:0/366188677 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:44:01.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.420+0000 7fa46b400640 1 -- 172.21.15.78:0/366188677 >> v1:172.21.15.84:6789/0 conn(0x7fa46c0c76f0 legacy=0x7fa46c0c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:01.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.420+0000 7fa46b400640 1 -- 172.21.15.78:0/366188677 >> v1:172.21.15.78:6789/0 conn(0x7fa46c0c7b00 legacy=0x7fa46c163e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:01.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.420+0000 7fa46b400640 1 -- 172.21.15.78:0/366188677 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c0c54e0 con 0x7fa46c1536f0 2024-05-21T14:44:01.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.424+0000 7fa46b400640 1 --2- 172.21.15.78:0/366188677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c1536f0 0x7fa46c15cad0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009d90 tx=0x7fa45c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4039f088372fa6 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:01.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.424+0000 7fa46a000640 1 -- 172.21.15.78:0/366188677 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c0b2070 con 0x7fa46c1536f0 2024-05-21T14:44:01.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.424+0000 7fa46a000640 1 -- 172.21.15.78:0/366188677 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa45c0a5920 con 0x7fa46c1536f0 2024-05-21T14:44:01.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.424+0000 7fa46a000640 1 -- 172.21.15.78:0/366188677 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c0a5cf0 con 0x7fa46c1536f0 2024-05-21T14:44:01.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.424+0000 7fa472400640 1 -- 172.21.15.78:0/366188677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c1536f0 msgr2=0x7fa46c15cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:01.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.424+0000 7fa472400640 1 --2- 172.21.15.78:0/366188677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c1536f0 0x7fa46c15cad0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009d90 tx=0x7fa45c01c970 comp rx=0 tx=0).stop 2024-05-21T14:44:01.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.424+0000 7fa472400640 1 -- 172.21.15.78:0/366188677 shutdown_connections 2024-05-21T14:44:01.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.424+0000 7fa472400640 1 --2- 172.21.15.78:0/366188677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c1536f0 0x7fa46c15cad0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.424+0000 7fa472400640 1 -- 172.21.15.78:0/366188677 >> 172.21.15.78:0/366188677 conn(0x7fa46c0cacb0 msgr2=0x7fa46c0cd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:01.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.424+0000 7fa472400640 1 -- 172.21.15.78:0/366188677 shutdown_connections 2024-05-21T14:44:01.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.424+0000 7fa472400640 1 -- 172.21.15.78:0/366188677 wait complete. 2024-05-21T14:44:01.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.428+0000 7fa472400640 1 Processor -- start 2024-05-21T14:44:01.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.428+0000 7fa472400640 1 -- start start 2024-05-21T14:44:01.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.428+0000 7fa472400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa46c0c76f0 0x7fa46c1f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:01.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.428+0000 7fa472400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c0c7b00 0x7fa46c1447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:01.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.428+0000 7fa472400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa46c1536f0 0x7fa46c144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:01.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.428+0000 7fa472400640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c06d700 con 0x7fa46c0c7b00 2024-05-21T14:44:01.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.428+0000 7fa472400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c15d010 con 0x7fa46c0c76f0 2024-05-21T14:44:01.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.428+0000 7fa472400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa46c1f4c90 con 0x7fa46c1536f0 2024-05-21T14:44:01.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.428+0000 7fa46aa00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c0c7b00 0x7fa46c1447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:01.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.428+0000 7fa46aa00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c0c7b00 0x7fa46c1447c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35546/0 (socket says 172.21.15.78:35546) 2024-05-21T14:44:01.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.428+0000 7fa46aa00640 1 -- 172.21.15.78:0/3629856054 learned_addr learned my addr 172.21.15.78:0/3629856054 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:44:01.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.428+0000 7fa46b400640 1 --2- 172.21.15.78:0/3629856054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa46c0c76f0 0x7fa46c1f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:01.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.428+0000 7fa46be00640 1 --2- 172.21.15.78:0/3629856054 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa46c1536f0 0x7fa46c144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:01.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.432+0000 7fa46aa00640 1 -- 172.21.15.78:0/3629856054 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa46c1536f0 msgr2=0x7fa46c144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:01.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.432+0000 7fa46aa00640 1 --2- 172.21.15.78:0/3629856054 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa46c1536f0 0x7fa46c144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.432+0000 7fa46aa00640 1 -- 172.21.15.78:0/3629856054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa46c0c76f0 msgr2=0x7fa46c1f4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:01.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.432+0000 7fa46aa00640 1 --2- 172.21.15.78:0/3629856054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa46c0c76f0 0x7fa46c1f4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.432+0000 7fa46aa00640 1 -- 172.21.15.78:0/3629856054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c1f47c0 con 0x7fa46c0c7b00 2024-05-21T14:44:01.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.432+0000 7fa46b400640 1 --2- 172.21.15.78:0/3629856054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa46c0c76f0 0x7fa46c1f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:44:01.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.432+0000 7fa46aa00640 1 --2- 172.21.15.78:0/3629856054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c0c7b00 0x7fa46c1447c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa45800c370 tx=0x7fa45800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:01.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.432+0000 7fa463400640 1 -- 172.21.15.78:0/3629856054 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4580052d0 con 0x7fa46c0c7b00 2024-05-21T14:44:01.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.432+0000 7fa463400640 1 -- 172.21.15.78:0/3629856054 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa458005470 con 0x7fa46c0c7b00 2024-05-21T14:44:01.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.432+0000 7fa472400640 1 -- 172.21.15.78:0/3629856054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46c14cbc0 con 0x7fa46c0c7b00 2024-05-21T14:44:01.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.432+0000 7fa463400640 1 -- 172.21.15.78:0/3629856054 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458007260 con 0x7fa46c0c7b00 2024-05-21T14:44:01.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.432+0000 7fa472400640 1 -- 172.21.15.78:0/3629856054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46c1552a0 con 0x7fa46c0c7b00 2024-05-21T14:44:01.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.432+0000 7fa472400640 1 -- 172.21.15.78:0/3629856054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa46c04f730 con 0x7fa46c0c7b00 2024-05-21T14:44:01.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.432+0000 7fa463400640 1 -- 172.21.15.78:0/3629856054 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa458007400 con 0x7fa46c0c7b00 2024-05-21T14:44:01.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.432+0000 7fa463400640 1 --2- 172.21.15.78:0/3629856054 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa44c0678c0 0x7fa44c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:01.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.432+0000 7fa463400640 1 -- 172.21.15.78:0/3629856054 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fa4580850d0 con 0x7fa46c0c7b00 2024-05-21T14:44:01.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.436+0000 7fa46b400640 1 --2- 172.21.15.78:0/3629856054 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa44c0678c0 0x7fa44c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:01.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.436+0000 7fa46b400640 1 --2- 172.21.15.78:0/3629856054 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa44c0678c0 0x7fa44c069dd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa45c0af000 tx=0x7fa45c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:01.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.436+0000 7fa463400640 1 -- 172.21.15.78:0/3629856054 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa458055be0 con 0x7fa46c0c7b00 2024-05-21T14:44:01.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.592+0000 7fa472400640 1 -- 172.21.15.78:0/3629856054 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa46c0c47b0 con 0x7fa44c0678c0 2024-05-21T14:44:01.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.608+0000 7fa463400640 1 -- 172.21.15.78:0/3629856054 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252019 (secure 0 0 0) 0x7fa46c0c47b0 con 0x7fa44c0678c0 2024-05-21T14:44:01.621 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:44:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-05-21T14:44:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.612+0000 7fa472400640 1 -- 172.21.15.78:0/3629856054 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa44c0678c0 msgr2=0x7fa44c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:01.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.612+0000 7fa472400640 1 --2- 172.21.15.78:0/3629856054 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa44c0678c0 0x7fa44c069dd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa45c0af000 tx=0x7fa45c0a7070 comp rx=0 tx=0).stop 2024-05-21T14:44:01.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.612+0000 7fa472400640 1 -- 172.21.15.78:0/3629856054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c0c7b00 msgr2=0x7fa46c1447c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:01.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.612+0000 7fa472400640 1 --2- 172.21.15.78:0/3629856054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c0c7b00 0x7fa46c1447c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa45800c370 tx=0x7fa45800c830 comp rx=0 tx=0).stop 2024-05-21T14:44:01.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.612+0000 7fa472400640 1 -- 172.21.15.78:0/3629856054 shutdown_connections 2024-05-21T14:44:01.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.612+0000 7fa472400640 1 --2- 172.21.15.78:0/3629856054 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa44c0678c0 0x7fa44c069dd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.612+0000 7fa472400640 1 --2- 172.21.15.78:0/3629856054 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa46c1536f0 0x7fa46c144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.612+0000 7fa472400640 1 --2- 172.21.15.78:0/3629856054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c0c7b00 0x7fa46c1447c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.612+0000 7fa472400640 1 --2- 172.21.15.78:0/3629856054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa46c0c76f0 0x7fa46c1f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.612+0000 7fa472400640 1 -- 172.21.15.78:0/3629856054 >> 172.21.15.78:0/3629856054 conn(0x7fa46c0cacb0 msgr2=0x7fa46c0cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:01.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.612+0000 7fa472400640 1 -- 172.21.15.78:0/3629856054 shutdown_connections 2024-05-21T14:44:01.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.612+0000 7fa472400640 1 -- 172.21.15.78:0/3629856054 wait complete. 2024-05-21T14:44:01.642 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-05-21T14:44:00.502922+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598402,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":364,"num_write_kb":2478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218336,"kb_used_data":2208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756384,"statfs":{"total":773094113280,"available":772870537216,"internally_reserved":0,"allocated":2260992,"data_stored":1846684,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003457"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067056+0000","last_change":"2024-05-21T14:43:19.606707+0000","last_active":"2024-05-21T14:43:21.067056+0000","last_peered":"2024-05-21T14:43:21.067056+0000","last_clean":"2024-05-21T14:43:21.067056+0000","last_became_active":"2024-05-21T14:43:19.606365+0000","last_became_peered":"2024-05-21T14:43:19.606365+0000","last_unstale":"2024-05-21T14:43:21.067056+0000","last_undegraded":"2024-05-21T14:43:21.067056+0000","last_fullsized":"2024-05-21T14:43:21.067056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:26.135357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067577+0000","last_change":"2024-05-21T14:43:19.632879+0000","last_active":"2024-05-21T14:43:21.067577+0000","last_peered":"2024-05-21T14:43:21.067577+0000","last_clean":"2024-05-21T14:43:21.067577+0000","last_became_active":"2024-05-21T14:43:19.632218+0000","last_became_peered":"2024-05-21T14:43:19.632218+0000","last_unstale":"2024-05-21T14:43:21.067577+0000","last_undegraded":"2024-05-21T14:43:21.067577+0000","last_fullsized":"2024-05-21T14:43:21.067577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:35:49.461861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066825+0000","last_change":"2024-05-21T14:43:19.620214+0000","last_active":"2024-05-21T14:43:21.066825+0000","last_peered":"2024-05-21T14:43:21.066825+0000","last_clean":"2024-05-21T14:43:21.066825+0000","last_became_active":"2024-05-21T14:43:19.619012+0000","last_became_peered":"2024-05-21T14:43:19.619012+0000","last_unstale":"2024-05-21T14:43:21.066825+0000","last_undegraded":"2024-05-21T14:43:21.066825+0000","last_fullsized":"2024-05-21T14:43:21.066825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:40:22.415178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066035+0000","last_change":"2024-05-21T14:43:19.602199+0000","last_active":"2024-05-21T14:43:21.066035+0000","last_peered":"2024-05-21T14:43:21.066035+0000","last_clean":"2024-05-21T14:43:21.066035+0000","last_became_active":"2024-05-21T14:43:19.601797+0000","last_became_peered":"2024-05-21T14:43:19.601797+0000","last_unstale":"2024-05-21T14:43:21.066035+0000","last_undegraded":"2024-05-21T14:43:21.066035+0000","last_fullsized":"2024-05-21T14:43:21.066035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:33:00.071681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066510+0000","last_change":"2024-05-21T14:43:19.623449+0000","last_active":"2024-05-21T14:43:21.066510+0000","last_peered":"2024-05-21T14:43:21.066510+0000","last_clean":"2024-05-21T14:43:21.066510+0000","last_became_active":"2024-05-21T14:43:19.623125+0000","last_became_peered":"2024-05-21T14:43:19.623125+0000","last_unstale":"2024-05-21T14:43:21.066510+0000","last_undegraded":"2024-05-21T14:43:21.066510+0000","last_fullsized":"2024-05-21T14:43:21.066510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:42.178156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.065985+0000","last_change":"2024-05-21T14:43:19.591222+0000","last_active":"2024-05-21T14:43:21.065985+0000","last_peered":"2024-05-21T14:43:21.065985+0000","last_clean":"2024-05-21T14:43:21.065985+0000","last_became_active":"2024-05-21T14:43:19.590858+0000","last_became_peered":"2024-05-21T14:43:19.590858+0000","last_unstale":"2024-05-21T14:43:21.065985+0000","last_undegraded":"2024-05-21T14:43:21.065985+0000","last_fullsized":"2024-05-21T14:43:21.065985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:21:15.737192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066173+0000","last_change":"2024-05-21T14:43:19.614716+0000","last_active":"2024-05-21T14:43:21.066173+0000","last_peered":"2024-05-21T14:43:21.066173+0000","last_clean":"2024-05-21T14:43:21.066173+0000","last_became_active":"2024-05-21T14:43:19.614451+0000","last_became_peered":"2024-05-21T14:43:19.614451+0000","last_unstale":"2024-05-21T14:43:21.066173+0000","last_undegraded":"2024-05-21T14:43:21.066173+0000","last_fullsized":"2024-05-21T14:43:21.066173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:07:01.524574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066544+0000","last_change":"2024-05-21T14:43:19.604029+0000","last_active":"2024-05-21T14:43:21.066544+0000","last_peered":"2024-05-21T14:43:21.066544+0000","last_clean":"2024-05-21T14:43:21.066544+0000","last_became_active":"2024-05-21T14:43:19.603164+0000","last_became_peered":"2024-05-21T14:43:19.603164+0000","last_unstale":"2024-05-21T14:43:21.066544+0000","last_undegraded":"2024-05-21T14:43:21.066544+0000","last_fullsized":"2024-05-21T14:43:21.066544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:14:27.286952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578218+0000","last_change":"2024-05-21T14:43:19.613765+0000","last_active":"2024-05-21T14:43:20.578218+0000","last_peered":"2024-05-21T14:43:20.578218+0000","last_clean":"2024-05-21T14:43:20.578218+0000","last_became_active":"2024-05-21T14:43:19.613429+0000","last_became_peered":"2024-05-21T14:43:19.613429+0000","last_unstale":"2024-05-21T14:43:20.578218+0000","last_undegraded":"2024-05-21T14:43:20.578218+0000","last_fullsized":"2024-05-21T14:43:20.578218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:29:16.905434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066956+0000","last_change":"2024-05-21T14:43:19.607400+0000","last_active":"2024-05-21T14:43:21.066956+0000","last_peered":"2024-05-21T14:43:21.066956+0000","last_clean":"2024-05-21T14:43:21.066956+0000","last_became_active":"2024-05-21T14:43:19.607105+0000","last_became_peered":"2024-05-21T14:43:19.607105+0000","last_unstale":"2024-05-21T14:43:21.066956+0000","last_undegraded":"2024-05-21T14:43:21.066956+0000","last_fullsized":"2024-05-21T14:43:21.066956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:26:22.366105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066810+0000","last_change":"2024-05-21T14:43:19.606534+0000","last_active":"2024-05-21T14:43:21.066810+0000","last_peered":"2024-05-21T14:43:21.066810+0000","last_clean":"2024-05-21T14:43:21.066810+0000","last_became_active":"2024-05-21T14:43:19.606029+0000","last_became_peered":"2024-05-21T14:43:19.606029+0000","last_unstale":"2024-05-21T14:43:21.066810+0000","last_undegraded":"2024-05-21T14:43:21.066810+0000","last_fullsized":"2024-05-21T14:43:21.066810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:33:48.849701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066546+0000","last_change":"2024-05-21T14:43:19.609910+0000","last_active":"2024-05-21T14:43:21.066546+0000","last_peered":"2024-05-21T14:43:21.066546+0000","last_clean":"2024-05-21T14:43:21.066546+0000","last_became_active":"2024-05-21T14:43:19.609616+0000","last_became_peered":"2024-05-21T14:43:19.609616+0000","last_unstale":"2024-05-21T14:43:21.066546+0000","last_undegraded":"2024-05-21T14:43:21.066546+0000","last_fullsized":"2024-05-21T14:43:21.066546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:36:16.637620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581855+0000","last_change":"2024-05-21T14:43:19.604001+0000","last_active":"2024-05-21T14:43:20.581855+0000","last_peered":"2024-05-21T14:43:20.581855+0000","last_clean":"2024-05-21T14:43:20.581855+0000","last_became_active":"2024-05-21T14:43:19.596859+0000","last_became_peered":"2024-05-21T14:43:19.596859+0000","last_unstale":"2024-05-21T14:43:20.581855+0000","last_undegraded":"2024-05-21T14:43:20.581855+0000","last_fullsized":"2024-05-21T14:43:20.581855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:45:43.431420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580379+0000","last_change":"2024-05-21T14:43:19.626837+0000","last_active":"2024-05-21T14:43:20.580379+0000","last_peered":"2024-05-21T14:43:20.580379+0000","last_clean":"2024-05-21T14:43:20.580379+0000","last_became_active":"2024-05-21T14:43:19.626213+0000","last_became_peered":"2024-05-21T14:43:19.626213+0000","last_unstale":"2024-05-21T14:43:20.580379+0000","last_undegraded":"2024-05-21T14:43:20.580379+0000","last_fullsized":"2024-05-21T14:43:20.580379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:51.705474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066538+0000","last_change":"2024-05-21T14:43:19.613483+0000","last_active":"2024-05-21T14:43:21.066538+0000","last_peered":"2024-05-21T14:43:21.066538+0000","last_clean":"2024-05-21T14:43:21.066538+0000","last_became_active":"2024-05-21T14:43:19.612581+0000","last_became_peered":"2024-05-21T14:43:19.612581+0000","last_unstale":"2024-05-21T14:43:21.066538+0000","last_undegraded":"2024-05-21T14:43:21.066538+0000","last_fullsized":"2024-05-21T14:43:21.066538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:41:15.797196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797569+0000","last_change":"2024-05-21T14:43:19.609126+0000","last_active":"2024-05-21T14:43:20.797569+0000","last_peered":"2024-05-21T14:43:20.797569+0000","last_clean":"2024-05-21T14:43:20.797569+0000","last_became_active":"2024-05-21T14:43:19.607967+0000","last_became_peered":"2024-05-21T14:43:19.607967+0000","last_unstale":"2024-05-21T14:43:20.797569+0000","last_undegraded":"2024-05-21T14:43:20.797569+0000","last_fullsized":"2024-05-21T14:43:20.797569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:35.881039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798283+0000","last_change":"2024-05-21T14:43:19.613487+0000","last_active":"2024-05-21T14:43:20.798283+0000","last_peered":"2024-05-21T14:43:20.798283+0000","last_clean":"2024-05-21T14:43:20.798283+0000","last_became_active":"2024-05-21T14:43:19.611280+0000","last_became_peered":"2024-05-21T14:43:19.611280+0000","last_unstale":"2024-05-21T14:43:20.798283+0000","last_undegraded":"2024-05-21T14:43:20.798283+0000","last_fullsized":"2024-05-21T14:43:20.798283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:51:21.887715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.807337+0000","last_change":"2024-05-21T14:43:19.607601+0000","last_active":"2024-05-21T14:43:58.807337+0000","last_peered":"2024-05-21T14:43:58.807337+0000","last_clean":"2024-05-21T14:43:58.807337+0000","last_became_active":"2024-05-21T14:43:19.606719+0000","last_became_peered":"2024-05-21T14:43:19.606719+0000","last_unstale":"2024-05-21T14:43:58.807337+0000","last_undegraded":"2024-05-21T14:43:58.807337+0000","last_fullsized":"2024-05-21T14:43:58.807337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:04:32.310805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798234+0000","last_change":"2024-05-21T14:43:19.618470+0000","last_active":"2024-05-21T14:43:20.798234+0000","last_peered":"2024-05-21T14:43:20.798234+0000","last_clean":"2024-05-21T14:43:20.798234+0000","last_became_active":"2024-05-21T14:43:19.617408+0000","last_became_peered":"2024-05-21T14:43:19.617408+0000","last_unstale":"2024-05-21T14:43:20.798234+0000","last_undegraded":"2024-05-21T14:43:20.798234+0000","last_fullsized":"2024-05-21T14:43:20.798234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:53:58.877306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066709+0000","last_change":"2024-05-21T14:43:19.609835+0000","last_active":"2024-05-21T14:43:21.066709+0000","last_peered":"2024-05-21T14:43:21.066709+0000","last_clean":"2024-05-21T14:43:21.066709+0000","last_became_active":"2024-05-21T14:43:19.609525+0000","last_became_peered":"2024-05-21T14:43:19.609525+0000","last_unstale":"2024-05-21T14:43:21.066709+0000","last_undegraded":"2024-05-21T14:43:21.066709+0000","last_fullsized":"2024-05-21T14:43:21.066709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:57:04.748898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963454+0000","last_change":"2024-05-21T14:43:19.607732+0000","last_active":"2024-05-21T14:43:20.963454+0000","last_peered":"2024-05-21T14:43:20.963454+0000","last_clean":"2024-05-21T14:43:20.963454+0000","last_became_active":"2024-05-21T14:43:19.606839+0000","last_became_peered":"2024-05-21T14:43:19.606839+0000","last_unstale":"2024-05-21T14:43:20.963454+0000","last_undegraded":"2024-05-21T14:43:20.963454+0000","last_fullsized":"2024-05-21T14:43:20.963454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:43:15.675663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578145+0000","last_change":"2024-05-21T14:43:19.601108+0000","last_active":"2024-05-21T14:43:20.578145+0000","last_peered":"2024-05-21T14:43:20.578145+0000","last_clean":"2024-05-21T14:43:20.578145+0000","last_became_active":"2024-05-21T14:43:19.600780+0000","last_became_peered":"2024-05-21T14:43:19.600780+0000","last_unstale":"2024-05-21T14:43:20.578145+0000","last_undegraded":"2024-05-21T14:43:20.578145+0000","last_fullsized":"2024-05-21T14:43:20.578145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:47:19.062733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067184+0000","last_change":"2024-05-21T14:43:19.620463+0000","last_active":"2024-05-21T14:43:21.067184+0000","last_peered":"2024-05-21T14:43:21.067184+0000","last_clean":"2024-05-21T14:43:21.067184+0000","last_became_active":"2024-05-21T14:43:19.614489+0000","last_became_peered":"2024-05-21T14:43:19.614489+0000","last_unstale":"2024-05-21T14:43:21.067184+0000","last_undegraded":"2024-05-21T14:43:21.067184+0000","last_fullsized":"2024-05-21T14:43:21.067184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:51:07.953352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797590+0000","last_change":"2024-05-21T14:43:19.624683+0000","last_active":"2024-05-21T14:43:20.797590+0000","last_peered":"2024-05-21T14:43:20.797590+0000","last_clean":"2024-05-21T14:43:20.797590+0000","last_became_active":"2024-05-21T14:43:19.624304+0000","last_became_peered":"2024-05-21T14:43:19.624304+0000","last_unstale":"2024-05-21T14:43:20.797590+0000","last_undegraded":"2024-05-21T14:43:20.797590+0000","last_fullsized":"2024-05-21T14:43:20.797590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:53.874968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067763+0000","last_change":"2024-05-21T14:43:19.621030+0000","last_active":"2024-05-21T14:43:21.067763+0000","last_peered":"2024-05-21T14:43:21.067763+0000","last_clean":"2024-05-21T14:43:21.067763+0000","last_became_active":"2024-05-21T14:43:19.619072+0000","last_became_peered":"2024-05-21T14:43:19.619072+0000","last_unstale":"2024-05-21T14:43:21.067763+0000","last_undegraded":"2024-05-21T14:43:21.067763+0000","last_fullsized":"2024-05-21T14:43:21.067763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:22:09.423661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066417+0000","last_change":"2024-05-21T14:43:19.602880+0000","last_active":"2024-05-21T14:43:21.066417+0000","last_peered":"2024-05-21T14:43:21.066417+0000","last_clean":"2024-05-21T14:43:21.066417+0000","last_became_active":"2024-05-21T14:43:19.602577+0000","last_became_peered":"2024-05-21T14:43:19.602577+0000","last_unstale":"2024-05-21T14:43:21.066417+0000","last_undegraded":"2024-05-21T14:43:21.066417+0000","last_fullsized":"2024-05-21T14:43:21.066417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:04:10.094373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582914+0000","last_change":"2024-05-21T14:43:19.632328+0000","last_active":"2024-05-21T14:43:20.582914+0000","last_peered":"2024-05-21T14:43:20.582914+0000","last_clean":"2024-05-21T14:43:20.582914+0000","last_became_active":"2024-05-21T14:43:19.631351+0000","last_became_peered":"2024-05-21T14:43:19.631351+0000","last_unstale":"2024-05-21T14:43:20.582914+0000","last_undegraded":"2024-05-21T14:43:20.582914+0000","last_fullsized":"2024-05-21T14:43:20.582914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:36:18.467070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582481+0000","last_change":"2024-05-21T14:43:19.632282+0000","last_active":"2024-05-21T14:43:20.582481+0000","last_peered":"2024-05-21T14:43:20.582481+0000","last_clean":"2024-05-21T14:43:20.582481+0000","last_became_active":"2024-05-21T14:43:19.631522+0000","last_became_peered":"2024-05-21T14:43:19.631522+0000","last_unstale":"2024-05-21T14:43:20.582481+0000","last_undegraded":"2024-05-21T14:43:20.582481+0000","last_fullsized":"2024-05-21T14:43:20.582481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:23:32.646087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067227+0000","last_change":"2024-05-21T14:43:19.620046+0000","last_active":"2024-05-21T14:43:21.067227+0000","last_peered":"2024-05-21T14:43:21.067227+0000","last_clean":"2024-05-21T14:43:21.067227+0000","last_became_active":"2024-05-21T14:43:19.612428+0000","last_became_peered":"2024-05-21T14:43:19.612428+0000","last_unstale":"2024-05-21T14:43:21.067227+0000","last_undegraded":"2024-05-21T14:43:21.067227+0000","last_fullsized":"2024-05-21T14:43:21.067227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:08:33.785399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797667+0000","last_change":"2024-05-21T14:43:19.618198+0000","last_active":"2024-05-21T14:43:20.797667+0000","last_peered":"2024-05-21T14:43:20.797667+0000","last_clean":"2024-05-21T14:43:20.797667+0000","last_became_active":"2024-05-21T14:43:19.617903+0000","last_became_peered":"2024-05-21T14:43:19.617903+0000","last_unstale":"2024-05-21T14:43:20.797667+0000","last_undegraded":"2024-05-21T14:43:20.797667+0000","last_fullsized":"2024-05-21T14:43:20.797667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:59.606862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.805397+0000","last_change":"2024-05-21T14:43:19.613942+0000","last_active":"2024-05-21T14:43:58.805397+0000","last_peered":"2024-05-21T14:43:58.805397+0000","last_clean":"2024-05-21T14:43:58.805397+0000","last_became_active":"2024-05-21T14:43:19.613035+0000","last_became_peered":"2024-05-21T14:43:19.613035+0000","last_unstale":"2024-05-21T14:43:58.805397+0000","last_undegraded":"2024-05-21T14:43:58.805397+0000","last_fullsized":"2024-05-21T14:43:58.805397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:47:46.462547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.065907+0000","last_change":"2024-05-21T14:43:19.626414+0000","last_active":"2024-05-21T14:43:21.065907+0000","last_peered":"2024-05-21T14:43:21.065907+0000","last_clean":"2024-05-21T14:43:21.065907+0000","last_became_active":"2024-05-21T14:43:19.626080+0000","last_became_peered":"2024-05-21T14:43:19.626080+0000","last_unstale":"2024-05-21T14:43:21.065907+0000","last_undegraded":"2024-05-21T14:43:21.065907+0000","last_fullsized":"2024-05-21T14:43:21.065907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:37:38.449284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578382+0000","last_change":"2024-05-21T14:43:19.620806+0000","last_active":"2024-05-21T14:43:20.578382+0000","last_peered":"2024-05-21T14:43:20.578382+0000","last_clean":"2024-05-21T14:43:20.578382+0000","last_became_active":"2024-05-21T14:43:19.620449+0000","last_became_peered":"2024-05-21T14:43:19.620449+0000","last_unstale":"2024-05-21T14:43:20.578382+0000","last_undegraded":"2024-05-21T14:43:20.578382+0000","last_fullsized":"2024-05-21T14:43:20.578382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:43:52.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:29.674250+0000","last_change":"2024-05-21T14:43:18.603028+0000","last_active":"2024-05-21T14:43:29.674250+0000","last_peered":"2024-05-21T14:43:29.674250+0000","last_clean":"2024-05-21T14:43:29.674250+0000","last_became_active":"2024-05-21T14:43:18.602036+0000","last_became_peered":"2024-05-21T14:43:18.602036+0000","last_unstale":"2024-05-21T14:43:29.674250+0000","last_undegraded":"2024-05-21T14:43:29.674250+0000","last_fullsized":"2024-05-21T14:43:29.674250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:15:25.384197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963922+0000","last_change":"2024-05-21T14:43:19.599725+0000","last_active":"2024-05-21T14:43:20.963922+0000","last_peered":"2024-05-21T14:43:20.963922+0000","last_clean":"2024-05-21T14:43:20.963922+0000","last_became_active":"2024-05-21T14:43:19.598972+0000","last_became_peered":"2024-05-21T14:43:19.598972+0000","last_unstale":"2024-05-21T14:43:20.963922+0000","last_undegraded":"2024-05-21T14:43:20.963922+0000","last_fullsized":"2024-05-21T14:43:20.963922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:54:00.871046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'7","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.746826+0000","last_change":"2024-05-21T14:43:18.615934+0000","last_active":"2024-05-21T14:43:41.746826+0000","last_peered":"2024-05-21T14:43:41.746826+0000","last_clean":"2024-05-21T14:43:41.746826+0000","last_became_active":"2024-05-21T14:43:18.615568+0000","last_became_peered":"2024-05-21T14:43:18.615568+0000","last_unstale":"2024-05-21T14:43:41.746826+0000","last_undegraded":"2024-05-21T14:43:41.746826+0000","last_fullsized":"2024-05-21T14:43:41.746826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:28:54.494319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:35.724343+0000","last_change":"2024-05-21T14:43:18.615154+0000","last_active":"2024-05-21T14:43:35.724343+0000","last_peered":"2024-05-21T14:43:35.724343+0000","last_clean":"2024-05-21T14:43:35.724343+0000","last_became_active":"2024-05-21T14:43:18.613838+0000","last_became_peered":"2024-05-21T14:43:18.613838+0000","last_unstale":"2024-05-21T14:43:35.724343+0000","last_undegraded":"2024-05-21T14:43:35.724343+0000","last_fullsized":"2024-05-21T14:43:35.724343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:32:09.174124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067194+0000","last_change":"2024-05-21T14:43:19.633585+0000","last_active":"2024-05-21T14:43:21.067194+0000","last_peered":"2024-05-21T14:43:21.067194+0000","last_clean":"2024-05-21T14:43:21.067194+0000","last_became_active":"2024-05-21T14:43:19.632476+0000","last_became_peered":"2024-05-21T14:43:19.632476+0000","last_unstale":"2024-05-21T14:43:21.067194+0000","last_undegraded":"2024-05-21T14:43:21.067194+0000","last_fullsized":"2024-05-21T14:43:21.067194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:53.023931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.745819+0000","last_change":"2024-05-21T14:43:18.585548+0000","last_active":"2024-05-21T14:43:41.745819+0000","last_peered":"2024-05-21T14:43:41.745819+0000","last_clean":"2024-05-21T14:43:41.745819+0000","last_became_active":"2024-05-21T14:43:18.585099+0000","last_became_peered":"2024-05-21T14:43:18.585099+0000","last_unstale":"2024-05-21T14:43:41.745819+0000","last_undegraded":"2024-05-21T14:43:41.745819+0000","last_fullsized":"2024-05-21T14:43:41.745819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:20:16.856225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963459+0000","last_change":"2024-05-21T14:43:19.614884+0000","last_active":"2024-05-21T14:43:20.963459+0000","last_peered":"2024-05-21T14:43:20.963459+0000","last_clean":"2024-05-21T14:43:20.963459+0000","last_became_active":"2024-05-21T14:43:19.614064+0000","last_became_peered":"2024-05-21T14:43:19.614064+0000","last_unstale":"2024-05-21T14:43:20.963459+0000","last_undegraded":"2024-05-21T14:43:20.963459+0000","last_fullsized":"2024-05-21T14:43:20.963459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:42:17.091043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:29.681041+0000","last_change":"2024-05-21T14:43:18.602794+0000","last_active":"2024-05-21T14:43:29.681041+0000","last_peered":"2024-05-21T14:43:29.681041+0000","last_clean":"2024-05-21T14:43:29.681041+0000","last_became_active":"2024-05-21T14:43:18.602429+0000","last_became_peered":"2024-05-21T14:43:18.602429+0000","last_unstale":"2024-05-21T14:43:29.681041+0000","last_undegraded":"2024-05-21T14:43:29.681041+0000","last_fullsized":"2024-05-21T14:43:29.681041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:50:14.465202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066483+0000","last_change":"2024-05-21T14:43:19.602663+0000","last_active":"2024-05-21T14:43:21.066483+0000","last_peered":"2024-05-21T14:43:21.066483+0000","last_clean":"2024-05-21T14:43:21.066483+0000","last_became_active":"2024-05-21T14:43:19.602294+0000","last_became_peered":"2024-05-21T14:43:19.602294+0000","last_unstale":"2024-05-21T14:43:21.066483+0000","last_undegraded":"2024-05-21T14:43:21.066483+0000","last_fullsized":"2024-05-21T14:43:21.066483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:48:56.271741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.769548+0000","last_change":"2024-05-21T14:43:18.604601+0000","last_active":"2024-05-21T14:43:47.769548+0000","last_peered":"2024-05-21T14:43:47.769548+0000","last_clean":"2024-05-21T14:43:47.769548+0000","last_became_active":"2024-05-21T14:43:18.604262+0000","last_became_peered":"2024-05-21T14:43:18.604262+0000","last_unstale":"2024-05-21T14:43:47.769548+0000","last_undegraded":"2024-05-21T14:43:47.769548+0000","last_fullsized":"2024-05-21T14:43:47.769548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:15.490579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.068019+0000","last_change":"2024-05-21T14:43:19.613952+0000","last_active":"2024-05-21T14:43:21.068019+0000","last_peered":"2024-05-21T14:43:21.068019+0000","last_clean":"2024-05-21T14:43:21.068019+0000","last_became_active":"2024-05-21T14:43:19.613093+0000","last_became_peered":"2024-05-21T14:43:19.613093+0000","last_unstale":"2024-05-21T14:43:21.068019+0000","last_undegraded":"2024-05-21T14:43:21.068019+0000","last_fullsized":"2024-05-21T14:43:21.068019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:03:44.925212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'5","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.806914+0000","last_change":"2024-05-21T14:43:18.602343+0000","last_active":"2024-05-21T14:43:58.806914+0000","last_peered":"2024-05-21T14:43:58.806914+0000","last_clean":"2024-05-21T14:43:58.806914+0000","last_became_active":"2024-05-21T14:43:18.601500+0000","last_became_peered":"2024-05-21T14:43:18.601500+0000","last_unstale":"2024-05-21T14:43:58.806914+0000","last_undegraded":"2024-05-21T14:43:58.806914+0000","last_fullsized":"2024-05-21T14:43:58.806914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:54:21.960430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798025+0000","last_change":"2024-05-21T14:43:19.608580+0000","last_active":"2024-05-21T14:43:20.798025+0000","last_peered":"2024-05-21T14:43:20.798025+0000","last_clean":"2024-05-21T14:43:20.798025+0000","last_became_active":"2024-05-21T14:43:19.608038+0000","last_became_peered":"2024-05-21T14:43:19.608038+0000","last_unstale":"2024-05-21T14:43:20.798025+0000","last_undegraded":"2024-05-21T14:43:20.798025+0000","last_fullsized":"2024-05-21T14:43:20.798025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:19.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'10","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.768673+0000","last_change":"2024-05-21T14:43:18.606824+0000","last_active":"2024-05-21T14:43:47.768673+0000","last_peered":"2024-05-21T14:43:47.768673+0000","last_clean":"2024-05-21T14:43:47.768673+0000","last_became_active":"2024-05-21T14:43:18.606449+0000","last_became_peered":"2024-05-21T14:43:18.606449+0000","last_unstale":"2024-05-21T14:43:47.768673+0000","last_undegraded":"2024-05-21T14:43:47.768673+0000","last_fullsized":"2024-05-21T14:43:47.768673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:43:41.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066889+0000","last_change":"2024-05-21T14:43:19.634014+0000","last_active":"2024-05-21T14:43:21.066889+0000","last_peered":"2024-05-21T14:43:21.066889+0000","last_clean":"2024-05-21T14:43:21.066889+0000","last_became_active":"2024-05-21T14:43:19.633664+0000","last_became_peered":"2024-05-21T14:43:19.633664+0000","last_unstale":"2024-05-21T14:43:21.066889+0000","last_undegraded":"2024-05-21T14:43:21.066889+0000","last_fullsized":"2024-05-21T14:43:21.066889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:36:07.708164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.806114+0000","last_change":"2024-05-21T14:43:18.614764+0000","last_active":"2024-05-21T14:43:58.806114+0000","last_peered":"2024-05-21T14:43:58.806114+0000","last_clean":"2024-05-21T14:43:58.806114+0000","last_became_active":"2024-05-21T14:43:18.614214+0000","last_became_peered":"2024-05-21T14:43:18.614214+0000","last_unstale":"2024-05-21T14:43:58.806114+0000","last_undegraded":"2024-05-21T14:43:58.806114+0000","last_fullsized":"2024-05-21T14:43:58.806114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:34:40.294756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580771+0000","last_change":"2024-05-21T14:43:19.625313+0000","last_active":"2024-05-21T14:43:20.580771+0000","last_peered":"2024-05-21T14:43:20.580771+0000","last_clean":"2024-05-21T14:43:20.580771+0000","last_became_active":"2024-05-21T14:43:19.624474+0000","last_became_peered":"2024-05-21T14:43:19.624474+0000","last_unstale":"2024-05-21T14:43:20.580771+0000","last_undegraded":"2024-05-21T14:43:20.580771+0000","last_fullsized":"2024-05-21T14:43:20.580771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:28.280456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.746478+0000","last_change":"2024-05-21T14:43:18.600736+0000","last_active":"2024-05-21T14:43:41.746478+0000","last_peered":"2024-05-21T14:43:41.746478+0000","last_clean":"2024-05-21T14:43:41.746478+0000","last_became_active":"2024-05-21T14:43:18.600415+0000","last_became_peered":"2024-05-21T14:43:18.600415+0000","last_unstale":"2024-05-21T14:43:41.746478+0000","last_undegraded":"2024-05-21T14:43:41.746478+0000","last_fullsized":"2024-05-21T14:43:41.746478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:03:57.207603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797724+0000","last_change":"2024-05-21T14:43:19.599637+0000","last_active":"2024-05-21T14:43:20.797724+0000","last_peered":"2024-05-21T14:43:20.797724+0000","last_clean":"2024-05-21T14:43:20.797724+0000","last_became_active":"2024-05-21T14:43:19.599195+0000","last_became_peered":"2024-05-21T14:43:19.599195+0000","last_unstale":"2024-05-21T14:43:20.797724+0000","last_undegraded":"2024-05-21T14:43:20.797724+0000","last_fullsized":"2024-05-21T14:43:20.797724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:17.350821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.739415+0000","last_change":"2024-05-21T14:43:18.603064+0000","last_active":"2024-05-21T14:43:41.739415+0000","last_peered":"2024-05-21T14:43:41.739415+0000","last_clean":"2024-05-21T14:43:41.739415+0000","last_became_active":"2024-05-21T14:43:18.602658+0000","last_became_peered":"2024-05-21T14:43:18.602658+0000","last_unstale":"2024-05-21T14:43:41.739415+0000","last_undegraded":"2024-05-21T14:43:41.739415+0000","last_fullsized":"2024-05-21T14:43:41.739415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:09:28.623131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.577809+0000","last_change":"2024-05-21T14:43:19.620760+0000","last_active":"2024-05-21T14:43:20.577809+0000","last_peered":"2024-05-21T14:43:20.577809+0000","last_clean":"2024-05-21T14:43:20.577809+0000","last_became_active":"2024-05-21T14:43:19.620409+0000","last_became_peered":"2024-05-21T14:43:19.620409+0000","last_unstale":"2024-05-21T14:43:20.577809+0000","last_undegraded":"2024-05-21T14:43:20.577809+0000","last_fullsized":"2024-05-21T14:43:20.577809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:49:59.051131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'17","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.743219+0000","last_change":"2024-05-21T14:43:18.594225+0000","last_active":"2024-05-21T14:43:41.743219+0000","last_peered":"2024-05-21T14:43:41.743219+0000","last_clean":"2024-05-21T14:43:41.743219+0000","last_became_active":"2024-05-21T14:43:18.592335+0000","last_became_peered":"2024-05-21T14:43:18.592335+0000","last_unstale":"2024-05-21T14:43:41.743219+0000","last_undegraded":"2024-05-21T14:43:41.743219+0000","last_fullsized":"2024-05-21T14:43:41.743219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:00:58.772091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797667+0000","last_change":"2024-05-21T14:43:19.612442+0000","last_active":"2024-05-21T14:43:20.797667+0000","last_peered":"2024-05-21T14:43:20.797667+0000","last_clean":"2024-05-21T14:43:20.797667+0000","last_became_active":"2024-05-21T14:43:19.612110+0000","last_became_peered":"2024-05-21T14:43:19.612110+0000","last_unstale":"2024-05-21T14:43:20.797667+0000","last_undegraded":"2024-05-21T14:43:20.797667+0000","last_fullsized":"2024-05-21T14:43:20.797667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:53.451513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.590887+0000","last_change":"2024-05-21T14:43:18.613433+0000","last_active":"2024-05-21T14:43:24.590887+0000","last_peered":"2024-05-21T14:43:24.590887+0000","last_clean":"2024-05-21T14:43:24.590887+0000","last_became_active":"2024-05-21T14:43:18.613048+0000","last_became_peered":"2024-05-21T14:43:18.613048+0000","last_unstale":"2024-05-21T14:43:24.590887+0000","last_undegraded":"2024-05-21T14:43:24.590887+0000","last_fullsized":"2024-05-21T14:43:24.590887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:00:16.454574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066572+0000","last_change":"2024-05-21T14:43:19.597079+0000","last_active":"2024-05-21T14:43:21.066572+0000","last_peered":"2024-05-21T14:43:21.066572+0000","last_clean":"2024-05-21T14:43:21.066572+0000","last_became_active":"2024-05-21T14:43:19.596736+0000","last_became_peered":"2024-05-21T14:43:19.596736+0000","last_unstale":"2024-05-21T14:43:21.066572+0000","last_undegraded":"2024-05-21T14:43:21.066572+0000","last_fullsized":"2024-05-21T14:43:21.066572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:09:03.687971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.770686+0000","last_change":"2024-05-21T14:43:18.620603+0000","last_active":"2024-05-21T14:43:47.770686+0000","last_peered":"2024-05-21T14:43:47.770686+0000","last_clean":"2024-05-21T14:43:47.770686+0000","last_became_active":"2024-05-21T14:43:18.619762+0000","last_became_peered":"2024-05-21T14:43:18.619762+0000","last_unstale":"2024-05-21T14:43:47.770686+0000","last_undegraded":"2024-05-21T14:43:47.770686+0000","last_fullsized":"2024-05-21T14:43:47.770686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:31:49.257435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067100+0000","last_change":"2024-05-21T14:43:19.611608+0000","last_active":"2024-05-21T14:43:21.067100+0000","last_peered":"2024-05-21T14:43:21.067100+0000","last_clean":"2024-05-21T14:43:21.067100+0000","last_became_active":"2024-05-21T14:43:19.610774+0000","last_became_peered":"2024-05-21T14:43:19.610774+0000","last_unstale":"2024-05-21T14:43:21.067100+0000","last_undegraded":"2024-05-21T14:43:21.067100+0000","last_fullsized":"2024-05-21T14:43:21.067100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:19:00.383286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.741997+0000","last_change":"2024-05-21T14:43:18.610121+0000","last_active":"2024-05-21T14:43:41.741997+0000","last_peered":"2024-05-21T14:43:41.741997+0000","last_clean":"2024-05-21T14:43:41.741997+0000","last_became_active":"2024-05-21T14:43:18.609349+0000","last_became_peered":"2024-05-21T14:43:18.609349+0000","last_unstale":"2024-05-21T14:43:41.741997+0000","last_undegraded":"2024-05-21T14:43:41.741997+0000","last_fullsized":"2024-05-21T14:43:41.741997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:48.330067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066734+0000","last_change":"2024-05-21T14:43:19.605193+0000","last_active":"2024-05-21T14:43:21.066734+0000","last_peered":"2024-05-21T14:43:21.066734+0000","last_clean":"2024-05-21T14:43:21.066734+0000","last_became_active":"2024-05-21T14:43:19.604869+0000","last_became_peered":"2024-05-21T14:43:19.604869+0000","last_unstale":"2024-05-21T14:43:21.066734+0000","last_undegraded":"2024-05-21T14:43:21.066734+0000","last_fullsized":"2024-05-21T14:43:21.066734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:58:05.078363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.738314+0000","last_change":"2024-05-21T14:43:18.616535+0000","last_active":"2024-05-21T14:43:41.738314+0000","last_peered":"2024-05-21T14:43:41.738314+0000","last_clean":"2024-05-21T14:43:41.738314+0000","last_became_active":"2024-05-21T14:43:18.615734+0000","last_became_peered":"2024-05-21T14:43:18.615734+0000","last_unstale":"2024-05-21T14:43:41.738314+0000","last_undegraded":"2024-05-21T14:43:41.738314+0000","last_fullsized":"2024-05-21T14:43:41.738314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:10:27.821535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798116+0000","last_change":"2024-05-21T14:43:19.615424+0000","last_active":"2024-05-21T14:43:20.798116+0000","last_peered":"2024-05-21T14:43:20.798116+0000","last_clean":"2024-05-21T14:43:20.798116+0000","last_became_active":"2024-05-21T14:43:19.614915+0000","last_became_peered":"2024-05-21T14:43:19.614915+0000","last_unstale":"2024-05-21T14:43:20.798116+0000","last_undegraded":"2024-05-21T14:43:20.798116+0000","last_fullsized":"2024-05-21T14:43:20.798116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:25:09.153430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.577738+0000","last_change":"2024-05-21T14:43:08.080234+0000","last_active":"2024-05-21T14:43:20.577738+0000","last_peered":"2024-05-21T14:43:20.577738+0000","last_clean":"2024-05-21T14:43:20.577738+0000","last_became_active":"2024-05-21T14:43:08.079934+0000","last_became_peered":"2024-05-21T14:43:08.079934+0000","last_unstale":"2024-05-21T14:43:20.577738+0000","last_undegraded":"2024-05-21T14:43:20.577738+0000","last_fullsized":"2024-05-21T14:43:20.577738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_clean_scrub_stamp":"2024-05-21T14:43:07.046978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:54:57.347768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.746452+0000","last_change":"2024-05-21T14:43:18.599850+0000","last_active":"2024-05-21T14:43:41.746452+0000","last_peered":"2024-05-21T14:43:41.746452+0000","last_clean":"2024-05-21T14:43:41.746452+0000","last_became_active":"2024-05-21T14:43:18.599347+0000","last_became_peered":"2024-05-21T14:43:18.599347+0000","last_unstale":"2024-05-21T14:43:41.746452+0000","last_undegraded":"2024-05-21T14:43:41.746452+0000","last_fullsized":"2024-05-21T14:43:41.746452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:01:06.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963423+0000","last_change":"2024-05-21T14:43:19.613056+0000","last_active":"2024-05-21T14:43:20.963423+0000","last_peered":"2024-05-21T14:43:20.963423+0000","last_clean":"2024-05-21T14:43:20.963423+0000","last_became_active":"2024-05-21T14:43:19.611889+0000","last_became_peered":"2024-05-21T14:43:19.611889+0000","last_unstale":"2024-05-21T14:43:20.963423+0000","last_undegraded":"2024-05-21T14:43:20.963423+0000","last_fullsized":"2024-05-21T14:43:20.963423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:46:20.105282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:35.726262+0000","last_change":"2024-05-21T14:43:18.621482+0000","last_active":"2024-05-21T14:43:35.726262+0000","last_peered":"2024-05-21T14:43:35.726262+0000","last_clean":"2024-05-21T14:43:35.726262+0000","last_became_active":"2024-05-21T14:43:18.621229+0000","last_became_peered":"2024-05-21T14:43:18.621229+0000","last_unstale":"2024-05-21T14:43:35.726262+0000","last_undegraded":"2024-05-21T14:43:35.726262+0000","last_fullsized":"2024-05-21T14:43:35.726262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:30:04.326588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580381+0000","last_change":"2024-05-21T14:43:19.625038+0000","last_active":"2024-05-21T14:43:20.580381+0000","last_peered":"2024-05-21T14:43:20.580381+0000","last_clean":"2024-05-21T14:43:20.580381+0000","last_became_active":"2024-05-21T14:43:19.624114+0000","last_became_peered":"2024-05-21T14:43:19.624114+0000","last_unstale":"2024-05-21T14:43:20.580381+0000","last_undegraded":"2024-05-21T14:43:20.580381+0000","last_fullsized":"2024-05-21T14:43:20.580381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:11.854243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'5","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.805088+0000","last_change":"2024-05-21T14:43:18.618518+0000","last_active":"2024-05-21T14:43:58.805088+0000","last_peered":"2024-05-21T14:43:58.805088+0000","last_clean":"2024-05-21T14:43:58.805088+0000","last_became_active":"2024-05-21T14:43:18.617756+0000","last_became_peered":"2024-05-21T14:43:18.617756+0000","last_unstale":"2024-05-21T14:43:58.805088+0000","last_undegraded":"2024-05-21T14:43:58.805088+0000","last_fullsized":"2024-05-21T14:43:58.805088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:52:12.999877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066783+0000","last_change":"2024-05-21T14:43:19.613595+0000","last_active":"2024-05-21T14:43:21.066783+0000","last_peered":"2024-05-21T14:43:21.066783+0000","last_clean":"2024-05-21T14:43:21.066783+0000","last_became_active":"2024-05-21T14:43:19.612730+0000","last_became_peered":"2024-05-21T14:43:19.612730+0000","last_unstale":"2024-05-21T14:43:21.066783+0000","last_undegraded":"2024-05-21T14:43:21.066783+0000","last_fullsized":"2024-05-21T14:43:21.066783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:01:02.847071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.773237+0000","last_change":"2024-05-21T14:43:18.608596+0000","last_active":"2024-05-21T14:43:47.773237+0000","last_peered":"2024-05-21T14:43:47.773237+0000","last_clean":"2024-05-21T14:43:47.773237+0000","last_became_active":"2024-05-21T14:43:18.608262+0000","last_became_peered":"2024-05-21T14:43:18.608262+0000","last_unstale":"2024-05-21T14:43:47.773237+0000","last_undegraded":"2024-05-21T14:43:47.773237+0000","last_fullsized":"2024-05-21T14:43:47.773237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:14.962554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066581+0000","last_change":"2024-05-21T14:43:19.607815+0000","last_active":"2024-05-21T14:43:21.066581+0000","last_peered":"2024-05-21T14:43:21.066581+0000","last_clean":"2024-05-21T14:43:21.066581+0000","last_became_active":"2024-05-21T14:43:19.607513+0000","last_became_peered":"2024-05-21T14:43:19.607513+0000","last_unstale":"2024-05-21T14:43:21.066581+0000","last_undegraded":"2024-05-21T14:43:21.066581+0000","last_fullsized":"2024-05-21T14:43:21.066581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:01:35.332981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066943+0000","last_change":"2024-05-21T14:43:18.603626+0000","last_active":"2024-05-21T14:43:21.066943+0000","last_peered":"2024-05-21T14:43:21.066943+0000","last_clean":"2024-05-21T14:43:21.066943+0000","last_became_active":"2024-05-21T14:43:18.602704+0000","last_became_peered":"2024-05-21T14:43:18.602704+0000","last_unstale":"2024-05-21T14:43:21.066943+0000","last_undegraded":"2024-05-21T14:43:21.066943+0000","last_fullsized":"2024-05-21T14:43:21.066943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:03.976820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066240+0000","last_change":"2024-05-21T14:43:19.634449+0000","last_active":"2024-05-21T14:43:21.066240+0000","last_peered":"2024-05-21T14:43:21.066240+0000","last_clean":"2024-05-21T14:43:21.066240+0000","last_became_active":"2024-05-21T14:43:19.633751+0000","last_became_peered":"2024-05-21T14:43:19.633751+0000","last_unstale":"2024-05-21T14:43:21.066240+0000","last_undegraded":"2024-05-21T14:43:21.066240+0000","last_fullsized":"2024-05-21T14:43:21.066240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:04:51.415303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.747266+0000","last_change":"2024-05-21T14:43:18.608335+0000","last_active":"2024-05-21T14:43:41.747266+0000","last_peered":"2024-05-21T14:43:41.747266+0000","last_clean":"2024-05-21T14:43:41.747266+0000","last_became_active":"2024-05-21T14:43:18.607999+0000","last_became_peered":"2024-05-21T14:43:18.607999+0000","last_unstale":"2024-05-21T14:43:41.747266+0000","last_undegraded":"2024-05-21T14:43:41.747266+0000","last_fullsized":"2024-05-21T14:43:41.747266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:21.325953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582549+0000","last_change":"2024-05-21T14:43:19.626742+0000","last_active":"2024-05-21T14:43:20.582549+0000","last_peered":"2024-05-21T14:43:20.582549+0000","last_clean":"2024-05-21T14:43:20.582549+0000","last_became_active":"2024-05-21T14:43:19.626024+0000","last_became_peered":"2024-05-21T14:43:19.626024+0000","last_unstale":"2024-05-21T14:43:20.582549+0000","last_undegraded":"2024-05-21T14:43:20.582549+0000","last_fullsized":"2024-05-21T14:43:20.582549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:48:15.426224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'7","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.743462+0000","last_change":"2024-05-21T14:43:18.616913+0000","last_active":"2024-05-21T14:43:41.743462+0000","last_peered":"2024-05-21T14:43:41.743462+0000","last_clean":"2024-05-21T14:43:41.743462+0000","last_became_active":"2024-05-21T14:43:18.616214+0000","last_became_peered":"2024-05-21T14:43:18.616214+0000","last_unstale":"2024-05-21T14:43:41.743462+0000","last_undegraded":"2024-05-21T14:43:41.743462+0000","last_fullsized":"2024-05-21T14:43:41.743462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:22.112018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963796+0000","last_change":"2024-05-21T14:43:19.607521+0000","last_active":"2024-05-21T14:43:20.963796+0000","last_peered":"2024-05-21T14:43:20.963796+0000","last_clean":"2024-05-21T14:43:20.963796+0000","last_became_active":"2024-05-21T14:43:19.606673+0000","last_became_peered":"2024-05-21T14:43:19.606673+0000","last_unstale":"2024-05-21T14:43:20.963796+0000","last_undegraded":"2024-05-21T14:43:20.963796+0000","last_fullsized":"2024-05-21T14:43:20.963796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:50:50.373410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'7","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.768063+0000","last_change":"2024-05-21T14:43:18.615846+0000","last_active":"2024-05-21T14:43:47.768063+0000","last_peered":"2024-05-21T14:43:47.768063+0000","last_clean":"2024-05-21T14:43:47.768063+0000","last_became_active":"2024-05-21T14:43:18.615506+0000","last_became_peered":"2024-05-21T14:43:18.615506+0000","last_unstale":"2024-05-21T14:43:47.768063+0000","last_undegraded":"2024-05-21T14:43:47.768063+0000","last_fullsized":"2024-05-21T14:43:47.768063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:07:17.030757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.964252+0000","last_change":"2024-05-21T14:43:19.611473+0000","last_active":"2024-05-21T14:43:20.964252+0000","last_peered":"2024-05-21T14:43:20.964252+0000","last_clean":"2024-05-21T14:43:20.964252+0000","last_became_active":"2024-05-21T14:43:19.610600+0000","last_became_peered":"2024-05-21T14:43:19.610600+0000","last_unstale":"2024-05-21T14:43:20.964252+0000","last_undegraded":"2024-05-21T14:43:20.964252+0000","last_fullsized":"2024-05-21T14:43:20.964252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:48:07.659795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:29.679809+0000","last_change":"2024-05-21T14:43:18.604951+0000","last_active":"2024-05-21T14:43:29.679809+0000","last_peered":"2024-05-21T14:43:29.679809+0000","last_clean":"2024-05-21T14:43:29.679809+0000","last_became_active":"2024-05-21T14:43:18.602186+0000","last_became_peered":"2024-05-21T14:43:18.602186+0000","last_unstale":"2024-05-21T14:43:29.679809+0000","last_undegraded":"2024-05-21T14:43:29.679809+0000","last_fullsized":"2024-05-21T14:43:29.679809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:34:10.395484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797647+0000","last_change":"2024-05-21T14:43:19.600827+0000","last_active":"2024-05-21T14:43:20.797647+0000","last_peered":"2024-05-21T14:43:20.797647+0000","last_clean":"2024-05-21T14:43:20.797647+0000","last_became_active":"2024-05-21T14:43:19.600499+0000","last_became_peered":"2024-05-21T14:43:19.600499+0000","last_unstale":"2024-05-21T14:43:20.797647+0000","last_undegraded":"2024-05-21T14:43:20.797647+0000","last_fullsized":"2024-05-21T14:43:20.797647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:55:36.231321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'7","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.769353+0000","last_change":"2024-05-21T14:43:18.615190+0000","last_active":"2024-05-21T14:43:47.769353+0000","last_peered":"2024-05-21T14:43:47.769353+0000","last_clean":"2024-05-21T14:43:47.769353+0000","last_became_active":"2024-05-21T14:43:18.614306+0000","last_became_peered":"2024-05-21T14:43:18.614306+0000","last_unstale":"2024-05-21T14:43:47.769353+0000","last_undegraded":"2024-05-21T14:43:47.769353+0000","last_fullsized":"2024-05-21T14:43:47.769353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:53.472559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.962948+0000","last_change":"2024-05-21T14:43:19.610903+0000","last_active":"2024-05-21T14:43:20.962948+0000","last_peered":"2024-05-21T14:43:20.962948+0000","last_clean":"2024-05-21T14:43:20.962948+0000","last_became_active":"2024-05-21T14:43:19.610101+0000","last_became_peered":"2024-05-21T14:43:19.610101+0000","last_unstale":"2024-05-21T14:43:20.962948+0000","last_undegraded":"2024-05-21T14:43:20.962948+0000","last_fullsized":"2024-05-21T14:43:20.962948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:16:24.580581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.740216+0000","last_change":"2024-05-21T14:43:18.617785+0000","last_active":"2024-05-21T14:43:41.740216+0000","last_peered":"2024-05-21T14:43:41.740216+0000","last_clean":"2024-05-21T14:43:41.740216+0000","last_became_active":"2024-05-21T14:43:18.617041+0000","last_became_peered":"2024-05-21T14:43:18.617041+0000","last_unstale":"2024-05-21T14:43:41.740216+0000","last_undegraded":"2024-05-21T14:43:41.740216+0000","last_fullsized":"2024-05-21T14:43:41.740216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:02:50.837158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.805753+0000","last_change":"2024-05-21T14:43:19.627096+0000","last_active":"2024-05-21T14:43:58.805753+0000","last_peered":"2024-05-21T14:43:58.805753+0000","last_clean":"2024-05-21T14:43:58.805753+0000","last_became_active":"2024-05-21T14:43:19.626265+0000","last_became_peered":"2024-05-21T14:43:19.626265+0000","last_unstale":"2024-05-21T14:43:58.805753+0000","last_undegraded":"2024-05-21T14:43:58.805753+0000","last_fullsized":"2024-05-21T14:43:58.805753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:23:47.818120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:29.698283+0000","last_change":"2024-05-21T14:43:18.599635+0000","last_active":"2024-05-21T14:43:29.698283+0000","last_peered":"2024-05-21T14:43:29.698283+0000","last_clean":"2024-05-21T14:43:29.698283+0000","last_became_active":"2024-05-21T14:43:18.598996+0000","last_became_peered":"2024-05-21T14:43:18.598996+0000","last_unstale":"2024-05-21T14:43:29.698283+0000","last_undegraded":"2024-05-21T14:43:29.698283+0000","last_fullsized":"2024-05-21T14:43:29.698283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:17:09.383291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797767+0000","last_change":"2024-05-21T14:43:19.617686+0000","last_active":"2024-05-21T14:43:20.797767+0000","last_peered":"2024-05-21T14:43:20.797767+0000","last_clean":"2024-05-21T14:43:20.797767+0000","last_became_active":"2024-05-21T14:43:19.617398+0000","last_became_peered":"2024-05-21T14:43:19.617398+0000","last_unstale":"2024-05-21T14:43:20.797767+0000","last_undegraded":"2024-05-21T14:43:20.797767+0000","last_fullsized":"2024-05-21T14:43:20.797767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:21:06.527871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798047+0000","last_change":"2024-05-21T14:43:19.601673+0000","last_active":"2024-05-21T14:43:20.798047+0000","last_peered":"2024-05-21T14:43:20.798047+0000","last_clean":"2024-05-21T14:43:20.798047+0000","last_became_active":"2024-05-21T14:43:19.601286+0000","last_became_peered":"2024-05-21T14:43:19.601286+0000","last_unstale":"2024-05-21T14:43:20.798047+0000","last_undegraded":"2024-05-21T14:43:20.798047+0000","last_fullsized":"2024-05-21T14:43:20.798047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:21:22.955055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.769432+0000","last_change":"2024-05-21T14:43:18.613555+0000","last_active":"2024-05-21T14:43:47.769432+0000","last_peered":"2024-05-21T14:43:47.769432+0000","last_clean":"2024-05-21T14:43:47.769432+0000","last_became_active":"2024-05-21T14:43:18.613117+0000","last_became_peered":"2024-05-21T14:43:18.613117+0000","last_unstale":"2024-05-21T14:43:47.769432+0000","last_undegraded":"2024-05-21T14:43:47.769432+0000","last_fullsized":"2024-05-21T14:43:47.769432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:38.151165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578450+0000","last_change":"2024-05-21T14:43:19.596736+0000","last_active":"2024-05-21T14:43:20.578450+0000","last_peered":"2024-05-21T14:43:20.578450+0000","last_clean":"2024-05-21T14:43:20.578450+0000","last_became_active":"2024-05-21T14:43:19.596157+0000","last_became_peered":"2024-05-21T14:43:19.596157+0000","last_unstale":"2024-05-21T14:43:20.578450+0000","last_undegraded":"2024-05-21T14:43:20.578450+0000","last_fullsized":"2024-05-21T14:43:20.578450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:22:14.002930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'12","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.770421+0000","last_change":"2024-05-21T14:43:18.614044+0000","last_active":"2024-05-21T14:43:47.770421+0000","last_peered":"2024-05-21T14:43:47.770421+0000","last_clean":"2024-05-21T14:43:47.770421+0000","last_became_active":"2024-05-21T14:43:18.613730+0000","last_became_peered":"2024-05-21T14:43:18.613730+0000","last_unstale":"2024-05-21T14:43:47.770421+0000","last_undegraded":"2024-05-21T14:43:47.770421+0000","last_fullsized":"2024-05-21T14:43:47.770421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:41:34.787779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067780+0000","last_change":"2024-05-21T14:43:19.621999+0000","last_active":"2024-05-21T14:43:21.067780+0000","last_peered":"2024-05-21T14:43:21.067780+0000","last_clean":"2024-05-21T14:43:21.067780+0000","last_became_active":"2024-05-21T14:43:19.614744+0000","last_became_peered":"2024-05-21T14:43:19.614744+0000","last_unstale":"2024-05-21T14:43:21.067780+0000","last_undegraded":"2024-05-21T14:43:21.067780+0000","last_fullsized":"2024-05-21T14:43:21.067780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:32:37.316833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.592331+0000","last_change":"2024-05-21T14:43:18.614193+0000","last_active":"2024-05-21T14:43:24.592331+0000","last_peered":"2024-05-21T14:43:24.592331+0000","last_clean":"2024-05-21T14:43:24.592331+0000","last_became_active":"2024-05-21T14:43:18.609797+0000","last_became_peered":"2024-05-21T14:43:18.609797+0000","last_unstale":"2024-05-21T14:43:24.592331+0000","last_undegraded":"2024-05-21T14:43:24.592331+0000","last_fullsized":"2024-05-21T14:43:24.592331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:39:55.623816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067766+0000","last_change":"2024-05-21T14:43:19.610578+0000","last_active":"2024-05-21T14:43:21.067766+0000","last_peered":"2024-05-21T14:43:21.067766+0000","last_clean":"2024-05-21T14:43:21.067766+0000","last_became_active":"2024-05-21T14:43:19.606575+0000","last_became_peered":"2024-05-21T14:43:19.606575+0000","last_unstale":"2024-05-21T14:43:21.067766+0000","last_undegraded":"2024-05-21T14:43:21.067766+0000","last_fullsized":"2024-05-21T14:43:21.067766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:50:06.088520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'13","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.769562+0000","last_change":"2024-05-21T14:43:18.601862+0000","last_active":"2024-05-21T14:43:47.769562+0000","last_peered":"2024-05-21T14:43:47.769562+0000","last_clean":"2024-05-21T14:43:47.769562+0000","last_became_active":"2024-05-21T14:43:18.601311+0000","last_became_peered":"2024-05-21T14:43:18.601311+0000","last_unstale":"2024-05-21T14:43:47.769562+0000","last_undegraded":"2024-05-21T14:43:47.769562+0000","last_fullsized":"2024-05-21T14:43:47.769562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:02.736061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8034,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":16068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":83615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":672429,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509452,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":84685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":83957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":82915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":673017,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":83777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":82289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T14:44:01.645 INFO:tasks.mds_thrash.ceph_manager:clean! 2024-05-21T14:44:01.645 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T14:44:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.828+0000 7fb1b1800640 1 Processor -- start 2024-05-21T14:44:01.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.828+0000 7fb1b1800640 1 -- start start 2024-05-21T14:44:01.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.828+0000 7fb1b1800640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb1ac0c9790 0x7fb1ac070d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:01.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.828+0000 7fb1b1800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb1ac0cb5b0 0x7fb1ac0cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:01.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.828+0000 7fb1b1800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1ac071420 con 0x7fb1ac155b80 2024-05-21T14:44:01.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.828+0000 7fb1b1800640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fb1ac15f2d0 con 0x7fb1ac0c9790 2024-05-21T14:44:01.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.828+0000 7fb1b1800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fb1ac071700 con 0x7fb1ac0cb5b0 2024-05-21T14:44:01.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.828+0000 7fb1aaa00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb1ac0c9790 0x7fb1ac070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:01.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.828+0000 7fb1aaa00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb1ac0c9790 0x7fb1ac070d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35552/0 (socket says 172.21.15.78:35552) 2024-05-21T14:44:01.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.828+0000 7fb1aaa00640 1 -- 172.21.15.78:0/1950299453 learned_addr learned my addr 172.21.15.78:0/1950299453 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:44:01.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.828+0000 7fb1ab400640 1 --2- 172.21.15.78:0/1950299453 >> v2:172.21.15.84:3300/0 conn(0x7fb1ac0cb5b0 0x7fb1ac0cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:01.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.828+0000 7fb1aaa00640 1 -- 172.21.15.78:0/1950299453 >> v2:172.21.15.84:3300/0 conn(0x7fb1ac0cb5b0 msgr2=0x7fb1ac0cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:44:01.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.828+0000 7fb1aaa00640 1 --2- 172.21.15.78:0/1950299453 >> v2:172.21.15.84:3300/0 conn(0x7fb1ac0cb5b0 0x7fb1ac0cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.828+0000 7fb1aaa00640 1 -- 172.21.15.78:0/1950299453 >> v1:172.21.15.84:6789/0 conn(0x7fb1ac155b80 legacy=0x7fb1ac15f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:01.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.828+0000 7fb1aaa00640 1 -- 172.21.15.78:0/1950299453 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ac0719e0 con 0x7fb1ac0c9790 2024-05-21T14:44:01.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.832+0000 7fb1aaa00640 1 --2- 172.21.15.78:0/1950299453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ac0c9790 0x7fb1ac070d70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac06e910 tx=0x7fb19c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17866ab695b39e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:01.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.832+0000 7fb1a9600640 1 -- 172.21.15.78:0/1950299453 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c0b0070 con 0x7fb1ac0c9790 2024-05-21T14:44:01.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.832+0000 7fb1a9600640 1 -- 172.21.15.78:0/1950299453 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19c0ab600 con 0x7fb1ac0c9790 2024-05-21T14:44:01.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.832+0000 7fb1a9600640 1 -- 172.21.15.78:0/1950299453 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c0ab9d0 con 0x7fb1ac0c9790 2024-05-21T14:44:01.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.832+0000 7fb1b1800640 1 -- 172.21.15.78:0/1950299453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ac0c9790 msgr2=0x7fb1ac070d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:01.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.832+0000 7fb1b1800640 1 --2- 172.21.15.78:0/1950299453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ac0c9790 0x7fb1ac070d70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac06e910 tx=0x7fb19c01c520 comp rx=0 tx=0).stop 2024-05-21T14:44:01.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.832+0000 7fb1b1800640 1 -- 172.21.15.78:0/1950299453 shutdown_connections 2024-05-21T14:44:01.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.832+0000 7fb1b1800640 1 --2- 172.21.15.78:0/1950299453 >> v2:172.21.15.84:3300/0 conn(0x7fb1ac0cb5b0 0x7fb1ac0cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.832+0000 7fb1b1800640 1 --2- 172.21.15.78:0/1950299453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ac0c9790 0x7fb1ac070d70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.832+0000 7fb1b1800640 1 -- 172.21.15.78:0/1950299453 >> 172.21.15.78:0/1950299453 conn(0x7fb1ac0752c0 msgr2=0x7fb1ac0ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:01.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.832+0000 7fb1b1800640 1 -- 172.21.15.78:0/1950299453 shutdown_connections 2024-05-21T14:44:01.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.832+0000 7fb1b1800640 1 -- 172.21.15.78:0/1950299453 wait complete. 2024-05-21T14:44:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1b1800640 1 Processor -- start 2024-05-21T14:44:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1b1800640 1 -- start start 2024-05-21T14:44:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1b1800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1ac0c9790 0x7fb1ac0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:01.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1b1800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb1ac0cb5b0 0x7fb1ac0c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:01.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1b1800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ac155b80 0x7fb1ac0b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:01.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1b1800640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac1689c0 con 0x7fb1ac155b80 2024-05-21T14:44:01.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1b1800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac168b40 con 0x7fb1ac0c9790 2024-05-21T14:44:01.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1b1800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ac168cc0 con 0x7fb1ac0cb5b0 2024-05-21T14:44:01.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1ab400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ac155b80 0x7fb1ac0b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:01.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1ab400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ac155b80 0x7fb1ac0b0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35558/0 (socket says 172.21.15.78:35558) 2024-05-21T14:44:01.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1ab400640 1 -- 172.21.15.78:0/487011131 learned_addr learned my addr 172.21.15.78:0/487011131 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:44:01.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1aaa00640 1 --2- 172.21.15.78:0/487011131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1ac0c9790 0x7fb1ac0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:01.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1aa000640 1 --2- 172.21.15.78:0/487011131 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb1ac0cb5b0 0x7fb1ac0c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1ab400640 1 -- 172.21.15.78:0/487011131 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb1ac0cb5b0 msgr2=0x7fb1ac0c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1ab400640 1 --2- 172.21.15.78:0/487011131 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb1ac0cb5b0 0x7fb1ac0c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1ab400640 1 -- 172.21.15.78:0/487011131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1ac0c9790 msgr2=0x7fb1ac0b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1ab400640 1 --2- 172.21.15.78:0/487011131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1ac0c9790 0x7fb1ac0b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1ab400640 1 -- 172.21.15.78:0/487011131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ac0c7de0 con 0x7fb1ac155b80 2024-05-21T14:44:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1ab400640 1 --2- 172.21.15.78:0/487011131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ac155b80 0x7fb1ac0b0010 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400efc0 tx=0x7fb1a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1a2a00640 1 -- 172.21.15.78:0/487011131 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4018020 con 0x7fb1ac155b80 2024-05-21T14:44:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1a2a00640 1 -- 172.21.15.78:0/487011131 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1a4014480 con 0x7fb1ac155b80 2024-05-21T14:44:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1b1800640 1 -- 172.21.15.78:0/487011131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1ac0af8a0 con 0x7fb1ac155b80 2024-05-21T14:44:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1a2a00640 1 -- 172.21.15.78:0/487011131 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4009e60 con 0x7fb1ac155b80 2024-05-21T14:44:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.836+0000 7fb1b1800640 1 -- 172.21.15.78:0/487011131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1ac1f89b0 con 0x7fb1ac155b80 2024-05-21T14:44:01.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.840+0000 7fb1b1800640 1 -- 172.21.15.78:0/487011131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1ac04f730 con 0x7fb1ac155b80 2024-05-21T14:44:01.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.840+0000 7fb1a2a00640 1 -- 172.21.15.78:0/487011131 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1a401b020 con 0x7fb1ac155b80 2024-05-21T14:44:01.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.840+0000 7fb1a2a00640 1 --2- 172.21.15.78:0/487011131 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb18c0678c0 0x7fb18c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:01.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.840+0000 7fb1a2a00640 1 -- 172.21.15.78:0/487011131 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb1a4086af0 con 0x7fb1ac155b80 2024-05-21T14:44:01.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.840+0000 7fb1aaa00640 1 --2- 172.21.15.78:0/487011131 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb18c0678c0 0x7fb18c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:01.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.840+0000 7fb1aaa00640 1 --2- 172.21.15.78:0/487011131 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb18c0678c0 0x7fb18c069dd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0ad000 tx=0x7fb19c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:01.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.844+0000 7fb1a2a00640 1 -- 172.21.15.78:0/487011131 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb1a4022030 con 0x7fb1ac155b80 2024-05-21T14:44:02.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:01.996+0000 7fb1b1800640 1 -- 172.21.15.78:0/487011131 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb1ac0c9550 con 0x7fb18c0678c0 2024-05-21T14:44:02.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.016+0000 7fb1a2a00640 1 -- 172.21.15.78:0/487011131 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252019 (secure 0 0 0) 0x7fb1ac0c9550 con 0x7fb18c0678c0 2024-05-21T14:44:02.028 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:44:02.029 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-05-21T14:44:02.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.020+0000 7fb1b1800640 1 -- 172.21.15.78:0/487011131 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb18c0678c0 msgr2=0x7fb18c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.020+0000 7fb1b1800640 1 --2- 172.21.15.78:0/487011131 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb18c0678c0 0x7fb18c069dd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0ad000 tx=0x7fb19c0a6000 comp rx=0 tx=0).stop 2024-05-21T14:44:02.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.020+0000 7fb1b1800640 1 -- 172.21.15.78:0/487011131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ac155b80 msgr2=0x7fb1ac0b0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.020+0000 7fb1b1800640 1 --2- 172.21.15.78:0/487011131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ac155b80 0x7fb1ac0b0010 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400efc0 tx=0x7fb1a400c490 comp rx=0 tx=0).stop 2024-05-21T14:44:02.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.020+0000 7fb1b1800640 1 -- 172.21.15.78:0/487011131 shutdown_connections 2024-05-21T14:44:02.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.020+0000 7fb1b1800640 1 --2- 172.21.15.78:0/487011131 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb18c0678c0 0x7fb18c069dd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.020+0000 7fb1b1800640 1 --2- 172.21.15.78:0/487011131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ac155b80 0x7fb1ac0b0010 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.020+0000 7fb1b1800640 1 --2- 172.21.15.78:0/487011131 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb1ac0cb5b0 0x7fb1ac0c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.020+0000 7fb1b1800640 1 --2- 172.21.15.78:0/487011131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1ac0c9790 0x7fb1ac0b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.020+0000 7fb1b1800640 1 -- 172.21.15.78:0/487011131 >> 172.21.15.78:0/487011131 conn(0x7fb1ac0752c0 msgr2=0x7fb1ac073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:02.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.020+0000 7fb1b1800640 1 -- 172.21.15.78:0/487011131 shutdown_connections 2024-05-21T14:44:02.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.020+0000 7fb1b1800640 1 -- 172.21.15.78:0/487011131 wait complete. 2024-05-21T14:44:02.049 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-05-21T14:44:00.502922+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598402,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":364,"num_write_kb":2478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218336,"kb_used_data":2208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756384,"statfs":{"total":773094113280,"available":772870537216,"internally_reserved":0,"allocated":2260992,"data_stored":1846684,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003457"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067056+0000","last_change":"2024-05-21T14:43:19.606707+0000","last_active":"2024-05-21T14:43:21.067056+0000","last_peered":"2024-05-21T14:43:21.067056+0000","last_clean":"2024-05-21T14:43:21.067056+0000","last_became_active":"2024-05-21T14:43:19.606365+0000","last_became_peered":"2024-05-21T14:43:19.606365+0000","last_unstale":"2024-05-21T14:43:21.067056+0000","last_undegraded":"2024-05-21T14:43:21.067056+0000","last_fullsized":"2024-05-21T14:43:21.067056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:26.135357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067577+0000","last_change":"2024-05-21T14:43:19.632879+0000","last_active":"2024-05-21T14:43:21.067577+0000","last_peered":"2024-05-21T14:43:21.067577+0000","last_clean":"2024-05-21T14:43:21.067577+0000","last_became_active":"2024-05-21T14:43:19.632218+0000","last_became_peered":"2024-05-21T14:43:19.632218+0000","last_unstale":"2024-05-21T14:43:21.067577+0000","last_undegraded":"2024-05-21T14:43:21.067577+0000","last_fullsized":"2024-05-21T14:43:21.067577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:35:49.461861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066825+0000","last_change":"2024-05-21T14:43:19.620214+0000","last_active":"2024-05-21T14:43:21.066825+0000","last_peered":"2024-05-21T14:43:21.066825+0000","last_clean":"2024-05-21T14:43:21.066825+0000","last_became_active":"2024-05-21T14:43:19.619012+0000","last_became_peered":"2024-05-21T14:43:19.619012+0000","last_unstale":"2024-05-21T14:43:21.066825+0000","last_undegraded":"2024-05-21T14:43:21.066825+0000","last_fullsized":"2024-05-21T14:43:21.066825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:40:22.415178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066035+0000","last_change":"2024-05-21T14:43:19.602199+0000","last_active":"2024-05-21T14:43:21.066035+0000","last_peered":"2024-05-21T14:43:21.066035+0000","last_clean":"2024-05-21T14:43:21.066035+0000","last_became_active":"2024-05-21T14:43:19.601797+0000","last_became_peered":"2024-05-21T14:43:19.601797+0000","last_unstale":"2024-05-21T14:43:21.066035+0000","last_undegraded":"2024-05-21T14:43:21.066035+0000","last_fullsized":"2024-05-21T14:43:21.066035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:33:00.071681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066510+0000","last_change":"2024-05-21T14:43:19.623449+0000","last_active":"2024-05-21T14:43:21.066510+0000","last_peered":"2024-05-21T14:43:21.066510+0000","last_clean":"2024-05-21T14:43:21.066510+0000","last_became_active":"2024-05-21T14:43:19.623125+0000","last_became_peered":"2024-05-21T14:43:19.623125+0000","last_unstale":"2024-05-21T14:43:21.066510+0000","last_undegraded":"2024-05-21T14:43:21.066510+0000","last_fullsized":"2024-05-21T14:43:21.066510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:42.178156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.065985+0000","last_change":"2024-05-21T14:43:19.591222+0000","last_active":"2024-05-21T14:43:21.065985+0000","last_peered":"2024-05-21T14:43:21.065985+0000","last_clean":"2024-05-21T14:43:21.065985+0000","last_became_active":"2024-05-21T14:43:19.590858+0000","last_became_peered":"2024-05-21T14:43:19.590858+0000","last_unstale":"2024-05-21T14:43:21.065985+0000","last_undegraded":"2024-05-21T14:43:21.065985+0000","last_fullsized":"2024-05-21T14:43:21.065985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:21:15.737192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066173+0000","last_change":"2024-05-21T14:43:19.614716+0000","last_active":"2024-05-21T14:43:21.066173+0000","last_peered":"2024-05-21T14:43:21.066173+0000","last_clean":"2024-05-21T14:43:21.066173+0000","last_became_active":"2024-05-21T14:43:19.614451+0000","last_became_peered":"2024-05-21T14:43:19.614451+0000","last_unstale":"2024-05-21T14:43:21.066173+0000","last_undegraded":"2024-05-21T14:43:21.066173+0000","last_fullsized":"2024-05-21T14:43:21.066173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:07:01.524574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066544+0000","last_change":"2024-05-21T14:43:19.604029+0000","last_active":"2024-05-21T14:43:21.066544+0000","last_peered":"2024-05-21T14:43:21.066544+0000","last_clean":"2024-05-21T14:43:21.066544+0000","last_became_active":"2024-05-21T14:43:19.603164+0000","last_became_peered":"2024-05-21T14:43:19.603164+0000","last_unstale":"2024-05-21T14:43:21.066544+0000","last_undegraded":"2024-05-21T14:43:21.066544+0000","last_fullsized":"2024-05-21T14:43:21.066544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:14:27.286952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578218+0000","last_change":"2024-05-21T14:43:19.613765+0000","last_active":"2024-05-21T14:43:20.578218+0000","last_peered":"2024-05-21T14:43:20.578218+0000","last_clean":"2024-05-21T14:43:20.578218+0000","last_became_active":"2024-05-21T14:43:19.613429+0000","last_became_peered":"2024-05-21T14:43:19.613429+0000","last_unstale":"2024-05-21T14:43:20.578218+0000","last_undegraded":"2024-05-21T14:43:20.578218+0000","last_fullsized":"2024-05-21T14:43:20.578218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:29:16.905434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066956+0000","last_change":"2024-05-21T14:43:19.607400+0000","last_active":"2024-05-21T14:43:21.066956+0000","last_peered":"2024-05-21T14:43:21.066956+0000","last_clean":"2024-05-21T14:43:21.066956+0000","last_became_active":"2024-05-21T14:43:19.607105+0000","last_became_peered":"2024-05-21T14:43:19.607105+0000","last_unstale":"2024-05-21T14:43:21.066956+0000","last_undegraded":"2024-05-21T14:43:21.066956+0000","last_fullsized":"2024-05-21T14:43:21.066956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:26:22.366105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066810+0000","last_change":"2024-05-21T14:43:19.606534+0000","last_active":"2024-05-21T14:43:21.066810+0000","last_peered":"2024-05-21T14:43:21.066810+0000","last_clean":"2024-05-21T14:43:21.066810+0000","last_became_active":"2024-05-21T14:43:19.606029+0000","last_became_peered":"2024-05-21T14:43:19.606029+0000","last_unstale":"2024-05-21T14:43:21.066810+0000","last_undegraded":"2024-05-21T14:43:21.066810+0000","last_fullsized":"2024-05-21T14:43:21.066810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:33:48.849701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066546+0000","last_change":"2024-05-21T14:43:19.609910+0000","last_active":"2024-05-21T14:43:21.066546+0000","last_peered":"2024-05-21T14:43:21.066546+0000","last_clean":"2024-05-21T14:43:21.066546+0000","last_became_active":"2024-05-21T14:43:19.609616+0000","last_became_peered":"2024-05-21T14:43:19.609616+0000","last_unstale":"2024-05-21T14:43:21.066546+0000","last_undegraded":"2024-05-21T14:43:21.066546+0000","last_fullsized":"2024-05-21T14:43:21.066546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:36:16.637620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.581855+0000","last_change":"2024-05-21T14:43:19.604001+0000","last_active":"2024-05-21T14:43:20.581855+0000","last_peered":"2024-05-21T14:43:20.581855+0000","last_clean":"2024-05-21T14:43:20.581855+0000","last_became_active":"2024-05-21T14:43:19.596859+0000","last_became_peered":"2024-05-21T14:43:19.596859+0000","last_unstale":"2024-05-21T14:43:20.581855+0000","last_undegraded":"2024-05-21T14:43:20.581855+0000","last_fullsized":"2024-05-21T14:43:20.581855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:45:43.431420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580379+0000","last_change":"2024-05-21T14:43:19.626837+0000","last_active":"2024-05-21T14:43:20.580379+0000","last_peered":"2024-05-21T14:43:20.580379+0000","last_clean":"2024-05-21T14:43:20.580379+0000","last_became_active":"2024-05-21T14:43:19.626213+0000","last_became_peered":"2024-05-21T14:43:19.626213+0000","last_unstale":"2024-05-21T14:43:20.580379+0000","last_undegraded":"2024-05-21T14:43:20.580379+0000","last_fullsized":"2024-05-21T14:43:20.580379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:51.705474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066538+0000","last_change":"2024-05-21T14:43:19.613483+0000","last_active":"2024-05-21T14:43:21.066538+0000","last_peered":"2024-05-21T14:43:21.066538+0000","last_clean":"2024-05-21T14:43:21.066538+0000","last_became_active":"2024-05-21T14:43:19.612581+0000","last_became_peered":"2024-05-21T14:43:19.612581+0000","last_unstale":"2024-05-21T14:43:21.066538+0000","last_undegraded":"2024-05-21T14:43:21.066538+0000","last_fullsized":"2024-05-21T14:43:21.066538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:41:15.797196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797569+0000","last_change":"2024-05-21T14:43:19.609126+0000","last_active":"2024-05-21T14:43:20.797569+0000","last_peered":"2024-05-21T14:43:20.797569+0000","last_clean":"2024-05-21T14:43:20.797569+0000","last_became_active":"2024-05-21T14:43:19.607967+0000","last_became_peered":"2024-05-21T14:43:19.607967+0000","last_unstale":"2024-05-21T14:43:20.797569+0000","last_undegraded":"2024-05-21T14:43:20.797569+0000","last_fullsized":"2024-05-21T14:43:20.797569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:35.881039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798283+0000","last_change":"2024-05-21T14:43:19.613487+0000","last_active":"2024-05-21T14:43:20.798283+0000","last_peered":"2024-05-21T14:43:20.798283+0000","last_clean":"2024-05-21T14:43:20.798283+0000","last_became_active":"2024-05-21T14:43:19.611280+0000","last_became_peered":"2024-05-21T14:43:19.611280+0000","last_unstale":"2024-05-21T14:43:20.798283+0000","last_undegraded":"2024-05-21T14:43:20.798283+0000","last_fullsized":"2024-05-21T14:43:20.798283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:51:21.887715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.807337+0000","last_change":"2024-05-21T14:43:19.607601+0000","last_active":"2024-05-21T14:43:58.807337+0000","last_peered":"2024-05-21T14:43:58.807337+0000","last_clean":"2024-05-21T14:43:58.807337+0000","last_became_active":"2024-05-21T14:43:19.606719+0000","last_became_peered":"2024-05-21T14:43:19.606719+0000","last_unstale":"2024-05-21T14:43:58.807337+0000","last_undegraded":"2024-05-21T14:43:58.807337+0000","last_fullsized":"2024-05-21T14:43:58.807337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:04:32.310805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798234+0000","last_change":"2024-05-21T14:43:19.618470+0000","last_active":"2024-05-21T14:43:20.798234+0000","last_peered":"2024-05-21T14:43:20.798234+0000","last_clean":"2024-05-21T14:43:20.798234+0000","last_became_active":"2024-05-21T14:43:19.617408+0000","last_became_peered":"2024-05-21T14:43:19.617408+0000","last_unstale":"2024-05-21T14:43:20.798234+0000","last_undegraded":"2024-05-21T14:43:20.798234+0000","last_fullsized":"2024-05-21T14:43:20.798234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:53:58.877306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066709+0000","last_change":"2024-05-21T14:43:19.609835+0000","last_active":"2024-05-21T14:43:21.066709+0000","last_peered":"2024-05-21T14:43:21.066709+0000","last_clean":"2024-05-21T14:43:21.066709+0000","last_became_active":"2024-05-21T14:43:19.609525+0000","last_became_peered":"2024-05-21T14:43:19.609525+0000","last_unstale":"2024-05-21T14:43:21.066709+0000","last_undegraded":"2024-05-21T14:43:21.066709+0000","last_fullsized":"2024-05-21T14:43:21.066709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:57:04.748898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963454+0000","last_change":"2024-05-21T14:43:19.607732+0000","last_active":"2024-05-21T14:43:20.963454+0000","last_peered":"2024-05-21T14:43:20.963454+0000","last_clean":"2024-05-21T14:43:20.963454+0000","last_became_active":"2024-05-21T14:43:19.606839+0000","last_became_peered":"2024-05-21T14:43:19.606839+0000","last_unstale":"2024-05-21T14:43:20.963454+0000","last_undegraded":"2024-05-21T14:43:20.963454+0000","last_fullsized":"2024-05-21T14:43:20.963454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:43:15.675663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578145+0000","last_change":"2024-05-21T14:43:19.601108+0000","last_active":"2024-05-21T14:43:20.578145+0000","last_peered":"2024-05-21T14:43:20.578145+0000","last_clean":"2024-05-21T14:43:20.578145+0000","last_became_active":"2024-05-21T14:43:19.600780+0000","last_became_peered":"2024-05-21T14:43:19.600780+0000","last_unstale":"2024-05-21T14:43:20.578145+0000","last_undegraded":"2024-05-21T14:43:20.578145+0000","last_fullsized":"2024-05-21T14:43:20.578145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:47:19.062733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067184+0000","last_change":"2024-05-21T14:43:19.620463+0000","last_active":"2024-05-21T14:43:21.067184+0000","last_peered":"2024-05-21T14:43:21.067184+0000","last_clean":"2024-05-21T14:43:21.067184+0000","last_became_active":"2024-05-21T14:43:19.614489+0000","last_became_peered":"2024-05-21T14:43:19.614489+0000","last_unstale":"2024-05-21T14:43:21.067184+0000","last_undegraded":"2024-05-21T14:43:21.067184+0000","last_fullsized":"2024-05-21T14:43:21.067184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:51:07.953352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797590+0000","last_change":"2024-05-21T14:43:19.624683+0000","last_active":"2024-05-21T14:43:20.797590+0000","last_peered":"2024-05-21T14:43:20.797590+0000","last_clean":"2024-05-21T14:43:20.797590+0000","last_became_active":"2024-05-21T14:43:19.624304+0000","last_became_peered":"2024-05-21T14:43:19.624304+0000","last_unstale":"2024-05-21T14:43:20.797590+0000","last_undegraded":"2024-05-21T14:43:20.797590+0000","last_fullsized":"2024-05-21T14:43:20.797590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:53.874968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067763+0000","last_change":"2024-05-21T14:43:19.621030+0000","last_active":"2024-05-21T14:43:21.067763+0000","last_peered":"2024-05-21T14:43:21.067763+0000","last_clean":"2024-05-21T14:43:21.067763+0000","last_became_active":"2024-05-21T14:43:19.619072+0000","last_became_peered":"2024-05-21T14:43:19.619072+0000","last_unstale":"2024-05-21T14:43:21.067763+0000","last_undegraded":"2024-05-21T14:43:21.067763+0000","last_fullsized":"2024-05-21T14:43:21.067763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:22:09.423661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066417+0000","last_change":"2024-05-21T14:43:19.602880+0000","last_active":"2024-05-21T14:43:21.066417+0000","last_peered":"2024-05-21T14:43:21.066417+0000","last_clean":"2024-05-21T14:43:21.066417+0000","last_became_active":"2024-05-21T14:43:19.602577+0000","last_became_peered":"2024-05-21T14:43:19.602577+0000","last_unstale":"2024-05-21T14:43:21.066417+0000","last_undegraded":"2024-05-21T14:43:21.066417+0000","last_fullsized":"2024-05-21T14:43:21.066417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:04:10.094373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582914+0000","last_change":"2024-05-21T14:43:19.632328+0000","last_active":"2024-05-21T14:43:20.582914+0000","last_peered":"2024-05-21T14:43:20.582914+0000","last_clean":"2024-05-21T14:43:20.582914+0000","last_became_active":"2024-05-21T14:43:19.631351+0000","last_became_peered":"2024-05-21T14:43:19.631351+0000","last_unstale":"2024-05-21T14:43:20.582914+0000","last_undegraded":"2024-05-21T14:43:20.582914+0000","last_fullsized":"2024-05-21T14:43:20.582914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:36:18.467070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582481+0000","last_change":"2024-05-21T14:43:19.632282+0000","last_active":"2024-05-21T14:43:20.582481+0000","last_peered":"2024-05-21T14:43:20.582481+0000","last_clean":"2024-05-21T14:43:20.582481+0000","last_became_active":"2024-05-21T14:43:19.631522+0000","last_became_peered":"2024-05-21T14:43:19.631522+0000","last_unstale":"2024-05-21T14:43:20.582481+0000","last_undegraded":"2024-05-21T14:43:20.582481+0000","last_fullsized":"2024-05-21T14:43:20.582481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:23:32.646087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067227+0000","last_change":"2024-05-21T14:43:19.620046+0000","last_active":"2024-05-21T14:43:21.067227+0000","last_peered":"2024-05-21T14:43:21.067227+0000","last_clean":"2024-05-21T14:43:21.067227+0000","last_became_active":"2024-05-21T14:43:19.612428+0000","last_became_peered":"2024-05-21T14:43:19.612428+0000","last_unstale":"2024-05-21T14:43:21.067227+0000","last_undegraded":"2024-05-21T14:43:21.067227+0000","last_fullsized":"2024-05-21T14:43:21.067227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:08:33.785399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797667+0000","last_change":"2024-05-21T14:43:19.618198+0000","last_active":"2024-05-21T14:43:20.797667+0000","last_peered":"2024-05-21T14:43:20.797667+0000","last_clean":"2024-05-21T14:43:20.797667+0000","last_became_active":"2024-05-21T14:43:19.617903+0000","last_became_peered":"2024-05-21T14:43:19.617903+0000","last_unstale":"2024-05-21T14:43:20.797667+0000","last_undegraded":"2024-05-21T14:43:20.797667+0000","last_fullsized":"2024-05-21T14:43:20.797667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:59.606862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.805397+0000","last_change":"2024-05-21T14:43:19.613942+0000","last_active":"2024-05-21T14:43:58.805397+0000","last_peered":"2024-05-21T14:43:58.805397+0000","last_clean":"2024-05-21T14:43:58.805397+0000","last_became_active":"2024-05-21T14:43:19.613035+0000","last_became_peered":"2024-05-21T14:43:19.613035+0000","last_unstale":"2024-05-21T14:43:58.805397+0000","last_undegraded":"2024-05-21T14:43:58.805397+0000","last_fullsized":"2024-05-21T14:43:58.805397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:47:46.462547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.065907+0000","last_change":"2024-05-21T14:43:19.626414+0000","last_active":"2024-05-21T14:43:21.065907+0000","last_peered":"2024-05-21T14:43:21.065907+0000","last_clean":"2024-05-21T14:43:21.065907+0000","last_became_active":"2024-05-21T14:43:19.626080+0000","last_became_peered":"2024-05-21T14:43:19.626080+0000","last_unstale":"2024-05-21T14:43:21.065907+0000","last_undegraded":"2024-05-21T14:43:21.065907+0000","last_fullsized":"2024-05-21T14:43:21.065907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:37:38.449284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578382+0000","last_change":"2024-05-21T14:43:19.620806+0000","last_active":"2024-05-21T14:43:20.578382+0000","last_peered":"2024-05-21T14:43:20.578382+0000","last_clean":"2024-05-21T14:43:20.578382+0000","last_became_active":"2024-05-21T14:43:19.620449+0000","last_became_peered":"2024-05-21T14:43:19.620449+0000","last_unstale":"2024-05-21T14:43:20.578382+0000","last_undegraded":"2024-05-21T14:43:20.578382+0000","last_fullsized":"2024-05-21T14:43:20.578382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:43:52.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:29.674250+0000","last_change":"2024-05-21T14:43:18.603028+0000","last_active":"2024-05-21T14:43:29.674250+0000","last_peered":"2024-05-21T14:43:29.674250+0000","last_clean":"2024-05-21T14:43:29.674250+0000","last_became_active":"2024-05-21T14:43:18.602036+0000","last_became_peered":"2024-05-21T14:43:18.602036+0000","last_unstale":"2024-05-21T14:43:29.674250+0000","last_undegraded":"2024-05-21T14:43:29.674250+0000","last_fullsized":"2024-05-21T14:43:29.674250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:15:25.384197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963922+0000","last_change":"2024-05-21T14:43:19.599725+0000","last_active":"2024-05-21T14:43:20.963922+0000","last_peered":"2024-05-21T14:43:20.963922+0000","last_clean":"2024-05-21T14:43:20.963922+0000","last_became_active":"2024-05-21T14:43:19.598972+0000","last_became_peered":"2024-05-21T14:43:19.598972+0000","last_unstale":"2024-05-21T14:43:20.963922+0000","last_undegraded":"2024-05-21T14:43:20.963922+0000","last_fullsized":"2024-05-21T14:43:20.963922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:54:00.871046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'7","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.746826+0000","last_change":"2024-05-21T14:43:18.615934+0000","last_active":"2024-05-21T14:43:41.746826+0000","last_peered":"2024-05-21T14:43:41.746826+0000","last_clean":"2024-05-21T14:43:41.746826+0000","last_became_active":"2024-05-21T14:43:18.615568+0000","last_became_peered":"2024-05-21T14:43:18.615568+0000","last_unstale":"2024-05-21T14:43:41.746826+0000","last_undegraded":"2024-05-21T14:43:41.746826+0000","last_fullsized":"2024-05-21T14:43:41.746826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:28:54.494319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:35.724343+0000","last_change":"2024-05-21T14:43:18.615154+0000","last_active":"2024-05-21T14:43:35.724343+0000","last_peered":"2024-05-21T14:43:35.724343+0000","last_clean":"2024-05-21T14:43:35.724343+0000","last_became_active":"2024-05-21T14:43:18.613838+0000","last_became_peered":"2024-05-21T14:43:18.613838+0000","last_unstale":"2024-05-21T14:43:35.724343+0000","last_undegraded":"2024-05-21T14:43:35.724343+0000","last_fullsized":"2024-05-21T14:43:35.724343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:32:09.174124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067194+0000","last_change":"2024-05-21T14:43:19.633585+0000","last_active":"2024-05-21T14:43:21.067194+0000","last_peered":"2024-05-21T14:43:21.067194+0000","last_clean":"2024-05-21T14:43:21.067194+0000","last_became_active":"2024-05-21T14:43:19.632476+0000","last_became_peered":"2024-05-21T14:43:19.632476+0000","last_unstale":"2024-05-21T14:43:21.067194+0000","last_undegraded":"2024-05-21T14:43:21.067194+0000","last_fullsized":"2024-05-21T14:43:21.067194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:53.023931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.745819+0000","last_change":"2024-05-21T14:43:18.585548+0000","last_active":"2024-05-21T14:43:41.745819+0000","last_peered":"2024-05-21T14:43:41.745819+0000","last_clean":"2024-05-21T14:43:41.745819+0000","last_became_active":"2024-05-21T14:43:18.585099+0000","last_became_peered":"2024-05-21T14:43:18.585099+0000","last_unstale":"2024-05-21T14:43:41.745819+0000","last_undegraded":"2024-05-21T14:43:41.745819+0000","last_fullsized":"2024-05-21T14:43:41.745819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:20:16.856225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963459+0000","last_change":"2024-05-21T14:43:19.614884+0000","last_active":"2024-05-21T14:43:20.963459+0000","last_peered":"2024-05-21T14:43:20.963459+0000","last_clean":"2024-05-21T14:43:20.963459+0000","last_became_active":"2024-05-21T14:43:19.614064+0000","last_became_peered":"2024-05-21T14:43:19.614064+0000","last_unstale":"2024-05-21T14:43:20.963459+0000","last_undegraded":"2024-05-21T14:43:20.963459+0000","last_fullsized":"2024-05-21T14:43:20.963459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:42:17.091043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:29.681041+0000","last_change":"2024-05-21T14:43:18.602794+0000","last_active":"2024-05-21T14:43:29.681041+0000","last_peered":"2024-05-21T14:43:29.681041+0000","last_clean":"2024-05-21T14:43:29.681041+0000","last_became_active":"2024-05-21T14:43:18.602429+0000","last_became_peered":"2024-05-21T14:43:18.602429+0000","last_unstale":"2024-05-21T14:43:29.681041+0000","last_undegraded":"2024-05-21T14:43:29.681041+0000","last_fullsized":"2024-05-21T14:43:29.681041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:50:14.465202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066483+0000","last_change":"2024-05-21T14:43:19.602663+0000","last_active":"2024-05-21T14:43:21.066483+0000","last_peered":"2024-05-21T14:43:21.066483+0000","last_clean":"2024-05-21T14:43:21.066483+0000","last_became_active":"2024-05-21T14:43:19.602294+0000","last_became_peered":"2024-05-21T14:43:19.602294+0000","last_unstale":"2024-05-21T14:43:21.066483+0000","last_undegraded":"2024-05-21T14:43:21.066483+0000","last_fullsized":"2024-05-21T14:43:21.066483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:48:56.271741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.769548+0000","last_change":"2024-05-21T14:43:18.604601+0000","last_active":"2024-05-21T14:43:47.769548+0000","last_peered":"2024-05-21T14:43:47.769548+0000","last_clean":"2024-05-21T14:43:47.769548+0000","last_became_active":"2024-05-21T14:43:18.604262+0000","last_became_peered":"2024-05-21T14:43:18.604262+0000","last_unstale":"2024-05-21T14:43:47.769548+0000","last_undegraded":"2024-05-21T14:43:47.769548+0000","last_fullsized":"2024-05-21T14:43:47.769548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:15.490579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.068019+0000","last_change":"2024-05-21T14:43:19.613952+0000","last_active":"2024-05-21T14:43:21.068019+0000","last_peered":"2024-05-21T14:43:21.068019+0000","last_clean":"2024-05-21T14:43:21.068019+0000","last_became_active":"2024-05-21T14:43:19.613093+0000","last_became_peered":"2024-05-21T14:43:19.613093+0000","last_unstale":"2024-05-21T14:43:21.068019+0000","last_undegraded":"2024-05-21T14:43:21.068019+0000","last_fullsized":"2024-05-21T14:43:21.068019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:03:44.925212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'5","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.806914+0000","last_change":"2024-05-21T14:43:18.602343+0000","last_active":"2024-05-21T14:43:58.806914+0000","last_peered":"2024-05-21T14:43:58.806914+0000","last_clean":"2024-05-21T14:43:58.806914+0000","last_became_active":"2024-05-21T14:43:18.601500+0000","last_became_peered":"2024-05-21T14:43:18.601500+0000","last_unstale":"2024-05-21T14:43:58.806914+0000","last_undegraded":"2024-05-21T14:43:58.806914+0000","last_fullsized":"2024-05-21T14:43:58.806914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:54:21.960430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798025+0000","last_change":"2024-05-21T14:43:19.608580+0000","last_active":"2024-05-21T14:43:20.798025+0000","last_peered":"2024-05-21T14:43:20.798025+0000","last_clean":"2024-05-21T14:43:20.798025+0000","last_became_active":"2024-05-21T14:43:19.608038+0000","last_became_peered":"2024-05-21T14:43:19.608038+0000","last_unstale":"2024-05-21T14:43:20.798025+0000","last_undegraded":"2024-05-21T14:43:20.798025+0000","last_fullsized":"2024-05-21T14:43:20.798025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:19.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'10","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.768673+0000","last_change":"2024-05-21T14:43:18.606824+0000","last_active":"2024-05-21T14:43:47.768673+0000","last_peered":"2024-05-21T14:43:47.768673+0000","last_clean":"2024-05-21T14:43:47.768673+0000","last_became_active":"2024-05-21T14:43:18.606449+0000","last_became_peered":"2024-05-21T14:43:18.606449+0000","last_unstale":"2024-05-21T14:43:47.768673+0000","last_undegraded":"2024-05-21T14:43:47.768673+0000","last_fullsized":"2024-05-21T14:43:47.768673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:43:41.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066889+0000","last_change":"2024-05-21T14:43:19.634014+0000","last_active":"2024-05-21T14:43:21.066889+0000","last_peered":"2024-05-21T14:43:21.066889+0000","last_clean":"2024-05-21T14:43:21.066889+0000","last_became_active":"2024-05-21T14:43:19.633664+0000","last_became_peered":"2024-05-21T14:43:19.633664+0000","last_unstale":"2024-05-21T14:43:21.066889+0000","last_undegraded":"2024-05-21T14:43:21.066889+0000","last_fullsized":"2024-05-21T14:43:21.066889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:36:07.708164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.806114+0000","last_change":"2024-05-21T14:43:18.614764+0000","last_active":"2024-05-21T14:43:58.806114+0000","last_peered":"2024-05-21T14:43:58.806114+0000","last_clean":"2024-05-21T14:43:58.806114+0000","last_became_active":"2024-05-21T14:43:18.614214+0000","last_became_peered":"2024-05-21T14:43:18.614214+0000","last_unstale":"2024-05-21T14:43:58.806114+0000","last_undegraded":"2024-05-21T14:43:58.806114+0000","last_fullsized":"2024-05-21T14:43:58.806114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:34:40.294756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580771+0000","last_change":"2024-05-21T14:43:19.625313+0000","last_active":"2024-05-21T14:43:20.580771+0000","last_peered":"2024-05-21T14:43:20.580771+0000","last_clean":"2024-05-21T14:43:20.580771+0000","last_became_active":"2024-05-21T14:43:19.624474+0000","last_became_peered":"2024-05-21T14:43:19.624474+0000","last_unstale":"2024-05-21T14:43:20.580771+0000","last_undegraded":"2024-05-21T14:43:20.580771+0000","last_fullsized":"2024-05-21T14:43:20.580771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:28.280456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.746478+0000","last_change":"2024-05-21T14:43:18.600736+0000","last_active":"2024-05-21T14:43:41.746478+0000","last_peered":"2024-05-21T14:43:41.746478+0000","last_clean":"2024-05-21T14:43:41.746478+0000","last_became_active":"2024-05-21T14:43:18.600415+0000","last_became_peered":"2024-05-21T14:43:18.600415+0000","last_unstale":"2024-05-21T14:43:41.746478+0000","last_undegraded":"2024-05-21T14:43:41.746478+0000","last_fullsized":"2024-05-21T14:43:41.746478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:03:57.207603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797724+0000","last_change":"2024-05-21T14:43:19.599637+0000","last_active":"2024-05-21T14:43:20.797724+0000","last_peered":"2024-05-21T14:43:20.797724+0000","last_clean":"2024-05-21T14:43:20.797724+0000","last_became_active":"2024-05-21T14:43:19.599195+0000","last_became_peered":"2024-05-21T14:43:19.599195+0000","last_unstale":"2024-05-21T14:43:20.797724+0000","last_undegraded":"2024-05-21T14:43:20.797724+0000","last_fullsized":"2024-05-21T14:43:20.797724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:17.350821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.739415+0000","last_change":"2024-05-21T14:43:18.603064+0000","last_active":"2024-05-21T14:43:41.739415+0000","last_peered":"2024-05-21T14:43:41.739415+0000","last_clean":"2024-05-21T14:43:41.739415+0000","last_became_active":"2024-05-21T14:43:18.602658+0000","last_became_peered":"2024-05-21T14:43:18.602658+0000","last_unstale":"2024-05-21T14:43:41.739415+0000","last_undegraded":"2024-05-21T14:43:41.739415+0000","last_fullsized":"2024-05-21T14:43:41.739415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:09:28.623131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.577809+0000","last_change":"2024-05-21T14:43:19.620760+0000","last_active":"2024-05-21T14:43:20.577809+0000","last_peered":"2024-05-21T14:43:20.577809+0000","last_clean":"2024-05-21T14:43:20.577809+0000","last_became_active":"2024-05-21T14:43:19.620409+0000","last_became_peered":"2024-05-21T14:43:19.620409+0000","last_unstale":"2024-05-21T14:43:20.577809+0000","last_undegraded":"2024-05-21T14:43:20.577809+0000","last_fullsized":"2024-05-21T14:43:20.577809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:49:59.051131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'17","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.743219+0000","last_change":"2024-05-21T14:43:18.594225+0000","last_active":"2024-05-21T14:43:41.743219+0000","last_peered":"2024-05-21T14:43:41.743219+0000","last_clean":"2024-05-21T14:43:41.743219+0000","last_became_active":"2024-05-21T14:43:18.592335+0000","last_became_peered":"2024-05-21T14:43:18.592335+0000","last_unstale":"2024-05-21T14:43:41.743219+0000","last_undegraded":"2024-05-21T14:43:41.743219+0000","last_fullsized":"2024-05-21T14:43:41.743219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:00:58.772091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797667+0000","last_change":"2024-05-21T14:43:19.612442+0000","last_active":"2024-05-21T14:43:20.797667+0000","last_peered":"2024-05-21T14:43:20.797667+0000","last_clean":"2024-05-21T14:43:20.797667+0000","last_became_active":"2024-05-21T14:43:19.612110+0000","last_became_peered":"2024-05-21T14:43:19.612110+0000","last_unstale":"2024-05-21T14:43:20.797667+0000","last_undegraded":"2024-05-21T14:43:20.797667+0000","last_fullsized":"2024-05-21T14:43:20.797667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:53.451513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.590887+0000","last_change":"2024-05-21T14:43:18.613433+0000","last_active":"2024-05-21T14:43:24.590887+0000","last_peered":"2024-05-21T14:43:24.590887+0000","last_clean":"2024-05-21T14:43:24.590887+0000","last_became_active":"2024-05-21T14:43:18.613048+0000","last_became_peered":"2024-05-21T14:43:18.613048+0000","last_unstale":"2024-05-21T14:43:24.590887+0000","last_undegraded":"2024-05-21T14:43:24.590887+0000","last_fullsized":"2024-05-21T14:43:24.590887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:00:16.454574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066572+0000","last_change":"2024-05-21T14:43:19.597079+0000","last_active":"2024-05-21T14:43:21.066572+0000","last_peered":"2024-05-21T14:43:21.066572+0000","last_clean":"2024-05-21T14:43:21.066572+0000","last_became_active":"2024-05-21T14:43:19.596736+0000","last_became_peered":"2024-05-21T14:43:19.596736+0000","last_unstale":"2024-05-21T14:43:21.066572+0000","last_undegraded":"2024-05-21T14:43:21.066572+0000","last_fullsized":"2024-05-21T14:43:21.066572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:09:03.687971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.770686+0000","last_change":"2024-05-21T14:43:18.620603+0000","last_active":"2024-05-21T14:43:47.770686+0000","last_peered":"2024-05-21T14:43:47.770686+0000","last_clean":"2024-05-21T14:43:47.770686+0000","last_became_active":"2024-05-21T14:43:18.619762+0000","last_became_peered":"2024-05-21T14:43:18.619762+0000","last_unstale":"2024-05-21T14:43:47.770686+0000","last_undegraded":"2024-05-21T14:43:47.770686+0000","last_fullsized":"2024-05-21T14:43:47.770686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:31:49.257435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067100+0000","last_change":"2024-05-21T14:43:19.611608+0000","last_active":"2024-05-21T14:43:21.067100+0000","last_peered":"2024-05-21T14:43:21.067100+0000","last_clean":"2024-05-21T14:43:21.067100+0000","last_became_active":"2024-05-21T14:43:19.610774+0000","last_became_peered":"2024-05-21T14:43:19.610774+0000","last_unstale":"2024-05-21T14:43:21.067100+0000","last_undegraded":"2024-05-21T14:43:21.067100+0000","last_fullsized":"2024-05-21T14:43:21.067100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:19:00.383286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.741997+0000","last_change":"2024-05-21T14:43:18.610121+0000","last_active":"2024-05-21T14:43:41.741997+0000","last_peered":"2024-05-21T14:43:41.741997+0000","last_clean":"2024-05-21T14:43:41.741997+0000","last_became_active":"2024-05-21T14:43:18.609349+0000","last_became_peered":"2024-05-21T14:43:18.609349+0000","last_unstale":"2024-05-21T14:43:41.741997+0000","last_undegraded":"2024-05-21T14:43:41.741997+0000","last_fullsized":"2024-05-21T14:43:41.741997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:48.330067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066734+0000","last_change":"2024-05-21T14:43:19.605193+0000","last_active":"2024-05-21T14:43:21.066734+0000","last_peered":"2024-05-21T14:43:21.066734+0000","last_clean":"2024-05-21T14:43:21.066734+0000","last_became_active":"2024-05-21T14:43:19.604869+0000","last_became_peered":"2024-05-21T14:43:19.604869+0000","last_unstale":"2024-05-21T14:43:21.066734+0000","last_undegraded":"2024-05-21T14:43:21.066734+0000","last_fullsized":"2024-05-21T14:43:21.066734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:58:05.078363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.738314+0000","last_change":"2024-05-21T14:43:18.616535+0000","last_active":"2024-05-21T14:43:41.738314+0000","last_peered":"2024-05-21T14:43:41.738314+0000","last_clean":"2024-05-21T14:43:41.738314+0000","last_became_active":"2024-05-21T14:43:18.615734+0000","last_became_peered":"2024-05-21T14:43:18.615734+0000","last_unstale":"2024-05-21T14:43:41.738314+0000","last_undegraded":"2024-05-21T14:43:41.738314+0000","last_fullsized":"2024-05-21T14:43:41.738314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:10:27.821535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798116+0000","last_change":"2024-05-21T14:43:19.615424+0000","last_active":"2024-05-21T14:43:20.798116+0000","last_peered":"2024-05-21T14:43:20.798116+0000","last_clean":"2024-05-21T14:43:20.798116+0000","last_became_active":"2024-05-21T14:43:19.614915+0000","last_became_peered":"2024-05-21T14:43:19.614915+0000","last_unstale":"2024-05-21T14:43:20.798116+0000","last_undegraded":"2024-05-21T14:43:20.798116+0000","last_fullsized":"2024-05-21T14:43:20.798116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:25:09.153430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.577738+0000","last_change":"2024-05-21T14:43:08.080234+0000","last_active":"2024-05-21T14:43:20.577738+0000","last_peered":"2024-05-21T14:43:20.577738+0000","last_clean":"2024-05-21T14:43:20.577738+0000","last_became_active":"2024-05-21T14:43:08.079934+0000","last_became_peered":"2024-05-21T14:43:08.079934+0000","last_unstale":"2024-05-21T14:43:20.577738+0000","last_undegraded":"2024-05-21T14:43:20.577738+0000","last_fullsized":"2024-05-21T14:43:20.577738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_clean_scrub_stamp":"2024-05-21T14:43:07.046978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:54:57.347768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.746452+0000","last_change":"2024-05-21T14:43:18.599850+0000","last_active":"2024-05-21T14:43:41.746452+0000","last_peered":"2024-05-21T14:43:41.746452+0000","last_clean":"2024-05-21T14:43:41.746452+0000","last_became_active":"2024-05-21T14:43:18.599347+0000","last_became_peered":"2024-05-21T14:43:18.599347+0000","last_unstale":"2024-05-21T14:43:41.746452+0000","last_undegraded":"2024-05-21T14:43:41.746452+0000","last_fullsized":"2024-05-21T14:43:41.746452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:01:06.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963423+0000","last_change":"2024-05-21T14:43:19.613056+0000","last_active":"2024-05-21T14:43:20.963423+0000","last_peered":"2024-05-21T14:43:20.963423+0000","last_clean":"2024-05-21T14:43:20.963423+0000","last_became_active":"2024-05-21T14:43:19.611889+0000","last_became_peered":"2024-05-21T14:43:19.611889+0000","last_unstale":"2024-05-21T14:43:20.963423+0000","last_undegraded":"2024-05-21T14:43:20.963423+0000","last_fullsized":"2024-05-21T14:43:20.963423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:46:20.105282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:35.726262+0000","last_change":"2024-05-21T14:43:18.621482+0000","last_active":"2024-05-21T14:43:35.726262+0000","last_peered":"2024-05-21T14:43:35.726262+0000","last_clean":"2024-05-21T14:43:35.726262+0000","last_became_active":"2024-05-21T14:43:18.621229+0000","last_became_peered":"2024-05-21T14:43:18.621229+0000","last_unstale":"2024-05-21T14:43:35.726262+0000","last_undegraded":"2024-05-21T14:43:35.726262+0000","last_fullsized":"2024-05-21T14:43:35.726262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:30:04.326588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.580381+0000","last_change":"2024-05-21T14:43:19.625038+0000","last_active":"2024-05-21T14:43:20.580381+0000","last_peered":"2024-05-21T14:43:20.580381+0000","last_clean":"2024-05-21T14:43:20.580381+0000","last_became_active":"2024-05-21T14:43:19.624114+0000","last_became_peered":"2024-05-21T14:43:19.624114+0000","last_unstale":"2024-05-21T14:43:20.580381+0000","last_undegraded":"2024-05-21T14:43:20.580381+0000","last_fullsized":"2024-05-21T14:43:20.580381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:11.854243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'5","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.805088+0000","last_change":"2024-05-21T14:43:18.618518+0000","last_active":"2024-05-21T14:43:58.805088+0000","last_peered":"2024-05-21T14:43:58.805088+0000","last_clean":"2024-05-21T14:43:58.805088+0000","last_became_active":"2024-05-21T14:43:18.617756+0000","last_became_peered":"2024-05-21T14:43:18.617756+0000","last_unstale":"2024-05-21T14:43:58.805088+0000","last_undegraded":"2024-05-21T14:43:58.805088+0000","last_fullsized":"2024-05-21T14:43:58.805088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:52:12.999877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066783+0000","last_change":"2024-05-21T14:43:19.613595+0000","last_active":"2024-05-21T14:43:21.066783+0000","last_peered":"2024-05-21T14:43:21.066783+0000","last_clean":"2024-05-21T14:43:21.066783+0000","last_became_active":"2024-05-21T14:43:19.612730+0000","last_became_peered":"2024-05-21T14:43:19.612730+0000","last_unstale":"2024-05-21T14:43:21.066783+0000","last_undegraded":"2024-05-21T14:43:21.066783+0000","last_fullsized":"2024-05-21T14:43:21.066783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:01:02.847071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.773237+0000","last_change":"2024-05-21T14:43:18.608596+0000","last_active":"2024-05-21T14:43:47.773237+0000","last_peered":"2024-05-21T14:43:47.773237+0000","last_clean":"2024-05-21T14:43:47.773237+0000","last_became_active":"2024-05-21T14:43:18.608262+0000","last_became_peered":"2024-05-21T14:43:18.608262+0000","last_unstale":"2024-05-21T14:43:47.773237+0000","last_undegraded":"2024-05-21T14:43:47.773237+0000","last_fullsized":"2024-05-21T14:43:47.773237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:14.962554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066581+0000","last_change":"2024-05-21T14:43:19.607815+0000","last_active":"2024-05-21T14:43:21.066581+0000","last_peered":"2024-05-21T14:43:21.066581+0000","last_clean":"2024-05-21T14:43:21.066581+0000","last_became_active":"2024-05-21T14:43:19.607513+0000","last_became_peered":"2024-05-21T14:43:19.607513+0000","last_unstale":"2024-05-21T14:43:21.066581+0000","last_undegraded":"2024-05-21T14:43:21.066581+0000","last_fullsized":"2024-05-21T14:43:21.066581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:01:35.332981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066943+0000","last_change":"2024-05-21T14:43:18.603626+0000","last_active":"2024-05-21T14:43:21.066943+0000","last_peered":"2024-05-21T14:43:21.066943+0000","last_clean":"2024-05-21T14:43:21.066943+0000","last_became_active":"2024-05-21T14:43:18.602704+0000","last_became_peered":"2024-05-21T14:43:18.602704+0000","last_unstale":"2024-05-21T14:43:21.066943+0000","last_undegraded":"2024-05-21T14:43:21.066943+0000","last_fullsized":"2024-05-21T14:43:21.066943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:03.976820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.066240+0000","last_change":"2024-05-21T14:43:19.634449+0000","last_active":"2024-05-21T14:43:21.066240+0000","last_peered":"2024-05-21T14:43:21.066240+0000","last_clean":"2024-05-21T14:43:21.066240+0000","last_became_active":"2024-05-21T14:43:19.633751+0000","last_became_peered":"2024-05-21T14:43:19.633751+0000","last_unstale":"2024-05-21T14:43:21.066240+0000","last_undegraded":"2024-05-21T14:43:21.066240+0000","last_fullsized":"2024-05-21T14:43:21.066240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:04:51.415303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.747266+0000","last_change":"2024-05-21T14:43:18.608335+0000","last_active":"2024-05-21T14:43:41.747266+0000","last_peered":"2024-05-21T14:43:41.747266+0000","last_clean":"2024-05-21T14:43:41.747266+0000","last_became_active":"2024-05-21T14:43:18.607999+0000","last_became_peered":"2024-05-21T14:43:18.607999+0000","last_unstale":"2024-05-21T14:43:41.747266+0000","last_undegraded":"2024-05-21T14:43:41.747266+0000","last_fullsized":"2024-05-21T14:43:41.747266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:21.325953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.582549+0000","last_change":"2024-05-21T14:43:19.626742+0000","last_active":"2024-05-21T14:43:20.582549+0000","last_peered":"2024-05-21T14:43:20.582549+0000","last_clean":"2024-05-21T14:43:20.582549+0000","last_became_active":"2024-05-21T14:43:19.626024+0000","last_became_peered":"2024-05-21T14:43:19.626024+0000","last_unstale":"2024-05-21T14:43:20.582549+0000","last_undegraded":"2024-05-21T14:43:20.582549+0000","last_fullsized":"2024-05-21T14:43:20.582549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:48:15.426224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'7","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.743462+0000","last_change":"2024-05-21T14:43:18.616913+0000","last_active":"2024-05-21T14:43:41.743462+0000","last_peered":"2024-05-21T14:43:41.743462+0000","last_clean":"2024-05-21T14:43:41.743462+0000","last_became_active":"2024-05-21T14:43:18.616214+0000","last_became_peered":"2024-05-21T14:43:18.616214+0000","last_unstale":"2024-05-21T14:43:41.743462+0000","last_undegraded":"2024-05-21T14:43:41.743462+0000","last_fullsized":"2024-05-21T14:43:41.743462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:22.112018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.963796+0000","last_change":"2024-05-21T14:43:19.607521+0000","last_active":"2024-05-21T14:43:20.963796+0000","last_peered":"2024-05-21T14:43:20.963796+0000","last_clean":"2024-05-21T14:43:20.963796+0000","last_became_active":"2024-05-21T14:43:19.606673+0000","last_became_peered":"2024-05-21T14:43:19.606673+0000","last_unstale":"2024-05-21T14:43:20.963796+0000","last_undegraded":"2024-05-21T14:43:20.963796+0000","last_fullsized":"2024-05-21T14:43:20.963796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:50:50.373410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'7","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.768063+0000","last_change":"2024-05-21T14:43:18.615846+0000","last_active":"2024-05-21T14:43:47.768063+0000","last_peered":"2024-05-21T14:43:47.768063+0000","last_clean":"2024-05-21T14:43:47.768063+0000","last_became_active":"2024-05-21T14:43:18.615506+0000","last_became_peered":"2024-05-21T14:43:18.615506+0000","last_unstale":"2024-05-21T14:43:47.768063+0000","last_undegraded":"2024-05-21T14:43:47.768063+0000","last_fullsized":"2024-05-21T14:43:47.768063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:07:17.030757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.964252+0000","last_change":"2024-05-21T14:43:19.611473+0000","last_active":"2024-05-21T14:43:20.964252+0000","last_peered":"2024-05-21T14:43:20.964252+0000","last_clean":"2024-05-21T14:43:20.964252+0000","last_became_active":"2024-05-21T14:43:19.610600+0000","last_became_peered":"2024-05-21T14:43:19.610600+0000","last_unstale":"2024-05-21T14:43:20.964252+0000","last_undegraded":"2024-05-21T14:43:20.964252+0000","last_fullsized":"2024-05-21T14:43:20.964252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:48:07.659795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:29.679809+0000","last_change":"2024-05-21T14:43:18.604951+0000","last_active":"2024-05-21T14:43:29.679809+0000","last_peered":"2024-05-21T14:43:29.679809+0000","last_clean":"2024-05-21T14:43:29.679809+0000","last_became_active":"2024-05-21T14:43:18.602186+0000","last_became_peered":"2024-05-21T14:43:18.602186+0000","last_unstale":"2024-05-21T14:43:29.679809+0000","last_undegraded":"2024-05-21T14:43:29.679809+0000","last_fullsized":"2024-05-21T14:43:29.679809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:34:10.395484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797647+0000","last_change":"2024-05-21T14:43:19.600827+0000","last_active":"2024-05-21T14:43:20.797647+0000","last_peered":"2024-05-21T14:43:20.797647+0000","last_clean":"2024-05-21T14:43:20.797647+0000","last_became_active":"2024-05-21T14:43:19.600499+0000","last_became_peered":"2024-05-21T14:43:19.600499+0000","last_unstale":"2024-05-21T14:43:20.797647+0000","last_undegraded":"2024-05-21T14:43:20.797647+0000","last_fullsized":"2024-05-21T14:43:20.797647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:55:36.231321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'7","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.769353+0000","last_change":"2024-05-21T14:43:18.615190+0000","last_active":"2024-05-21T14:43:47.769353+0000","last_peered":"2024-05-21T14:43:47.769353+0000","last_clean":"2024-05-21T14:43:47.769353+0000","last_became_active":"2024-05-21T14:43:18.614306+0000","last_became_peered":"2024-05-21T14:43:18.614306+0000","last_unstale":"2024-05-21T14:43:47.769353+0000","last_undegraded":"2024-05-21T14:43:47.769353+0000","last_fullsized":"2024-05-21T14:43:47.769353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:53.472559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.962948+0000","last_change":"2024-05-21T14:43:19.610903+0000","last_active":"2024-05-21T14:43:20.962948+0000","last_peered":"2024-05-21T14:43:20.962948+0000","last_clean":"2024-05-21T14:43:20.962948+0000","last_became_active":"2024-05-21T14:43:19.610101+0000","last_became_peered":"2024-05-21T14:43:19.610101+0000","last_unstale":"2024-05-21T14:43:20.962948+0000","last_undegraded":"2024-05-21T14:43:20.962948+0000","last_fullsized":"2024-05-21T14:43:20.962948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:16:24.580581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:41.740216+0000","last_change":"2024-05-21T14:43:18.617785+0000","last_active":"2024-05-21T14:43:41.740216+0000","last_peered":"2024-05-21T14:43:41.740216+0000","last_clean":"2024-05-21T14:43:41.740216+0000","last_became_active":"2024-05-21T14:43:18.617041+0000","last_became_peered":"2024-05-21T14:43:18.617041+0000","last_unstale":"2024-05-21T14:43:41.740216+0000","last_undegraded":"2024-05-21T14:43:41.740216+0000","last_fullsized":"2024-05-21T14:43:41.740216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:02:50.837158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-21T14:43:58.805753+0000","last_change":"2024-05-21T14:43:19.627096+0000","last_active":"2024-05-21T14:43:58.805753+0000","last_peered":"2024-05-21T14:43:58.805753+0000","last_clean":"2024-05-21T14:43:58.805753+0000","last_became_active":"2024-05-21T14:43:19.626265+0000","last_became_peered":"2024-05-21T14:43:19.626265+0000","last_unstale":"2024-05-21T14:43:58.805753+0000","last_undegraded":"2024-05-21T14:43:58.805753+0000","last_fullsized":"2024-05-21T14:43:58.805753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:23:47.818120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:29.698283+0000","last_change":"2024-05-21T14:43:18.599635+0000","last_active":"2024-05-21T14:43:29.698283+0000","last_peered":"2024-05-21T14:43:29.698283+0000","last_clean":"2024-05-21T14:43:29.698283+0000","last_became_active":"2024-05-21T14:43:18.598996+0000","last_became_peered":"2024-05-21T14:43:18.598996+0000","last_unstale":"2024-05-21T14:43:29.698283+0000","last_undegraded":"2024-05-21T14:43:29.698283+0000","last_fullsized":"2024-05-21T14:43:29.698283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:17:09.383291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.797767+0000","last_change":"2024-05-21T14:43:19.617686+0000","last_active":"2024-05-21T14:43:20.797767+0000","last_peered":"2024-05-21T14:43:20.797767+0000","last_clean":"2024-05-21T14:43:20.797767+0000","last_became_active":"2024-05-21T14:43:19.617398+0000","last_became_peered":"2024-05-21T14:43:19.617398+0000","last_unstale":"2024-05-21T14:43:20.797767+0000","last_undegraded":"2024-05-21T14:43:20.797767+0000","last_fullsized":"2024-05-21T14:43:20.797767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:21:06.527871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.798047+0000","last_change":"2024-05-21T14:43:19.601673+0000","last_active":"2024-05-21T14:43:20.798047+0000","last_peered":"2024-05-21T14:43:20.798047+0000","last_clean":"2024-05-21T14:43:20.798047+0000","last_became_active":"2024-05-21T14:43:19.601286+0000","last_became_peered":"2024-05-21T14:43:19.601286+0000","last_unstale":"2024-05-21T14:43:20.798047+0000","last_undegraded":"2024-05-21T14:43:20.798047+0000","last_fullsized":"2024-05-21T14:43:20.798047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:21:22.955055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'5","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.769432+0000","last_change":"2024-05-21T14:43:18.613555+0000","last_active":"2024-05-21T14:43:47.769432+0000","last_peered":"2024-05-21T14:43:47.769432+0000","last_clean":"2024-05-21T14:43:47.769432+0000","last_became_active":"2024-05-21T14:43:18.613117+0000","last_became_peered":"2024-05-21T14:43:18.613117+0000","last_unstale":"2024-05-21T14:43:47.769432+0000","last_undegraded":"2024-05-21T14:43:47.769432+0000","last_fullsized":"2024-05-21T14:43:47.769432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:38.151165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:20.578450+0000","last_change":"2024-05-21T14:43:19.596736+0000","last_active":"2024-05-21T14:43:20.578450+0000","last_peered":"2024-05-21T14:43:20.578450+0000","last_clean":"2024-05-21T14:43:20.578450+0000","last_became_active":"2024-05-21T14:43:19.596157+0000","last_became_peered":"2024-05-21T14:43:19.596157+0000","last_unstale":"2024-05-21T14:43:20.578450+0000","last_undegraded":"2024-05-21T14:43:20.578450+0000","last_fullsized":"2024-05-21T14:43:20.578450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:22:14.002930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'12","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.770421+0000","last_change":"2024-05-21T14:43:18.614044+0000","last_active":"2024-05-21T14:43:47.770421+0000","last_peered":"2024-05-21T14:43:47.770421+0000","last_clean":"2024-05-21T14:43:47.770421+0000","last_became_active":"2024-05-21T14:43:18.613730+0000","last_became_peered":"2024-05-21T14:43:18.613730+0000","last_unstale":"2024-05-21T14:43:47.770421+0000","last_undegraded":"2024-05-21T14:43:47.770421+0000","last_fullsized":"2024-05-21T14:43:47.770421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:41:34.787779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067780+0000","last_change":"2024-05-21T14:43:19.621999+0000","last_active":"2024-05-21T14:43:21.067780+0000","last_peered":"2024-05-21T14:43:21.067780+0000","last_clean":"2024-05-21T14:43:21.067780+0000","last_became_active":"2024-05-21T14:43:19.614744+0000","last_became_peered":"2024-05-21T14:43:19.614744+0000","last_unstale":"2024-05-21T14:43:21.067780+0000","last_undegraded":"2024-05-21T14:43:21.067780+0000","last_fullsized":"2024-05-21T14:43:21.067780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:32:37.316833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:24.592331+0000","last_change":"2024-05-21T14:43:18.614193+0000","last_active":"2024-05-21T14:43:24.592331+0000","last_peered":"2024-05-21T14:43:24.592331+0000","last_clean":"2024-05-21T14:43:24.592331+0000","last_became_active":"2024-05-21T14:43:18.609797+0000","last_became_peered":"2024-05-21T14:43:18.609797+0000","last_unstale":"2024-05-21T14:43:24.592331+0000","last_undegraded":"2024-05-21T14:43:24.592331+0000","last_fullsized":"2024-05-21T14:43:24.592331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:39:55.623816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:21.067766+0000","last_change":"2024-05-21T14:43:19.610578+0000","last_active":"2024-05-21T14:43:21.067766+0000","last_peered":"2024-05-21T14:43:21.067766+0000","last_clean":"2024-05-21T14:43:21.067766+0000","last_became_active":"2024-05-21T14:43:19.606575+0000","last_became_peered":"2024-05-21T14:43:19.606575+0000","last_unstale":"2024-05-21T14:43:21.067766+0000","last_undegraded":"2024-05-21T14:43:21.067766+0000","last_fullsized":"2024-05-21T14:43:21.067766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:50:06.088520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'13","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-21T14:43:47.769562+0000","last_change":"2024-05-21T14:43:18.601862+0000","last_active":"2024-05-21T14:43:47.769562+0000","last_peered":"2024-05-21T14:43:47.769562+0000","last_clean":"2024-05-21T14:43:47.769562+0000","last_became_active":"2024-05-21T14:43:18.601311+0000","last_became_peered":"2024-05-21T14:43:18.601311+0000","last_unstale":"2024-05-21T14:43:47.769562+0000","last_undegraded":"2024-05-21T14:43:47.769562+0000","last_fullsized":"2024-05-21T14:43:47.769562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:02.736061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8034,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":16068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":83615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":672429,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509452,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":84685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":83957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":82915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":673017,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":83777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":82289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T14:44:02.053 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:44:02.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.232+0000 7fdab8000640 1 Processor -- start 2024-05-21T14:44:02.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.232+0000 7fdab8000640 1 -- start start 2024-05-21T14:44:02.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdab8000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdab00736d0 0x7fdab0073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdab8000640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab0153cd0 con 0x7fdab0159810 2024-05-21T14:44:02.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdab8000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab015cdf0 con 0x7fdab00c6760 2024-05-21T14:44:02.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdab8000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fdab015cbb0 con 0x7fdab00736d0 2024-05-21T14:44:02.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdab6000640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdab0159810 0x7fdab0159c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37098/0 (socket says 172.21.15.78:37098) 2024-05-21T14:44:02.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdab6000640 1 -- 172.21.15.78:0/1702825494 learned_addr learned my addr 172.21.15.78:0/1702825494 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:44:02.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdab4c00640 1 --2- 172.21.15.78:0/1702825494 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdab00736d0 0x7fdab0073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdaafe00640 1 -- 172.21.15.78:0/1702825494 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2443641468 0 0) 0x7fdab0153cd0 con 0x7fdab0159810 2024-05-21T14:44:02.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdaafe00640 1 -- 172.21.15.78:0/1702825494 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda98003530 con 0x7fdab0159810 2024-05-21T14:44:02.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdaafe00640 1 -- 172.21.15.78:0/1702825494 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2860100743 0 0) 0x7fda98003530 con 0x7fdab0159810 2024-05-21T14:44:02.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdaafe00640 1 -- 172.21.15.78:0/1702825494 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdab00736d0 msgr2=0x7fdab0073ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:44:02.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdaafe00640 1 --2- 172.21.15.78:0/1702825494 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdab00736d0 0x7fdab0073ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdaafe00640 1 -- 172.21.15.78:0/1702825494 >> v1:172.21.15.84:6789/0 conn(0x7fdab00c6760 legacy=0x7fdab00c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdaafe00640 1 -- 172.21.15.78:0/1702825494 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab015d0d0 con 0x7fdab0159810 2024-05-21T14:44:02.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdaafe00640 1 -- 172.21.15.78:0/1702825494 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7fdaa8001680 con 0x7fdab0159810 2024-05-21T14:44:02.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdaafe00640 1 -- 172.21.15.78:0/1702825494 >> v1:172.21.15.78:6789/0 conn(0x7fdab0159810 legacy=0x7fdab0159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdaafe00640 1 --2- 172.21.15.78:0/1702825494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda980039f0 0x7fda98003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdaafe00640 1 --2- 172.21.15.78:0/1702825494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda98004810 0x7fda98004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdaafe00640 1 --2- 172.21.15.78:0/1702825494 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdab00736d0 0x7fda98005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdaafe00640 1 -- 172.21.15.78:0/1702825494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdab015cbb0 con 0x7fda98004810 2024-05-21T14:44:02.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdaafe00640 1 -- 172.21.15.78:0/1702825494 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fda9800bab0 con 0x7fda980039f0 2024-05-21T14:44:02.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdaafe00640 1 -- 172.21.15.78:0/1702825494 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fda9800bcb0 con 0x7fdab00736d0 2024-05-21T14:44:02.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdab4c00640 1 --2- 172.21.15.78:0/1702825494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda98004810 0x7fda98004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdab5600640 1 --2- 172.21.15.78:0/1702825494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda980039f0 0x7fda98003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdab6000640 1 --2- 172.21.15.78:0/1702825494 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdab00736d0 0x7fda98005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdab4c00640 1 -- 172.21.15.78:0/1702825494 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdab00736d0 msgr2=0x7fda98005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:44:02.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdab4c00640 1 --2- 172.21.15.78:0/1702825494 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdab00736d0 0x7fda98005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdab4c00640 1 -- 172.21.15.78:0/1702825494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda980039f0 msgr2=0x7fda98003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:44:02.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdab4c00640 1 --2- 172.21.15.78:0/1702825494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda980039f0 0x7fda98003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.236+0000 7fdab4c00640 1 -- 172.21.15.78:0/1702825494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda98003530 con 0x7fda98004810 2024-05-21T14:44:02.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.240+0000 7fdab4c00640 1 --2- 172.21.15.78:0/1702825494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda98004810 0x7fda98004c20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009ab0 tx=0x7fda9c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0207bef88d32a2d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:02.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.240+0000 7fdaafe00640 1 -- 172.21.15.78:0/1702825494 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c0b2070 con 0x7fda98004810 2024-05-21T14:44:02.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.240+0000 7fdaafe00640 1 -- 172.21.15.78:0/1702825494 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda9c0a5660 con 0x7fda98004810 2024-05-21T14:44:02.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.240+0000 7fdaafe00640 1 -- 172.21.15.78:0/1702825494 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c0096b0 con 0x7fda98004810 2024-05-21T14:44:02.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.240+0000 7fdab8000640 1 -- 172.21.15.78:0/1702825494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda98004810 msgr2=0x7fda98004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.240+0000 7fdab8000640 1 --2- 172.21.15.78:0/1702825494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda98004810 0x7fda98004c20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009ab0 tx=0x7fda9c01ca70 comp rx=0 tx=0).stop 2024-05-21T14:44:02.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.240+0000 7fdab6000640 1 -- 172.21.15.78:0/1702825494 reap_dead start 2024-05-21T14:44:02.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.240+0000 7fdab8000640 1 -- 172.21.15.78:0/1702825494 shutdown_connections 2024-05-21T14:44:02.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.240+0000 7fdab8000640 1 -- 172.21.15.78:0/1702825494 >> 172.21.15.78:0/1702825494 conn(0x7fdab00c9380 msgr2=0x7fdab00c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:02.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.240+0000 7fdab8000640 1 -- 172.21.15.78:0/1702825494 shutdown_connections 2024-05-21T14:44:02.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.240+0000 7fdab8000640 1 -- 172.21.15.78:0/1702825494 wait complete. 2024-05-21T14:44:02.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab8000640 1 Processor -- start 2024-05-21T14:44:02.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab8000640 1 -- start start 2024-05-21T14:44:02.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab8000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fda98004810 0x7fdab01f1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab8000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdab01474d0 0x7fdab014c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab8000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdab01478e0 0x7fdab01e2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab8000640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdab015d970 con 0x7fdab01478e0 2024-05-21T14:44:02.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab8000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdab015d690 con 0x7fdab01474d0 2024-05-21T14:44:02.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab8000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fdab00c6b70 con 0x7fda98004810 2024-05-21T14:44:02.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab6000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdab01478e0 0x7fdab01e2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab6000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdab01478e0 0x7fdab01e2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35580/0 (socket says 172.21.15.78:35580) 2024-05-21T14:44:02.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab6000640 1 -- 172.21.15.78:0/3654387508 learned_addr learned my addr 172.21.15.78:0/3654387508 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:44:02.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab5600640 1 --2- 172.21.15.78:0/3654387508 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fda98004810 0x7fdab01f1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab4c00640 1 --2- 172.21.15.78:0/3654387508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdab01474d0 0x7fdab014c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab6000640 1 -- 172.21.15.78:0/3654387508 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fda98004810 msgr2=0x7fdab01f1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab6000640 1 --2- 172.21.15.78:0/3654387508 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fda98004810 0x7fdab01f1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab6000640 1 -- 172.21.15.78:0/3654387508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdab01474d0 msgr2=0x7fdab014c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab6000640 1 --2- 172.21.15.78:0/3654387508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdab01474d0 0x7fdab014c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab6000640 1 -- 172.21.15.78:0/3654387508 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab01f1c70 con 0x7fdab01478e0 2024-05-21T14:44:02.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab4c00640 1 --2- 172.21.15.78:0/3654387508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdab01474d0 0x7fdab014c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:44:02.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab5600640 1 --2- 172.21.15.78:0/3654387508 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fda98004810 0x7fdab01f1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:44:02.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab6000640 1 --2- 172.21.15.78:0/3654387508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdab01478e0 0x7fdab01e2c60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fda98004790 tx=0x7fdaa800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdaad600640 1 -- 172.21.15.78:0/3654387508 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa800c690 con 0x7fdab01478e0 2024-05-21T14:44:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdaad600640 1 -- 172.21.15.78:0/3654387508 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaa8018070 con 0x7fdab01478e0 2024-05-21T14:44:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab8000640 1 -- 172.21.15.78:0/3654387508 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab014b8c0 con 0x7fdab01478e0 2024-05-21T14:44:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdaad600640 1 -- 172.21.15.78:0/3654387508 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa800ca90 con 0x7fdab01478e0 2024-05-21T14:44:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.244+0000 7fdab8000640 1 -- 172.21.15.78:0/3654387508 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab014d550 con 0x7fdab01478e0 2024-05-21T14:44:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.248+0000 7fdab8000640 1 -- 172.21.15.78:0/3654387508 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdab01f10b0 con 0x7fdab01478e0 2024-05-21T14:44:02.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.248+0000 7fdaad600640 1 -- 172.21.15.78:0/3654387508 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdaa800cc30 con 0x7fdab01478e0 2024-05-21T14:44:02.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.248+0000 7fdaad600640 1 --2- 172.21.15.78:0/3654387508 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fda900678f0 0x7fda90069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.248+0000 7fdaad600640 1 -- 172.21.15.78:0/3654387508 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fdaa80858e0 con 0x7fdab01478e0 2024-05-21T14:44:02.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.248+0000 7fdab5600640 1 --2- 172.21.15.78:0/3654387508 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fda900678f0 0x7fda90069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.252+0000 7fdab5600640 1 --2- 172.21.15.78:0/3654387508 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fda900678f0 0x7fda90069e00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4000f90 tx=0x7fdaa40017d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:02.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.252+0000 7fdaad600640 1 -- 172.21.15.78:0/3654387508 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fdaa8056360 con 0x7fdab01478e0 2024-05-21T14:44:02.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.408+0000 7fdab8000640 1 -- 172.21.15.78:0/3654387508 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdab014d790 con 0x7fdab01478e0 2024-05-21T14:44:02.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.412+0000 7fdaad600640 1 -- 172.21.15.78:0/3654387508 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16585 (secure 0 0 0) 0x7fdaa8055c60 con 0x7fdab01478e0 2024-05-21T14:44:02.420 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:44:02.421 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:59.799293+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T14:43:17.088549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T14:43:18.012571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:44:02.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.412+0000 7fdab8000640 1 -- 172.21.15.78:0/3654387508 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fda900678f0 msgr2=0x7fda90069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.412+0000 7fdab8000640 1 --2- 172.21.15.78:0/3654387508 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fda900678f0 0x7fda90069e00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4000f90 tx=0x7fdaa40017d0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.412+0000 7fdab8000640 1 -- 172.21.15.78:0/3654387508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdab01478e0 msgr2=0x7fdab01e2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.412+0000 7fdab8000640 1 --2- 172.21.15.78:0/3654387508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdab01478e0 0x7fdab01e2c60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fda98004790 tx=0x7fdaa800eb90 comp rx=0 tx=0).stop 2024-05-21T14:44:02.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.412+0000 7fdab8000640 1 -- 172.21.15.78:0/3654387508 shutdown_connections 2024-05-21T14:44:02.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.412+0000 7fdab8000640 1 --2- 172.21.15.78:0/3654387508 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fda900678f0 0x7fda90069e00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.412+0000 7fdab8000640 1 --2- 172.21.15.78:0/3654387508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdab01478e0 0x7fdab01e2c60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.412+0000 7fdab8000640 1 --2- 172.21.15.78:0/3654387508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdab01474d0 0x7fdab014c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.412+0000 7fdab8000640 1 --2- 172.21.15.78:0/3654387508 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fda98004810 0x7fdab01f1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.412+0000 7fdab8000640 1 -- 172.21.15.78:0/3654387508 >> 172.21.15.78:0/3654387508 conn(0x7fdab00c9380 msgr2=0x7fdab0073c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:02.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.412+0000 7fdab8000640 1 -- 172.21.15.78:0/3654387508 shutdown_connections 2024-05-21T14:44:02.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.412+0000 7fdab8000640 1 -- 172.21.15.78:0/3654387508 wait complete. 2024-05-21T14:44:02.443 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-21T14:43:06.569415+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-21T14:43:17.088549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-21T14:43:18.012571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-21T14:44:02.444 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-21T14:44:02.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.584+0000 7f9b4c600640 1 Processor -- start 2024-05-21T14:44:02.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.584+0000 7f9b4c600640 1 -- start start 2024-05-21T14:44:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.584+0000 7f9b4c600640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9b441527a0 0x7f9b440c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.584+0000 7f9b4c600640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b440737e0 con 0x7f9b440733d0 2024-05-21T14:44:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.584+0000 7f9b4c600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b44073aa0 con 0x7f9b440c5980 2024-05-21T14:44:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.584+0000 7f9b4c600640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f9b44072980 con 0x7f9b441527a0 2024-05-21T14:44:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.584+0000 7f9b49c00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9b440733d0 0x7f9b44071910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37114/0 (socket says 172.21.15.78:37114) 2024-05-21T14:44:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.584+0000 7f9b49c00640 1 -- 172.21.15.78:0/4243436952 learned_addr learned my addr 172.21.15.78:0/4243436952 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:44:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.584+0000 7f9b49200640 1 --2- 172.21.15.78:0/4243436952 >> v2:172.21.15.78:3300/0 conn(0x7f9b441527a0 0x7f9b440c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.584+0000 7f9b43e00640 1 -- 172.21.15.78:0/4243436952 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4227083130 0 0) 0x7f9b440737e0 con 0x7f9b440733d0 2024-05-21T14:44:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.584+0000 7f9b43e00640 1 -- 172.21.15.78:0/4243436952 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b2c003530 con 0x7f9b440733d0 2024-05-21T14:44:02.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.588+0000 7f9b49200640 1 -- 172.21.15.78:0/4243436952 >> v1:172.21.15.84:6789/0 conn(0x7f9b440c5980 legacy=0x7f9b44162e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.588+0000 7f9b49200640 1 -- 172.21.15.78:0/4243436952 >> v1:172.21.15.78:6789/0 conn(0x7f9b440733d0 legacy=0x7f9b44071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.588+0000 7f9b49200640 1 -- 172.21.15.78:0/4243436952 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b44073d80 con 0x7f9b441527a0 2024-05-21T14:44:02.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.588+0000 7f9b49200640 1 --2- 172.21.15.78:0/4243436952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b441527a0 0x7f9b440c5440 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9b300097c0 tx=0x7f9b3001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87b9d14d520959e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:02.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.588+0000 7f9b43e00640 1 -- 172.21.15.78:0/4243436952 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b300b5070 con 0x7f9b441527a0 2024-05-21T14:44:02.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.588+0000 7f9b43e00640 1 -- 172.21.15.78:0/4243436952 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b300a8990 con 0x7f9b441527a0 2024-05-21T14:44:02.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.588+0000 7f9b43e00640 1 -- 172.21.15.78:0/4243436952 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b300a8d40 con 0x7f9b441527a0 2024-05-21T14:44:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.588+0000 7f9b4c600640 1 -- 172.21.15.78:0/4243436952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b441527a0 msgr2=0x7f9b440c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.588+0000 7f9b4c600640 1 --2- 172.21.15.78:0/4243436952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b441527a0 0x7f9b440c5440 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9b300097c0 tx=0x7f9b3001ec90 comp rx=0 tx=0).stop 2024-05-21T14:44:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.592+0000 7f9b4c600640 1 -- 172.21.15.78:0/4243436952 shutdown_connections 2024-05-21T14:44:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.592+0000 7f9b4c600640 1 --2- 172.21.15.78:0/4243436952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b441527a0 0x7f9b440c5440 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.592+0000 7f9b4c600640 1 -- 172.21.15.78:0/4243436952 >> 172.21.15.78:0/4243436952 conn(0x7f9b440cd1e0 msgr2=0x7f9b440c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.592+0000 7f9b4c600640 1 -- 172.21.15.78:0/4243436952 shutdown_connections 2024-05-21T14:44:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.592+0000 7f9b4c600640 1 -- 172.21.15.78:0/4243436952 wait complete. 2024-05-21T14:44:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.592+0000 7f9b4c600640 1 Processor -- start 2024-05-21T14:44:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.592+0000 7f9b4c600640 1 -- start start 2024-05-21T14:44:02.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.592+0000 7f9b4c600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b440733d0 0x7f9b441530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.592+0000 7f9b4c600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b440c5980 0x7f9b44150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.592+0000 7f9b4c600640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b441527a0 0x7f9b440c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.592+0000 7f9b4c600640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9b44072bd0 con 0x7f9b440c5980 2024-05-21T14:44:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.592+0000 7f9b4c600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9b44072f40 con 0x7f9b440733d0 2024-05-21T14:44:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.592+0000 7f9b4c600640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f9b440ca100 con 0x7f9b441527a0 2024-05-21T14:44:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.592+0000 7f9b49200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b440c5980 0x7f9b44150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b49200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b440c5980 0x7f9b44150c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35596/0 (socket says 172.21.15.78:35596) 2024-05-21T14:44:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b49200640 1 -- 172.21.15.78:0/3557411630 learned_addr learned my addr 172.21.15.78:0/3557411630 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:44:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b49c00640 1 --2- 172.21.15.78:0/3557411630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b440733d0 0x7f9b441530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b4a600640 1 --2- 172.21.15.78:0/3557411630 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b441527a0 0x7f9b440c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b49200640 1 -- 172.21.15.78:0/3557411630 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b441527a0 msgr2=0x7f9b440c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b49200640 1 --2- 172.21.15.78:0/3557411630 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b441527a0 0x7f9b440c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b49200640 1 -- 172.21.15.78:0/3557411630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b440733d0 msgr2=0x7f9b441530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b49200640 1 --2- 172.21.15.78:0/3557411630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b440733d0 0x7f9b441530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b49200640 1 -- 172.21.15.78:0/3557411630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b441503e0 con 0x7f9b440c5980 2024-05-21T14:44:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b4a600640 1 --2- 172.21.15.78:0/3557411630 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b441527a0 0x7f9b440c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:44:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b49200640 1 --2- 172.21.15.78:0/3557411630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b440c5980 0x7f9b44150c40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9b300b3040 tx=0x7f9b3001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:02.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b41600640 1 -- 172.21.15.78:0/3557411630 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b300c0070 con 0x7f9b440c5980 2024-05-21T14:44:02.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b41600640 1 -- 172.21.15.78:0/3557411630 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b30004230 con 0x7f9b440c5980 2024-05-21T14:44:02.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b4c600640 1 -- 172.21.15.78:0/3557411630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b44154c40 con 0x7f9b440c5980 2024-05-21T14:44:02.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b41600640 1 -- 172.21.15.78:0/3557411630 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b300b5040 con 0x7f9b440c5980 2024-05-21T14:44:02.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b4c600640 1 -- 172.21.15.78:0/3557411630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b44158250 con 0x7f9b440c5980 2024-05-21T14:44:02.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b4c600640 1 -- 172.21.15.78:0/3557411630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b44154e10 con 0x7f9b440c5980 2024-05-21T14:44:02.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b41600640 1 -- 172.21.15.78:0/3557411630 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9b300c3070 con 0x7f9b440c5980 2024-05-21T14:44:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.596+0000 7f9b41600640 1 --2- 172.21.15.78:0/3557411630 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9b240678f0 0x7f9b24069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.600+0000 7f9b41600640 1 -- 172.21.15.78:0/3557411630 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f9b30122380 con 0x7f9b440c5980 2024-05-21T14:44:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.600+0000 7f9b49c00640 1 --2- 172.21.15.78:0/3557411630 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9b240678f0 0x7f9b24069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.600+0000 7f9b49c00640 1 --2- 172.21.15.78:0/3557411630 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9b240678f0 0x7f9b24069e00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9b380011f0 tx=0x7f9b38007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:02.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.604+0000 7f9b41600640 1 -- 172.21.15.78:0/3557411630 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f9b300187f0 con 0x7f9b440c5980 2024-05-21T14:44:02.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.756+0000 7f9b4c600640 1 -- 172.21.15.78:0/3557411630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9b440c8a20 con 0x7f9b440c5980 2024-05-21T14:44:02.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.760+0000 7f9b41600640 1 -- 172.21.15.78:0/3557411630 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f9b300f27b0 con 0x7f9b440c5980 2024-05-21T14:44:02.767 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-05-21T14:44:02.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.760+0000 7f9b4c600640 1 -- 172.21.15.78:0/3557411630 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9b240678f0 msgr2=0x7f9b24069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.760+0000 7f9b4c600640 1 --2- 172.21.15.78:0/3557411630 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9b240678f0 0x7f9b24069e00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9b380011f0 tx=0x7f9b38007d40 comp rx=0 tx=0).stop 2024-05-21T14:44:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.760+0000 7f9b4c600640 1 -- 172.21.15.78:0/3557411630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b440c5980 msgr2=0x7f9b44150c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.760+0000 7f9b4c600640 1 --2- 172.21.15.78:0/3557411630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b440c5980 0x7f9b44150c40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9b300b3040 tx=0x7f9b3001ba30 comp rx=0 tx=0).stop 2024-05-21T14:44:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.760+0000 7f9b4c600640 1 -- 172.21.15.78:0/3557411630 shutdown_connections 2024-05-21T14:44:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.760+0000 7f9b4c600640 1 --2- 172.21.15.78:0/3557411630 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f9b240678f0 0x7f9b24069e00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.760+0000 7f9b4c600640 1 --2- 172.21.15.78:0/3557411630 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b441527a0 0x7f9b440c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.760+0000 7f9b4c600640 1 --2- 172.21.15.78:0/3557411630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b440c5980 0x7f9b44150c40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.760+0000 7f9b4c600640 1 --2- 172.21.15.78:0/3557411630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b440733d0 0x7f9b441530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.760+0000 7f9b4c600640 1 -- 172.21.15.78:0/3557411630 >> 172.21.15.78:0/3557411630 conn(0x7f9b440cd1e0 msgr2=0x7f9b440c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.760+0000 7f9b4c600640 1 -- 172.21.15.78:0/3557411630 shutdown_connections 2024-05-21T14:44:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.760+0000 7f9b4c600640 1 -- 172.21.15.78:0/3557411630 wait complete. 2024-05-21T14:44:02.789 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-21T14:44:02.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.928+0000 7f7b53200640 1 Processor -- start 2024-05-21T14:44:02.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.928+0000 7f7b53200640 1 -- start start 2024-05-21T14:44:02.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.932+0000 7f7b53200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7b540c9230 0x7f7b540caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.932+0000 7f7b53200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7b540c8460 0x7f7b540c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.932+0000 7f7b53200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7b54073410 0x7f7b54073820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.932+0000 7f7b53200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f7b540c64a0 con 0x7f7b540c9230 2024-05-21T14:44:02.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.932+0000 7f7b53200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f7b540c6200 con 0x7f7b540c8460 2024-05-21T14:44:02.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.932+0000 7f7b53200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f7b540c67e0 con 0x7f7b54073410 2024-05-21T14:44:02.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.932+0000 7f7b51e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7b540c9230 0x7f7b540caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.932+0000 7f7b51e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7b540c9230 0x7f7b540caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35600/0 (socket says 172.21.15.78:35600) 2024-05-21T14:44:02.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.932+0000 7f7b51e00640 1 -- 172.21.15.78:0/1918771419 learned_addr learned my addr 172.21.15.78:0/1918771419 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:44:02.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.932+0000 7f7b49400640 1 --2- 172.21.15.78:0/1918771419 >> v2:172.21.15.84:3300/0 conn(0x7f7b540c8460 0x7f7b540c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.932+0000 7f7b52800640 1 --2- 172.21.15.78:0/1918771419 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7b54073410 0x7f7b54073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.932+0000 7f7b51e00640 1 -- 172.21.15.78:0/1918771419 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7b54073410 msgr2=0x7f7b54073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:44:02.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.932+0000 7f7b51e00640 1 --2- 172.21.15.78:0/1918771419 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7b54073410 0x7f7b54073820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.932+0000 7f7b51e00640 1 -- 172.21.15.78:0/1918771419 >> v2:172.21.15.84:3300/0 conn(0x7f7b540c8460 msgr2=0x7f7b540c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:44:02.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.932+0000 7f7b51e00640 1 --2- 172.21.15.78:0/1918771419 >> v2:172.21.15.84:3300/0 conn(0x7f7b540c8460 0x7f7b540c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.932+0000 7f7b51e00640 1 -- 172.21.15.78:0/1918771419 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b540ca540 con 0x7f7b540c9230 2024-05-21T14:44:02.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.932+0000 7f7b52800640 1 --2- 172.21.15.78:0/1918771419 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7b54073410 0x7f7b54073820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:44:02.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.936+0000 7f7b51e00640 1 --2- 172.21.15.78:0/1918771419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b540c9230 0x7f7b540caa40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7b54075db0 tx=0x7f7b4401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e072d75ba8eff3 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:02.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.936+0000 7f7b51400640 1 -- 172.21.15.78:0/1918771419 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b440b0070 con 0x7f7b540c9230 2024-05-21T14:44:02.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.936+0000 7f7b51400640 1 -- 172.21.15.78:0/1918771419 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b440ab600 con 0x7f7b540c9230 2024-05-21T14:44:02.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.936+0000 7f7b51400640 1 -- 172.21.15.78:0/1918771419 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b440ab9d0 con 0x7f7b540c9230 2024-05-21T14:44:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.936+0000 7f7b53200640 1 -- 172.21.15.78:0/1918771419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b540c9230 msgr2=0x7f7b540caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.936+0000 7f7b53200640 1 --2- 172.21.15.78:0/1918771419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b540c9230 0x7f7b540caa40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7b54075db0 tx=0x7f7b4401c520 comp rx=0 tx=0).stop 2024-05-21T14:44:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.936+0000 7f7b53200640 1 -- 172.21.15.78:0/1918771419 shutdown_connections 2024-05-21T14:44:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.936+0000 7f7b53200640 1 --2- 172.21.15.78:0/1918771419 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7b54073410 0x7f7b54073820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.936+0000 7f7b53200640 1 --2- 172.21.15.78:0/1918771419 >> v2:172.21.15.84:3300/0 conn(0x7f7b540c8460 0x7f7b540c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.936+0000 7f7b53200640 1 --2- 172.21.15.78:0/1918771419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b540c9230 0x7f7b540caa40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.936+0000 7f7b53200640 1 -- 172.21.15.78:0/1918771419 >> 172.21.15.78:0/1918771419 conn(0x7f7b540ce870 msgr2=0x7f7b540cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.936+0000 7f7b53200640 1 -- 172.21.15.78:0/1918771419 shutdown_connections 2024-05-21T14:44:02.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.936+0000 7f7b53200640 1 -- 172.21.15.78:0/1918771419 wait complete. 2024-05-21T14:44:02.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b53200640 1 Processor -- start 2024-05-21T14:44:02.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b53200640 1 -- start start 2024-05-21T14:44:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b53200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b54073410 0x7f7b541f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b53200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7b540c8460 0x7f7b540cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b53200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540c9230 0x7f7b54144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b53200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7b54159590 con 0x7f7b54073410 2024-05-21T14:44:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b53200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7b54159410 con 0x7f7b540c9230 2024-05-21T14:44:02.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b53200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f7b540caf80 con 0x7f7b540c8460 2024-05-21T14:44:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b51e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b54073410 0x7f7b541f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b51e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b54073410 0x7f7b541f8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35610/0 (socket says 172.21.15.78:35610) 2024-05-21T14:44:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b51e00640 1 -- 172.21.15.78:0/1489583980 learned_addr learned my addr 172.21.15.78:0/1489583980 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:44:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b49400640 1 --2- 172.21.15.78:0/1489583980 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7b540c8460 0x7f7b540cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b52800640 1 --2- 172.21.15.78:0/1489583980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540c9230 0x7f7b54144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b51e00640 1 -- 172.21.15.78:0/1489583980 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7b540c8460 msgr2=0x7f7b540cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b51e00640 1 --2- 172.21.15.78:0/1489583980 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7b540c8460 0x7f7b540cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b51e00640 1 -- 172.21.15.78:0/1489583980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540c9230 msgr2=0x7f7b54144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b51e00640 1 --2- 172.21.15.78:0/1489583980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540c9230 0x7f7b54144290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b51e00640 1 -- 172.21.15.78:0/1489583980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b541f8fa0 con 0x7f7b54073410 2024-05-21T14:44:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b51e00640 1 --2- 172.21.15.78:0/1489583980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b54073410 0x7f7b541f8a60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7b4401abd0 tx=0x7f7b440192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b4aa00640 1 -- 172.21.15.78:0/1489583980 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b440ba070 con 0x7f7b54073410 2024-05-21T14:44:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b4aa00640 1 -- 172.21.15.78:0/1489583980 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b440b4620 con 0x7f7b54073410 2024-05-21T14:44:02.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b4aa00640 1 -- 172.21.15.78:0/1489583980 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b440b0040 con 0x7f7b54073410 2024-05-21T14:44:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b53200640 1 -- 172.21.15.78:0/1489583980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b54155520 con 0x7f7b54073410 2024-05-21T14:44:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.940+0000 7f7b53200640 1 -- 172.21.15.78:0/1489583980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b54155ce0 con 0x7f7b54073410 2024-05-21T14:44:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.944+0000 7f7b53200640 1 -- 172.21.15.78:0/1489583980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b5404f730 con 0x7f7b54073410 2024-05-21T14:44:02.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.944+0000 7f7b4aa00640 1 -- 172.21.15.78:0/1489583980 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7b440ab4c0 con 0x7f7b54073410 2024-05-21T14:44:02.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.944+0000 7f7b4aa00640 1 --2- 172.21.15.78:0/1489583980 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7b300678c0 0x7f7b30069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:02.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.944+0000 7f7b4aa00640 1 -- 172.21.15.78:0/1489583980 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f7b4411f4b0 con 0x7f7b54073410 2024-05-21T14:44:02.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.944+0000 7f7b49400640 1 --2- 172.21.15.78:0/1489583980 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7b300678c0 0x7f7b30069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:02.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.944+0000 7f7b49400640 1 --2- 172.21.15.78:0/1489583980 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7b300678c0 0x7f7b30069dd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7b540c8cf0 tx=0x7f7b3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:02.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:02.948+0000 7f7b4aa00640 1 -- 172.21.15.78:0/1489583980 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f7b440c3020 con 0x7f7b54073410 2024-05-21T14:44:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.104+0000 7f7b53200640 1 -- 172.21.15.78:0/1489583980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7b541531c0 con 0x7f7b54073410 2024-05-21T14:44:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.104+0000 7f7b4aa00640 1 -- 172.21.15.78:0/1489583980 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f7b44016110 con 0x7f7b54073410 2024-05-21T14:44:03.112 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-05-21T14:44:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.104+0000 7f7b53200640 1 -- 172.21.15.78:0/1489583980 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7b300678c0 msgr2=0x7f7b30069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.104+0000 7f7b53200640 1 --2- 172.21.15.78:0/1489583980 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7b300678c0 0x7f7b30069dd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7b540c8cf0 tx=0x7f7b3c008040 comp rx=0 tx=0).stop 2024-05-21T14:44:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.104+0000 7f7b53200640 1 -- 172.21.15.78:0/1489583980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b54073410 msgr2=0x7f7b541f8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.104+0000 7f7b53200640 1 --2- 172.21.15.78:0/1489583980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b54073410 0x7f7b541f8a60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7b4401abd0 tx=0x7f7b440192c0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.104+0000 7f7b53200640 1 -- 172.21.15.78:0/1489583980 shutdown_connections 2024-05-21T14:44:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.104+0000 7f7b53200640 1 --2- 172.21.15.78:0/1489583980 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f7b300678c0 0x7f7b30069dd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.104+0000 7f7b53200640 1 --2- 172.21.15.78:0/1489583980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540c9230 0x7f7b54144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.104+0000 7f7b53200640 1 --2- 172.21.15.78:0/1489583980 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7b540c8460 0x7f7b540cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.104+0000 7f7b53200640 1 --2- 172.21.15.78:0/1489583980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b54073410 0x7f7b541f8a60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.104+0000 7f7b53200640 1 -- 172.21.15.78:0/1489583980 >> 172.21.15.78:0/1489583980 conn(0x7f7b540ce870 msgr2=0x7f7b541473a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.104+0000 7f7b53200640 1 -- 172.21.15.78:0/1489583980 shutdown_connections 2024-05-21T14:44:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.104+0000 7f7b53200640 1 -- 172.21.15.78:0/1489583980 wait complete. 2024-05-21T14:44:03.134 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-21T14:44:03.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.272+0000 7f2856200640 1 Processor -- start 2024-05-21T14:44:03.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.276+0000 7f2856200640 1 -- start start 2024-05-21T14:44:03.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.276+0000 7f2856200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f28500733d0 0x7f2850071910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:03.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.276+0000 7f2856200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f28501527a0 0x7f28500c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:03.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.276+0000 7f2856200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f28500c5980 0x7f285015bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:03.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.276+0000 7f2856200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f2850072980 con 0x7f28500c5980 2024-05-21T14:44:03.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.276+0000 7f2856200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f2850072f40 con 0x7f28501527a0 2024-05-21T14:44:03.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.276+0000 7f2856200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f2850071e50 con 0x7f28500733d0 2024-05-21T14:44:03.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.276+0000 7f284fe00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f28500c5980 0x7f285015bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:03.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.276+0000 7f284fe00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f28500c5980 0x7f285015bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35104/0 (socket says 172.21.15.78:35104) 2024-05-21T14:44:03.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.276+0000 7f284fe00640 1 -- 172.21.15.78:0/2892539259 learned_addr learned my addr 172.21.15.78:0/2892539259 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:44:03.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.276+0000 7f284f400640 1 --2- 172.21.15.78:0/2892539259 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f28500733d0 0x7f2850071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:03.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.276+0000 7f284ea00640 1 --2- 172.21.15.78:0/2892539259 >> v2:172.21.15.84:3300/0 conn(0x7f28501527a0 0x7f28500c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:03.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.276+0000 7f284fe00640 1 -- 172.21.15.78:0/2892539259 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f28500733d0 msgr2=0x7f2850071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:44:03.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.276+0000 7f284fe00640 1 --2- 172.21.15.78:0/2892539259 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f28500733d0 0x7f2850071910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.276+0000 7f284fe00640 1 -- 172.21.15.78:0/2892539259 >> v2:172.21.15.84:3300/0 conn(0x7f28501527a0 msgr2=0x7f28500c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:44:03.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.276+0000 7f284fe00640 1 --2- 172.21.15.78:0/2892539259 >> v2:172.21.15.84:3300/0 conn(0x7f28501527a0 0x7f28500c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.276+0000 7f284fe00640 1 -- 172.21.15.78:0/2892539259 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28500737e0 con 0x7f28500c5980 2024-05-21T14:44:03.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.280+0000 7f284fe00640 1 --2- 172.21.15.78:0/2892539259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28500c5980 0x7f285015bae0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f28500cd8d0 tx=0x7f284801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95823ad2dbee3f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:03.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.280+0000 7f284e000640 1 -- 172.21.15.78:0/2892539259 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28480b5070 con 0x7f28500c5980 2024-05-21T14:44:03.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.280+0000 7f284e000640 1 -- 172.21.15.78:0/2892539259 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28480a89d0 con 0x7f28500c5980 2024-05-21T14:44:03.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.280+0000 7f284e000640 1 -- 172.21.15.78:0/2892539259 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28480a8da0 con 0x7f28500c5980 2024-05-21T14:44:03.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.280+0000 7f2856200640 1 -- 172.21.15.78:0/2892539259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28500c5980 msgr2=0x7f285015bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:03.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.280+0000 7f2856200640 1 --2- 172.21.15.78:0/2892539259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28500c5980 0x7f285015bae0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f28500cd8d0 tx=0x7f284801ed10 comp rx=0 tx=0).stop 2024-05-21T14:44:03.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.280+0000 7f2856200640 1 -- 172.21.15.78:0/2892539259 shutdown_connections 2024-05-21T14:44:03.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.280+0000 7f2856200640 1 --2- 172.21.15.78:0/2892539259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28500c5980 0x7f285015bae0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.280+0000 7f2856200640 1 --2- 172.21.15.78:0/2892539259 >> v2:172.21.15.84:3300/0 conn(0x7f28501527a0 0x7f28500c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.280+0000 7f2856200640 1 --2- 172.21.15.78:0/2892539259 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f28500733d0 0x7f2850071910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.280+0000 7f2856200640 1 -- 172.21.15.78:0/2892539259 >> 172.21.15.78:0/2892539259 conn(0x7f28500cd1e0 msgr2=0x7f28500c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:03.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.280+0000 7f2856200640 1 -- 172.21.15.78:0/2892539259 shutdown_connections 2024-05-21T14:44:03.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.280+0000 7f2856200640 1 -- 172.21.15.78:0/2892539259 wait complete. 2024-05-21T14:44:03.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f2856200640 1 Processor -- start 2024-05-21T14:44:03.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f2856200640 1 -- start start 2024-05-21T14:44:03.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f2856200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28500733d0 0x7f28501f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:03.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f2856200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28500c5980 0x7f285013d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:03.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f2856200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f28501527a0 0x7f28500cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:03.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f2856200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2850074060 con 0x7f28500c5980 2024-05-21T14:44:03.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f2856200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2850073d80 con 0x7f28500733d0 2024-05-21T14:44:03.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f2856200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f2850072bd0 con 0x7f28501527a0 2024-05-21T14:44:03.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f284ea00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28500c5980 0x7f285013d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:03.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f284ea00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28500c5980 0x7f285013d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35112/0 (socket says 172.21.15.78:35112) 2024-05-21T14:44:03.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f284ea00640 1 -- 172.21.15.78:0/3680003337 learned_addr learned my addr 172.21.15.78:0/3680003337 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:44:03.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f284f400640 1 --2- 172.21.15.78:0/3680003337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28500733d0 0x7f28501f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:03.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f284fe00640 1 --2- 172.21.15.78:0/3680003337 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f28501527a0 0x7f28500cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:03.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f284ea00640 1 -- 172.21.15.78:0/3680003337 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f28501527a0 msgr2=0x7f28500cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f284ea00640 1 --2- 172.21.15.78:0/3680003337 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f28501527a0 0x7f28500cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f284ea00640 1 -- 172.21.15.78:0/3680003337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28500733d0 msgr2=0x7f28501f6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f284ea00640 1 --2- 172.21.15.78:0/3680003337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28500733d0 0x7f28501f6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f284ea00640 1 -- 172.21.15.78:0/3680003337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28500cab30 con 0x7f28500c5980 2024-05-21T14:44:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f284ea00640 1 --2- 172.21.15.78:0/3680003337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28500c5980 0x7f285013d330 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f283c00e8a0 tx=0x7f283c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f2847400640 1 -- 172.21.15.78:0/3680003337 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c017070 con 0x7f28500c5980 2024-05-21T14:44:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f2847400640 1 -- 172.21.15.78:0/3680003337 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f283c00ee90 con 0x7f28500c5980 2024-05-21T14:44:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f2847400640 1 -- 172.21.15.78:0/3680003337 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c00cae0 con 0x7f28500c5980 2024-05-21T14:44:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f2856200640 1 -- 172.21.15.78:0/3680003337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2850164cb0 con 0x7f28500c5980 2024-05-21T14:44:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.284+0000 7f2856200640 1 -- 172.21.15.78:0/3680003337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f285013ec70 con 0x7f28500c5980 2024-05-21T14:44:03.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.288+0000 7f2856200640 1 -- 172.21.15.78:0/3680003337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f285015c980 con 0x7f28500c5980 2024-05-21T14:44:03.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.288+0000 7f2847400640 1 -- 172.21.15.78:0/3680003337 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f283c01a070 con 0x7f28500c5980 2024-05-21T14:44:03.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.288+0000 7f2847400640 1 --2- 172.21.15.78:0/3680003337 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f28300678c0 0x7f2830069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:03.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.288+0000 7f2847400640 1 -- 172.21.15.78:0/3680003337 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f283c085fb0 con 0x7f28500c5980 2024-05-21T14:44:03.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.288+0000 7f284f400640 1 --2- 172.21.15.78:0/3680003337 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f28300678c0 0x7f2830069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:03.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.288+0000 7f284f400640 1 --2- 172.21.15.78:0/3680003337 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f28300678c0 0x7f2830069dd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f28500c6e40 tx=0x7f284000d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.292+0000 7f2847400640 1 -- 172.21.15.78:0/3680003337 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f283c0569a0 con 0x7f28500c5980 2024-05-21T14:44:03.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.448+0000 7f2856200640 1 -- 172.21.15.78:0/3680003337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f28500c8a20 con 0x7f28500c5980 2024-05-21T14:44:03.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.448+0000 7f2847400640 1 -- 172.21.15.78:0/3680003337 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f283c0562a0 con 0x7f28500c5980 2024-05-21T14:44:03.458 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-05-21T14:44:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.452+0000 7f2856200640 1 -- 172.21.15.78:0/3680003337 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f28300678c0 msgr2=0x7f2830069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.452+0000 7f2856200640 1 --2- 172.21.15.78:0/3680003337 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f28300678c0 0x7f2830069dd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f28500c6e40 tx=0x7f284000d040 comp rx=0 tx=0).stop 2024-05-21T14:44:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.452+0000 7f2856200640 1 -- 172.21.15.78:0/3680003337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28500c5980 msgr2=0x7f285013d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.452+0000 7f2856200640 1 --2- 172.21.15.78:0/3680003337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28500c5980 0x7f285013d330 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f283c00e8a0 tx=0x7f283c00ed60 comp rx=0 tx=0).stop 2024-05-21T14:44:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.452+0000 7f2856200640 1 -- 172.21.15.78:0/3680003337 shutdown_connections 2024-05-21T14:44:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.452+0000 7f2856200640 1 --2- 172.21.15.78:0/3680003337 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f28300678c0 0x7f2830069dd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.452+0000 7f2856200640 1 --2- 172.21.15.78:0/3680003337 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f28501527a0 0x7f28500cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.452+0000 7f2856200640 1 --2- 172.21.15.78:0/3680003337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28500c5980 0x7f285013d330 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.452+0000 7f2856200640 1 --2- 172.21.15.78:0/3680003337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28500733d0 0x7f28501f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.452+0000 7f2856200640 1 -- 172.21.15.78:0/3680003337 >> 172.21.15.78:0/3680003337 conn(0x7f28500cd1e0 msgr2=0x7f2850146030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.452+0000 7f2856200640 1 -- 172.21.15.78:0/3680003337 shutdown_connections 2024-05-21T14:44:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.452+0000 7f2856200640 1 -- 172.21.15.78:0/3680003337 wait complete. 2024-05-21T14:44:03.480 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T14:44:03.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.616+0000 7f44c1200640 1 Processor -- start 2024-05-21T14:44:03.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.616+0000 7f44c1200640 1 -- start start 2024-05-21T14:44:03.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44c1200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44bc071fe0 0x7f44bc0723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:03.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44c1200640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44bc0715f0 con 0x7f44bc1529d0 2024-05-21T14:44:03.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44c1200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44bc072b80 con 0x7f44bc0c5640 2024-05-21T14:44:03.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44c1200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f44bc0c8530 con 0x7f44bc071fe0 2024-05-21T14:44:03.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9e00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f44bc1529d0 0x7f44bc072e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:59354/0 (socket says 172.21.15.78:59354) 2024-05-21T14:44:03.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9e00640 1 -- 172.21.15.78:0/940915259 learned_addr learned my addr 172.21.15.78:0/940915259 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:44:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b1400640 1 --2- 172.21.15.78:0/940915259 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44bc071fe0 0x7f44bc0723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9400640 1 -- 172.21.15.78:0/940915259 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1109890212 0 0) 0x7f44bc0715f0 con 0x7f44bc1529d0 2024-05-21T14:44:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9400640 1 -- 172.21.15.78:0/940915259 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44a0005740 con 0x7f44bc1529d0 2024-05-21T14:44:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9400640 1 -- 172.21.15.78:0/940915259 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2975081717 0 0) 0x7f44bc072b80 con 0x7f44bc0c5640 2024-05-21T14:44:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9400640 1 -- 172.21.15.78:0/940915259 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44bc0715f0 con 0x7f44bc0c5640 2024-05-21T14:44:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9400640 1 -- 172.21.15.78:0/940915259 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1105603366 0 0) 0x7f44a0005740 con 0x7f44bc1529d0 2024-05-21T14:44:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9400640 1 -- 172.21.15.78:0/940915259 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44bc071fe0 msgr2=0x7f44bc0723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:44:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9400640 1 --2- 172.21.15.78:0/940915259 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44bc071fe0 0x7f44bc0723f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9400640 1 -- 172.21.15.78:0/940915259 >> v1:172.21.15.84:6789/0 conn(0x7f44bc0c5640 legacy=0x7f44bc162e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9400640 1 -- 172.21.15.78:0/940915259 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44bc0c8810 con 0x7f44bc1529d0 2024-05-21T14:44:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9400640 1 -- 172.21.15.78:0/940915259 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7f44ac001a00 con 0x7f44bc1529d0 2024-05-21T14:44:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9400640 1 -- 172.21.15.78:0/940915259 >> v1:172.21.15.78:6789/0 conn(0x7f44bc1529d0 legacy=0x7f44bc072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9400640 1 --2- 172.21.15.78:0/940915259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0005d90 0x7f44a00061e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9400640 1 --2- 172.21.15.78:0/940915259 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44bc071fe0 0x7f44a0006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9400640 1 --2- 172.21.15.78:0/940915259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a0006f60 0x7f44a00073b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9400640 1 -- 172.21.15.78:0/940915259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f44bc0c8530 con 0x7f44a0006f60 2024-05-21T14:44:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9400640 1 -- 172.21.15.78:0/940915259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f44a000dd70 con 0x7f44a0005d90 2024-05-21T14:44:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9400640 1 -- 172.21.15.78:0/940915259 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f44a000df40 con 0x7f44bc071fe0 2024-05-21T14:44:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44ba800640 1 --2- 172.21.15.78:0/940915259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a0006f60 0x7f44a00073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b1400640 1 --2- 172.21.15.78:0/940915259 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44bc071fe0 0x7f44a0006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44b9e00640 1 --2- 172.21.15.78:0/940915259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0005d90 0x7f44a00061e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44ba800640 1 -- 172.21.15.78:0/940915259 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44bc071fe0 msgr2=0x7f44a0006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:44:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44ba800640 1 --2- 172.21.15.78:0/940915259 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44bc071fe0 0x7f44a0006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44ba800640 1 -- 172.21.15.78:0/940915259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0005d90 msgr2=0x7f44a00061e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:44:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44ba800640 1 --2- 172.21.15.78:0/940915259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0005d90 0x7f44a00061e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.620+0000 7f44ba800640 1 -- 172.21.15.78:0/940915259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a0005740 con 0x7f44a0006f60 2024-05-21T14:44:03.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.624+0000 7f44ba800640 1 --2- 172.21.15.78:0/940915259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a0006f60 0x7f44a00073b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f44bc06cbe0 tx=0x7f44b401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848457e1873c1f28 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:03.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.624+0000 7f44b9400640 1 -- 172.21.15.78:0/940915259 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b40b0070 con 0x7f44a0006f60 2024-05-21T14:44:03.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.624+0000 7f44b9400640 1 -- 172.21.15.78:0/940915259 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b40052f0 con 0x7f44a0006f60 2024-05-21T14:44:03.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.624+0000 7f44b9400640 1 -- 172.21.15.78:0/940915259 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b4001520 con 0x7f44a0006f60 2024-05-21T14:44:03.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.624+0000 7f44c1200640 1 -- 172.21.15.78:0/940915259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a0006f60 msgr2=0x7f44a00073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:03.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.624+0000 7f44c1200640 1 --2- 172.21.15.78:0/940915259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a0006f60 0x7f44a00073b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f44bc06cbe0 tx=0x7f44b401c500 comp rx=0 tx=0).stop 2024-05-21T14:44:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.624+0000 7f44ba800640 1 -- 172.21.15.78:0/940915259 reap_dead start 2024-05-21T14:44:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.624+0000 7f44c1200640 1 -- 172.21.15.78:0/940915259 shutdown_connections 2024-05-21T14:44:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.624+0000 7f44c1200640 1 -- 172.21.15.78:0/940915259 >> 172.21.15.78:0/940915259 conn(0x7f44bc0c9380 msgr2=0x7f44bc0c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.624+0000 7f44c1200640 1 -- 172.21.15.78:0/940915259 shutdown_connections 2024-05-21T14:44:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.624+0000 7f44c1200640 1 -- 172.21.15.78:0/940915259 wait complete. 2024-05-21T14:44:03.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44c1200640 1 Processor -- start 2024-05-21T14:44:03.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44c1200640 1 -- start start 2024-05-21T14:44:03.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44c1200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a0006f60 0x7f44bc15a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:03.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44c1200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44bc1f2fc0 0x7f44bc159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:03.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44c1200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44bc1514b0 0x7f44bc13eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:03.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44c1200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f44bc0c3a20 con 0x7f44a0006f60 2024-05-21T14:44:03.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44c1200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f44bc0c38a0 con 0x7f44bc1f2fc0 2024-05-21T14:44:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44c1200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f44bc0723f0 con 0x7f44bc1514b0 2024-05-21T14:44:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44b9e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a0006f60 0x7f44bc15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44b9e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a0006f60 0x7f44bc15a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35134/0 (socket says 172.21.15.78:35134) 2024-05-21T14:44:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44b9e00640 1 -- 172.21.15.78:0/1839198690 learned_addr learned my addr 172.21.15.78:0/1839198690 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:44:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44ba800640 1 --2- 172.21.15.78:0/1839198690 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44bc1514b0 0x7f44bc13eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44b1400640 1 --2- 172.21.15.78:0/1839198690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44bc1f2fc0 0x7f44bc159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44b9e00640 1 -- 172.21.15.78:0/1839198690 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44bc1514b0 msgr2=0x7f44bc13eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44b9e00640 1 --2- 172.21.15.78:0/1839198690 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44bc1514b0 0x7f44bc13eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44b9e00640 1 -- 172.21.15.78:0/1839198690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44bc1f2fc0 msgr2=0x7f44bc159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44b9e00640 1 --2- 172.21.15.78:0/1839198690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44bc1f2fc0 0x7f44bc159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44b9e00640 1 -- 172.21.15.78:0/1839198690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44bc14acc0 con 0x7f44a0006f60 2024-05-21T14:44:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44b9e00640 1 --2- 172.21.15.78:0/1839198690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a0006f60 0x7f44bc15a530 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007320 tx=0x7f44ac0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44b2a00640 1 -- 172.21.15.78:0/1839198690 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac01c070 con 0x7f44a0006f60 2024-05-21T14:44:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44b2a00640 1 -- 172.21.15.78:0/1839198690 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44ac004d70 con 0x7f44a0006f60 2024-05-21T14:44:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44b2a00640 1 -- 172.21.15.78:0/1839198690 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac010040 con 0x7f44a0006f60 2024-05-21T14:44:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44c1200640 1 -- 172.21.15.78:0/1839198690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44bc1f2500 con 0x7f44a0006f60 2024-05-21T14:44:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.628+0000 7f44c1200640 1 -- 172.21.15.78:0/1839198690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44bc1f27c0 con 0x7f44a0006f60 2024-05-21T14:44:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.632+0000 7f44c1200640 1 -- 172.21.15.78:0/1839198690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44bc1f2310 con 0x7f44a0006f60 2024-05-21T14:44:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.632+0000 7f44b2a00640 1 -- 172.21.15.78:0/1839198690 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f44ac011a10 con 0x7f44a0006f60 2024-05-21T14:44:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.632+0000 7f44b2a00640 1 --2- 172.21.15.78:0/1839198690 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f44980678f0 0x7f4498069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.632+0000 7f44b2a00640 1 -- 172.21.15.78:0/1839198690 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f44ac0888a0 con 0x7f44a0006f60 2024-05-21T14:44:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.632+0000 7f44b1400640 1 --2- 172.21.15.78:0/1839198690 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f44980678f0 0x7f4498069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:03.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.632+0000 7f44b1400640 1 --2- 172.21.15.78:0/1839198690 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f44980678f0 0x7f4498069e00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f44bc1eff40 tx=0x7f44a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:03.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.636+0000 7f44b2a00640 1 -- 172.21.15.78:0/1839198690 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f44ac0593b0 con 0x7f44a0006f60 2024-05-21T14:44:03.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.824+0000 7f44c1200640 1 -- 172.21.15.78:0/1839198690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44bc04f730 con 0x7f44a0006f60 2024-05-21T14:44:03.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.828+0000 7f44b2a00640 1 -- 172.21.15.78:0/1839198690 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6906 (secure 0 0 0) 0x7f44ac058cb0 con 0x7f44a0006f60 2024-05-21T14:44:03.837 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:44:03.837 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1952345794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1952345794},{"type":"v1","addr":"172.21.15.78:6833","nonce":1952345794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T14:43:18.985546+0000","modified":"2024-05-21T14:43:48.761495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4321,"mds_1":4300,"mds_2":4297,"mds_3":4294,"mds_4":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6836/3517628193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3517628193},{"type":"v1","addr":"172.21.15.78:6836","nonce":3517628193}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":9,"addr":"172.21.15.84:6835/3155872080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3155872080},{"type":"v1","addr":"172.21.15.84:6835","nonce":3155872080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6838/1750816366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1750816366},{"type":"v1","addr":"172.21.15.84:6838","nonce":1750816366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6839/4232079477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6837","nonce":4232079477},{"type":"v1","addr":"172.21.15.84:6839","nonce":4232079477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6837/1924967428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1924967428},{"type":"v1","addr":"172.21.15.78:6837","nonce":1924967428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4272,4294,4297,4300,4321]},"id":1}]} 2024-05-21T14:44:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 16 2024-05-21T14:44:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.832+0000 7f44c1200640 1 -- 172.21.15.78:0/1839198690 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f44980678f0 msgr2=0x7f4498069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.832+0000 7f44c1200640 1 --2- 172.21.15.78:0/1839198690 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f44980678f0 0x7f4498069e00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f44bc1eff40 tx=0x7f44a4008040 comp rx=0 tx=0).stop 2024-05-21T14:44:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.832+0000 7f44c1200640 1 -- 172.21.15.78:0/1839198690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a0006f60 msgr2=0x7f44bc15a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.832+0000 7f44c1200640 1 --2- 172.21.15.78:0/1839198690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a0006f60 0x7f44bc15a530 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007320 tx=0x7f44ac0077e0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.832+0000 7f44c1200640 1 -- 172.21.15.78:0/1839198690 shutdown_connections 2024-05-21T14:44:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.832+0000 7f44c1200640 1 --2- 172.21.15.78:0/1839198690 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f44980678f0 0x7f4498069e00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.832+0000 7f44c1200640 1 --2- 172.21.15.78:0/1839198690 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44bc1514b0 0x7f44bc13eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.832+0000 7f44c1200640 1 --2- 172.21.15.78:0/1839198690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44bc1f2fc0 0x7f44bc159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.832+0000 7f44c1200640 1 --2- 172.21.15.78:0/1839198690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a0006f60 0x7f44bc15a530 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:03.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.832+0000 7f44c1200640 1 -- 172.21.15.78:0/1839198690 >> 172.21.15.78:0/1839198690 conn(0x7f44bc0c9380 msgr2=0x7f44bc0c5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:03.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.832+0000 7f44c1200640 1 -- 172.21.15.78:0/1839198690 shutdown_connections 2024-05-21T14:44:03.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.832+0000 7f44c1200640 1 -- 172.21.15.78:0/1839198690 wait complete. 2024-05-21T14:44:03.859 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:44:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.996+0000 7fb5db000640 1 Processor -- start 2024-05-21T14:44:04.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:03.996+0000 7fb5db000640 1 -- start start 2024-05-21T14:44:04.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.000+0000 7fb5db000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb5d4071fe0 0x7fb5d40723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:04.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.000+0000 7fb5db000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5d40c5640 0x7fb5d40c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:04.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.000+0000 7fb5db000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5d40715f0 con 0x7fb5d41529d0 2024-05-21T14:44:04.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.000+0000 7fb5db000640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fb5d4072b80 con 0x7fb5d4071fe0 2024-05-21T14:44:04.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.000+0000 7fb5db000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d40c8530 con 0x7fb5d40c5640 2024-05-21T14:44:04.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.000+0000 7fb5d3400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb5d4071fe0 0x7fb5d40723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:04.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.000+0000 7fb5d3400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb5d4071fe0 0x7fb5d40723f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35150/0 (socket says 172.21.15.78:35150) 2024-05-21T14:44:04.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.000+0000 7fb5d3400640 1 -- 172.21.15.78:0/335795568 learned_addr learned my addr 172.21.15.78:0/335795568 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:44:04.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.000+0000 7fb5d9000640 1 --2- 172.21.15.78:0/335795568 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5d40c5640 0x7fb5d40c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:04.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.000+0000 7fb5d3400640 1 -- 172.21.15.78:0/335795568 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5d40c5640 msgr2=0x7fb5d40c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:44:04.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.000+0000 7fb5d3400640 1 --2- 172.21.15.78:0/335795568 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5d40c5640 0x7fb5d40c5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.000+0000 7fb5d3400640 1 -- 172.21.15.78:0/335795568 >> v1:172.21.15.84:6789/0 conn(0x7fb5d41529d0 legacy=0x7fb5d4072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.000+0000 7fb5d3400640 1 -- 172.21.15.78:0/335795568 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d40c8810 con 0x7fb5d4071fe0 2024-05-21T14:44:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.004+0000 7fb5d3400640 1 --2- 172.21.15.78:0/335795568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d4071fe0 0x7fb5d40723f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009870 tx=0x7fb5c001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e64a8e0eb85ad85 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:04.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.004+0000 7fb5d2a00640 1 -- 172.21.15.78:0/335795568 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c00b2070 con 0x7fb5d4071fe0 2024-05-21T14:44:04.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.004+0000 7fb5d2a00640 1 -- 172.21.15.78:0/335795568 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c00a9070 con 0x7fb5d4071fe0 2024-05-21T14:44:04.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.004+0000 7fb5d2a00640 1 -- 172.21.15.78:0/335795568 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c00ad880 con 0x7fb5d4071fe0 2024-05-21T14:44:04.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.004+0000 7fb5db000640 1 -- 172.21.15.78:0/335795568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d4071fe0 msgr2=0x7fb5d40723f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:04.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.004+0000 7fb5db000640 1 --2- 172.21.15.78:0/335795568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d4071fe0 0x7fb5d40723f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009870 tx=0x7fb5c001c560 comp rx=0 tx=0).stop 2024-05-21T14:44:04.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.004+0000 7fb5db000640 1 -- 172.21.15.78:0/335795568 shutdown_connections 2024-05-21T14:44:04.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.004+0000 7fb5db000640 1 --2- 172.21.15.78:0/335795568 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5d40c5640 0x7fb5d40c5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:04.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.004+0000 7fb5db000640 1 --2- 172.21.15.78:0/335795568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d4071fe0 0x7fb5d40723f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:04.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.004+0000 7fb5db000640 1 -- 172.21.15.78:0/335795568 >> 172.21.15.78:0/335795568 conn(0x7fb5d40c9380 msgr2=0x7fb5d40c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:04.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.004+0000 7fb5db000640 1 -- 172.21.15.78:0/335795568 shutdown_connections 2024-05-21T14:44:04.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.004+0000 7fb5db000640 1 -- 172.21.15.78:0/335795568 wait complete. 2024-05-21T14:44:04.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.004+0000 7fb5db000640 1 Processor -- start 2024-05-21T14:44:04.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.004+0000 7fb5db000640 1 -- start start 2024-05-21T14:44:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5db000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5d4071fe0 0x7fb5d4154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5db000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5d40c5640 0x7fb5d40cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5db000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d41529d0 0x7fb5d40cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5db000640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d41658b0 con 0x7fb5d41529d0 2024-05-21T14:44:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5db000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d40c3ab0 con 0x7fb5d40c5640 2024-05-21T14:44:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5db000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d4165a30 con 0x7fb5d4071fe0 2024-05-21T14:44:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5d9000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d41529d0 0x7fb5d40cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5d9000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d41529d0 0x7fb5d40cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35158/0 (socket says 172.21.15.78:35158) 2024-05-21T14:44:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5d9000640 1 -- 172.21.15.78:0/3280141702 learned_addr learned my addr 172.21.15.78:0/3280141702 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:44:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5d3e00640 1 --2- 172.21.15.78:0/3280141702 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5d4071fe0 0x7fb5d4154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5d3400640 1 --2- 172.21.15.78:0/3280141702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5d40c5640 0x7fb5d40cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5d9000640 1 -- 172.21.15.78:0/3280141702 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5d4071fe0 msgr2=0x7fb5d4154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5d9000640 1 --2- 172.21.15.78:0/3280141702 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5d4071fe0 0x7fb5d4154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5d9000640 1 -- 172.21.15.78:0/3280141702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5d40c5640 msgr2=0x7fb5d40cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5d9000640 1 --2- 172.21.15.78:0/3280141702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5d40c5640 0x7fb5d40cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5d9000640 1 -- 172.21.15.78:0/3280141702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d40ca920 con 0x7fb5d41529d0 2024-05-21T14:44:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5d9000640 1 --2- 172.21.15.78:0/3280141702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d41529d0 0x7fb5d40cba70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc007cf0 tx=0x7fb5cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5cbe00640 1 -- 172.21.15.78:0/3280141702 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc014420 con 0x7fb5d41529d0 2024-05-21T14:44:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5cbe00640 1 -- 172.21.15.78:0/3280141702 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5cc019070 con 0x7fb5d41529d0 2024-05-21T14:44:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5cbe00640 1 -- 172.21.15.78:0/3280141702 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc014820 con 0x7fb5d41529d0 2024-05-21T14:44:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5db000640 1 -- 172.21.15.78:0/3280141702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d414f2e0 con 0x7fb5d41529d0 2024-05-21T14:44:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5db000640 1 -- 172.21.15.78:0/3280141702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d4153c60 con 0x7fb5d41529d0 2024-05-21T14:44:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.008+0000 7fb5db000640 1 -- 172.21.15.78:0/3280141702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5d404f730 con 0x7fb5d41529d0 2024-05-21T14:44:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.012+0000 7fb5cbe00640 1 -- 172.21.15.78:0/3280141702 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb5cc0149c0 con 0x7fb5d41529d0 2024-05-21T14:44:04.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.012+0000 7fb5cbe00640 1 --2- 172.21.15.78:0/3280141702 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb5b40678c0 0x7fb5b4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:44:04.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.012+0000 7fb5cbe00640 1 -- 172.21.15.78:0/3280141702 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb5cc0864b0 con 0x7fb5d41529d0 2024-05-21T14:44:04.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.012+0000 7fb5d3e00640 1 --2- 172.21.15.78:0/3280141702 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb5b40678c0 0x7fb5b4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:44:04.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.012+0000 7fb5d3e00640 1 --2- 172.21.15.78:0/3280141702 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb5b40678c0 0x7fb5b4069dd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4000f70 tx=0x7fb5c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:44:04.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.016+0000 7fb5cbe00640 1 -- 172.21.15.78:0/3280141702 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb5cc056f30 con 0x7fb5d41529d0 2024-05-21T14:44:04.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.172+0000 7fb5db000640 1 -- 172.21.15.78:0/3280141702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5d406fd00 con 0x7fb5d41529d0 2024-05-21T14:44:04.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.172+0000 7fb5cbe00640 1 -- 172.21.15.78:0/3280141702 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16585 (secure 0 0 0) 0x7fb5cc056830 con 0x7fb5d41529d0 2024-05-21T14:44:04.182 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:44:04.183 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:59.799293+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T14:43:17.088549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T14:43:18.012571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:44:04.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.176+0000 7fb5db000640 1 -- 172.21.15.78:0/3280141702 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb5b40678c0 msgr2=0x7fb5b4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:04.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.176+0000 7fb5db000640 1 --2- 172.21.15.78:0/3280141702 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb5b40678c0 0x7fb5b4069dd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4000f70 tx=0x7fb5c4009040 comp rx=0 tx=0).stop 2024-05-21T14:44:04.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.176+0000 7fb5db000640 1 -- 172.21.15.78:0/3280141702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d41529d0 msgr2=0x7fb5d40cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:44:04.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.176+0000 7fb5db000640 1 --2- 172.21.15.78:0/3280141702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d41529d0 0x7fb5d40cba70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc007cf0 tx=0x7fb5cc00e4b0 comp rx=0 tx=0).stop 2024-05-21T14:44:04.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.176+0000 7fb5db000640 1 -- 172.21.15.78:0/3280141702 shutdown_connections 2024-05-21T14:44:04.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.176+0000 7fb5db000640 1 --2- 172.21.15.78:0/3280141702 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb5b40678c0 0x7fb5b4069dd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:04.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.176+0000 7fb5db000640 1 --2- 172.21.15.78:0/3280141702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5d41529d0 0x7fb5d40cba70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:04.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.176+0000 7fb5db000640 1 --2- 172.21.15.78:0/3280141702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5d40c5640 0x7fb5d40cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:04.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.176+0000 7fb5db000640 1 --2- 172.21.15.78:0/3280141702 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5d4071fe0 0x7fb5d4154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:44:04.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.176+0000 7fb5db000640 1 -- 172.21.15.78:0/3280141702 >> 172.21.15.78:0/3280141702 conn(0x7fb5d40c9380 msgr2=0x7fb5d406f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:44:04.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.176+0000 7fb5db000640 1 -- 172.21.15.78:0/3280141702 shutdown_connections 2024-05-21T14:44:04.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:44:04.176+0000 7fb5db000640 1 -- 172.21.15.78:0/3280141702 wait complete. 2024-05-21T14:44:04.204 DEBUG:tasks.mds_thrash:Yielding 2024-05-21T14:44:04.205 INFO:teuthology.run_tasks:Running task workunit... 2024-05-21T14:44:04.217 INFO:tasks.workunit:Pulling workunits from ref d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-21T14:44:04.218 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-21T14:44:04.218 INFO:tasks.workunit:timeout=3h 2024-05-21T14:44:04.218 INFO:tasks.workunit:cleanup=True 2024-05-21T14:44:04.218 DEBUG:teuthology.orchestra.run.smithi078:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-21T14:44:04.219 INFO:tasks.mds_thrash.fs.[cephfs]:starting mds_do_thrash for fs cephfs 2024-05-21T14:44:04.219 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 105 secs before thrashing 2024-05-21T14:44:04.228 INFO:teuthology.orchestra.run.smithi078.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-21T14:44:04.228 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-21T14:44:04.228 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 2ch/44d Inode: 1 Links: 2 2024-05-21T14:44:04.228 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T14:44:04.228 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-21T14:44:04.228 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-05-21 14:43:24.578135665 +0000 2024-05-21T14:44:04.228 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-05-21 14:43:57.300902707 +0000 2024-05-21T14:44:04.228 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-05-21 14:43:24.578135665 +0000 2024-05-21T14:44:04.228 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-21T14:44:04.228 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-21T14:44:04.297 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-21T14:44:04.349 INFO:tasks.workunit.client.0.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-21T14:44:17.075 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:44:17.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:44:47.196 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:44:47.202 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:45:17.291 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:45:17.296 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:45:28.723 INFO:tasks.workunit.client.0.smithi078.stderr:Updating files: 66% (8220/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-21T14:45:29.587 INFO:tasks.workunit.client.0.smithi078.stderr:Note: switching to 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'. 2024-05-21T14:45:29.587 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-05-21T14:45:29.587 INFO:tasks.workunit.client.0.smithi078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-21T14:45:29.587 INFO:tasks.workunit.client.0.smithi078.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-21T14:45:29.587 INFO:tasks.workunit.client.0.smithi078.stderr:state without impacting any branches by switching back to a branch. 2024-05-21T14:45:29.587 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-05-21T14:45:29.588 INFO:tasks.workunit.client.0.smithi078.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-21T14:45:29.588 INFO:tasks.workunit.client.0.smithi078.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-21T14:45:29.588 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-05-21T14:45:29.588 INFO:tasks.workunit.client.0.smithi078.stderr: git switch -c 2024-05-21T14:45:29.588 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-05-21T14:45:29.588 INFO:tasks.workunit.client.0.smithi078.stderr:Or undo this operation with: 2024-05-21T14:45:29.588 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-05-21T14:45:29.588 INFO:tasks.workunit.client.0.smithi078.stderr: git switch - 2024-05-21T14:45:29.588 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-05-21T14:45:29.588 INFO:tasks.workunit.client.0.smithi078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-21T14:45:29.588 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-05-21T14:45:29.588 INFO:tasks.workunit.client.0.smithi078.stderr:HEAD is now at d2b507c724e Merge PR #56984 into wip-pdonnell-testing-20240517.203521-squid-debug 2024-05-21T14:45:29.602 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-21T14:45:29.611 INFO:tasks.workunit.client.0.smithi078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-21T14:45:29.614 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-21T14:45:29.614 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-21T14:45:30.378 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-21T14:45:30.465 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-21T14:45:30.520 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-21T14:45:30.522 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-21T14:45:30.522 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-21T14:45:30.574 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-21T14:45:30.580 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:45:30.580 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-21T14:45:30.631 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2024-05-21T14:45:30.632 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2024-05-21T14:45:30.632 DEBUG:teuthology.orchestra.run.smithi078:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2b507c724ef6c8295ee0a35d185cdab167fd61d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2024-05-21T14:45:32.505 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-21T14:45:32.506 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-21T14:45:32.541 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2024-05-21T14:45:32.541 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-21T14:45:33.469 DEBUG:teuthology.parallel:result is None 2024-05-21T14:45:33.469 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-21T14:45:33.497 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-21T14:45:33.498 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2024-05-21T14:45:33.509 INFO:tasks.mds_thrash:joining mds_thrasher 2024-05-21T14:45:33.509 INFO:tasks.mds_thrash.fs.[cephfs]:stat['max_mds'] = 0 2024-05-21T14:45:33.509 INFO:tasks.mds_thrash.fs.[cephfs]:stat['deactivate'] = 0 2024-05-21T14:45:33.509 INFO:tasks.mds_thrash.fs.[cephfs]:stat['kill'] = 0 2024-05-21T14:45:33.509 INFO:tasks.mds_thrash:done joining 2024-05-21T14:45:33.509 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-21T14:45:33.532 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-21T14:45:33.532 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:45:33.532 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-21T14:45:33.550 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-05-21T14:45:33.551 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-21T14:45:33.606 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:45:33.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.783+0000 7f00e7600640 1 Processor -- start 2024-05-21T14:45:33.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.783+0000 7f00e7600640 1 -- start start 2024-05-21T14:45:33.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.783+0000 7f00e7600640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f00e00c6760 0x7f00e00c7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:33.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.783+0000 7f00e7600640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00e0159f20 0x7f00e0073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:33.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.783+0000 7f00e7600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00e0153cd0 con 0x7f00e00736d0 2024-05-21T14:45:33.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.783+0000 7f00e7600640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f00e015cbb0 con 0x7f00e00c6760 2024-05-21T14:45:33.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.783+0000 7f00e7600640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f00e015cdf0 con 0x7f00e0159f20 2024-05-21T14:45:33.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.783+0000 7f00e4c00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f00e00c6760 0x7f00e00c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:33.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.783+0000 7f00e4c00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f00e00c6760 0x7f00e00c7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49590/0 (socket says 172.21.15.78:49590) 2024-05-21T14:45:33.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.783+0000 7f00e4c00640 1 -- 172.21.15.78:0/1082110037 learned_addr learned my addr 172.21.15.78:0/1082110037 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:33.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.783+0000 7f00e5600640 1 --2- 172.21.15.78:0/1082110037 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00e0159f20 0x7f00e0073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:33.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.783+0000 7f00e4c00640 1 -- 172.21.15.78:0/1082110037 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00e0159f20 msgr2=0x7f00e0073ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:33.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.783+0000 7f00e4c00640 1 --2- 172.21.15.78:0/1082110037 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00e0159f20 0x7f00e0073ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:33.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.783+0000 7f00e4c00640 1 -- 172.21.15.78:0/1082110037 >> v1:172.21.15.84:6789/0 conn(0x7f00e00736d0 legacy=0x7f00e0159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:33.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.783+0000 7f00e4c00640 1 -- 172.21.15.78:0/1082110037 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e015d0d0 con 0x7f00e00c6760 2024-05-21T14:45:33.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.787+0000 7f00e4c00640 1 --2- 172.21.15.78:0/1082110037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00e00c6760 0x7f00e00c7310 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009870 tx=0x7f00d001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f824da49965e866a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:33.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.787+0000 7f00df400640 1 -- 172.21.15.78:0/1082110037 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d00b0070 con 0x7f00e00c6760 2024-05-21T14:45:33.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.787+0000 7f00df400640 1 -- 172.21.15.78:0/1082110037 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00d00ab600 con 0x7f00e00c6760 2024-05-21T14:45:33.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.787+0000 7f00df400640 1 -- 172.21.15.78:0/1082110037 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d00ab9d0 con 0x7f00e00c6760 2024-05-21T14:45:33.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.787+0000 7f00e7600640 1 -- 172.21.15.78:0/1082110037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00e00c6760 msgr2=0x7f00e00c7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:33.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.787+0000 7f00e7600640 1 --2- 172.21.15.78:0/1082110037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00e00c6760 0x7f00e00c7310 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009870 tx=0x7f00d001c520 comp rx=0 tx=0).stop 2024-05-21T14:45:33.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.787+0000 7f00e7600640 1 -- 172.21.15.78:0/1082110037 shutdown_connections 2024-05-21T14:45:33.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.787+0000 7f00e7600640 1 --2- 172.21.15.78:0/1082110037 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00e0159f20 0x7f00e0073ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:33.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.787+0000 7f00e7600640 1 --2- 172.21.15.78:0/1082110037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00e00c6760 0x7f00e00c7310 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:33.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.787+0000 7f00e7600640 1 -- 172.21.15.78:0/1082110037 >> 172.21.15.78:0/1082110037 conn(0x7f00e00c9380 msgr2=0x7f00e00c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:33.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.787+0000 7f00e7600640 1 -- 172.21.15.78:0/1082110037 shutdown_connections 2024-05-21T14:45:33.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.787+0000 7f00e7600640 1 -- 172.21.15.78:0/1082110037 wait complete. 2024-05-21T14:45:33.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.791+0000 7f00e7600640 1 Processor -- start 2024-05-21T14:45:33.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.791+0000 7f00e7600640 1 -- start start 2024-05-21T14:45:33.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.791+0000 7f00e7600640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00e00736d0 0x7f00e01463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:33.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.791+0000 7f00e7600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00e00c6760 0x7f00e00cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:33.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.791+0000 7f00e7600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00e0159f20 0x7f00e00cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:33.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.791+0000 7f00e7600640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f00e00c79d0 con 0x7f00e00c6760 2024-05-21T14:45:33.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.791+0000 7f00e7600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f00e00c7850 con 0x7f00e0159f20 2024-05-21T14:45:33.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.791+0000 7f00e7600640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f00e00c6b70 con 0x7f00e00736d0 2024-05-21T14:45:33.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.791+0000 7f00dfe00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00e00c6760 0x7f00e00cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:33.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.791+0000 7f00e4c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00e00736d0 0x7f00e01463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:33.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.791+0000 7f00dfe00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00e00c6760 0x7f00e00cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49592/0 (socket says 172.21.15.78:49592) 2024-05-21T14:45:33.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.791+0000 7f00dfe00640 1 -- 172.21.15.78:0/1388678218 learned_addr learned my addr 172.21.15.78:0/1388678218 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:33.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.791+0000 7f00e5600640 1 --2- 172.21.15.78:0/1388678218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00e0159f20 0x7f00e00cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:33.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.795+0000 7f00dfe00640 1 -- 172.21.15.78:0/1388678218 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00e00736d0 msgr2=0x7f00e01463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:33.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.795+0000 7f00dfe00640 1 --2- 172.21.15.78:0/1388678218 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00e00736d0 0x7f00e01463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:33.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.795+0000 7f00dfe00640 1 -- 172.21.15.78:0/1388678218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00e0159f20 msgr2=0x7f00e00cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:33.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.795+0000 7f00dfe00640 1 --2- 172.21.15.78:0/1388678218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00e0159f20 0x7f00e00cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:33.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.795+0000 7f00dfe00640 1 -- 172.21.15.78:0/1388678218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e015b1c0 con 0x7f00e00c6760 2024-05-21T14:45:33.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.795+0000 7f00e5600640 1 --2- 172.21.15.78:0/1388678218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00e0159f20 0x7f00e00cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:45:33.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.795+0000 7f00dfe00640 1 --2- 172.21.15.78:0/1388678218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00e00c6760 0x7f00e00cb7b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00b3c0 tx=0x7f00cc00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:33.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.795+0000 7f00dcc00640 1 -- 172.21.15.78:0/1388678218 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc011830 con 0x7f00e00c6760 2024-05-21T14:45:33.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.795+0000 7f00dcc00640 1 -- 172.21.15.78:0/1388678218 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00cc016070 con 0x7f00e00c6760 2024-05-21T14:45:33.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.795+0000 7f00dcc00640 1 -- 172.21.15.78:0/1388678218 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc011c30 con 0x7f00e00c6760 2024-05-21T14:45:33.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.795+0000 7f00e7600640 1 -- 172.21.15.78:0/1388678218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e015bcd0 con 0x7f00e00c6760 2024-05-21T14:45:33.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.795+0000 7f00e7600640 1 -- 172.21.15.78:0/1388678218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e0148a10 con 0x7f00e00c6760 2024-05-21T14:45:33.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.795+0000 7f00e7600640 1 -- 172.21.15.78:0/1388678218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e0157010 con 0x7f00e00c6760 2024-05-21T14:45:33.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.795+0000 7f00dcc00640 1 -- 172.21.15.78:0/1388678218 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00cc01b460 con 0x7f00e00c6760 2024-05-21T14:45:33.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.795+0000 7f00dcc00640 1 --2- 172.21.15.78:0/1388678218 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f00c00678c0 0x7f00c0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:33.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.795+0000 7f00dcc00640 1 -- 172.21.15.78:0/1388678218 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f00cc0857d0 con 0x7f00e00c6760 2024-05-21T14:45:33.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.799+0000 7f00e4c00640 1 --2- 172.21.15.78:0/1388678218 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f00c00678c0 0x7f00c0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:33.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.799+0000 7f00e4c00640 1 --2- 172.21.15.78:0/1388678218 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f00c00678c0 0x7f00c0069dd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f00d00ad000 tx=0x7f00d00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:33.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.803+0000 7f00dcc00640 1 -- 172.21.15.78:0/1388678218 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f00cc020020 con 0x7f00e00c6760 2024-05-21T14:45:33.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.955+0000 7f00e7600640 1 -- 172.21.15.78:0/1388678218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00e00c7d00 con 0x7f00e00c6760 2024-05-21T14:45:33.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.959+0000 7f00dcc00640 1 -- 172.21.15.78:0/1388678218 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16585 (secure 0 0 0) 0x7f00cc056250 con 0x7f00e00c6760 2024-05-21T14:45:33.968 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:45:33.968 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:59.799293+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T14:43:17.088549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T14:43:18.012571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:45:33.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.959+0000 7f00e7600640 1 -- 172.21.15.78:0/1388678218 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f00c00678c0 msgr2=0x7f00c0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:33.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.959+0000 7f00e7600640 1 --2- 172.21.15.78:0/1388678218 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f00c00678c0 0x7f00c0069dd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f00d00ad000 tx=0x7f00d00a6000 comp rx=0 tx=0).stop 2024-05-21T14:45:33.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.959+0000 7f00e7600640 1 -- 172.21.15.78:0/1388678218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00e00c6760 msgr2=0x7f00e00cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:33.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.959+0000 7f00e7600640 1 --2- 172.21.15.78:0/1388678218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00e00c6760 0x7f00e00cb7b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00b3c0 tx=0x7f00cc00b880 comp rx=0 tx=0).stop 2024-05-21T14:45:33.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.959+0000 7f00e7600640 1 -- 172.21.15.78:0/1388678218 shutdown_connections 2024-05-21T14:45:33.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.959+0000 7f00e7600640 1 --2- 172.21.15.78:0/1388678218 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f00c00678c0 0x7f00c0069dd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:33.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.959+0000 7f00e7600640 1 --2- 172.21.15.78:0/1388678218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00e0159f20 0x7f00e00cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:33.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.959+0000 7f00e7600640 1 --2- 172.21.15.78:0/1388678218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00e00c6760 0x7f00e00cb7b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:33.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.959+0000 7f00e7600640 1 --2- 172.21.15.78:0/1388678218 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00e00736d0 0x7f00e01463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:33.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.959+0000 7f00e7600640 1 -- 172.21.15.78:0/1388678218 >> 172.21.15.78:0/1388678218 conn(0x7f00e00c9380 msgr2=0x7f00e0147600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:33.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.959+0000 7f00e7600640 1 -- 172.21.15.78:0/1388678218 shutdown_connections 2024-05-21T14:45:33.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:33.959+0000 7f00e7600640 1 -- 172.21.15.78:0/1388678218 wait complete. 2024-05-21T14:45:33.991 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-21T14:43:06.569415+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-21T14:43:17.088549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-21T14:43:18.012571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-21T14:45:33.992 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-21T14:45:34.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.131+0000 7f62cea00640 1 Processor -- start 2024-05-21T14:45:34.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.131+0000 7f62cea00640 1 -- start start 2024-05-21T14:45:34.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.135+0000 7f62cea00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62c80713d0 0x7f62c806b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:34.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.135+0000 7f62cea00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c80c8a60 con 0x7f62c8072d40 2024-05-21T14:45:34.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.135+0000 7f62cea00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c80c8d40 con 0x7f62c80717e0 2024-05-21T14:45:34.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.135+0000 7f62cea00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f62c8157e90 con 0x7f62c80713d0 2024-05-21T14:45:34.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.135+0000 7f62bf400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62c80713d0 0x7f62c806b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:34.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.135+0000 7f62c7e00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f62c8072d40 0x7f62c8151e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53206/0 (socket says 172.21.15.78:53206) 2024-05-21T14:45:34.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.135+0000 7f62c7e00640 1 -- 172.21.15.78:0/1178542608 learned_addr learned my addr 172.21.15.78:0/1178542608 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:45:34.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.135+0000 7f62bf400640 1 -- 172.21.15.78:0/1178542608 >> v1:172.21.15.84:6789/0 conn(0x7f62c80717e0 legacy=0x7f62c8162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:34.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.135+0000 7f62bf400640 1 -- 172.21.15.78:0/1178542608 >> v1:172.21.15.78:6789/0 conn(0x7f62c8072d40 legacy=0x7f62c8151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:34.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.135+0000 7f62bf400640 1 -- 172.21.15.78:0/1178542608 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c8158170 con 0x7f62c80713d0 2024-05-21T14:45:34.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.139+0000 7f62bf400640 1 --2- 172.21.15.78:0/1178542608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c80713d0 0x7f62c806b620 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f62b00097c0 tx=0x7f62b001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7ac49b3a1a2d54 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:34.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.139+0000 7f62c7400640 1 -- 172.21.15.78:0/1178542608 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b00b0070 con 0x7f62c80713d0 2024-05-21T14:45:34.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.139+0000 7f62c7400640 1 -- 172.21.15.78:0/1178542608 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b00ab600 con 0x7f62c80713d0 2024-05-21T14:45:34.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.139+0000 7f62c7400640 1 -- 172.21.15.78:0/1178542608 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b00ab9d0 con 0x7f62c80713d0 2024-05-21T14:45:34.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.139+0000 7f62cea00640 1 -- 172.21.15.78:0/1178542608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c80713d0 msgr2=0x7f62c806b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:34.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.139+0000 7f62cea00640 1 --2- 172.21.15.78:0/1178542608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c80713d0 0x7f62c806b620 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f62b00097c0 tx=0x7f62b001c4a0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.139+0000 7f62cea00640 1 -- 172.21.15.78:0/1178542608 shutdown_connections 2024-05-21T14:45:34.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.139+0000 7f62cea00640 1 --2- 172.21.15.78:0/1178542608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c80713d0 0x7f62c806b620 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.139+0000 7f62cea00640 1 -- 172.21.15.78:0/1178542608 >> 172.21.15.78:0/1178542608 conn(0x7f62c80cd1e0 msgr2=0x7f62c80c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:34.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.139+0000 7f62cea00640 1 -- 172.21.15.78:0/1178542608 shutdown_connections 2024-05-21T14:45:34.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.139+0000 7f62cea00640 1 -- 172.21.15.78:0/1178542608 wait complete. 2024-05-21T14:45:34.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.139+0000 7f62cea00640 1 Processor -- start 2024-05-21T14:45:34.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.139+0000 7f62cea00640 1 -- start start 2024-05-21T14:45:34.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62c80713d0 0x7f62c815b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:34.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cea00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f62c80717e0 0x7f62c8141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:34.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cea00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c8072d40 0x7f62c813eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:34.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cea00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f62c80c37e0 con 0x7f62c8072d40 2024-05-21T14:45:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cea00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f62c80c3660 con 0x7f62c80713d0 2024-05-21T14:45:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cea00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f62c8165d30 con 0x7f62c80717e0 2024-05-21T14:45:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cca00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c8072d40 0x7f62c813eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cca00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c8072d40 0x7f62c813eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49608/0 (socket says 172.21.15.78:49608) 2024-05-21T14:45:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cca00640 1 -- 172.21.15.78:0/234120201 learned_addr learned my addr 172.21.15.78:0/234120201 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62c7e00640 1 --2- 172.21.15.78:0/234120201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62c80713d0 0x7f62c815b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62bf400640 1 --2- 172.21.15.78:0/234120201 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f62c80717e0 0x7f62c8141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cca00640 1 -- 172.21.15.78:0/234120201 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f62c80717e0 msgr2=0x7f62c8141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cca00640 1 --2- 172.21.15.78:0/234120201 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f62c80717e0 0x7f62c8141520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cca00640 1 -- 172.21.15.78:0/234120201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62c80713d0 msgr2=0x7f62c815b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cca00640 1 --2- 172.21.15.78:0/234120201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62c80713d0 0x7f62c815b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cca00640 1 -- 172.21.15.78:0/234120201 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c81572c0 con 0x7f62c8072d40 2024-05-21T14:45:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cca00640 1 --2- 172.21.15.78:0/234120201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c8072d40 0x7f62c813eee0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f62c000c3f0 tx=0x7f62c000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62c4c00640 1 -- 172.21.15.78:0/234120201 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c00052d0 con 0x7f62c8072d40 2024-05-21T14:45:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62c4c00640 1 -- 172.21.15.78:0/234120201 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62c0005470 con 0x7f62c8072d40 2024-05-21T14:45:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62c4c00640 1 -- 172.21.15.78:0/234120201 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c0007260 con 0x7f62c8072d40 2024-05-21T14:45:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cea00640 1 -- 172.21.15.78:0/234120201 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c8157a40 con 0x7f62c8072d40 2024-05-21T14:45:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cea00640 1 -- 172.21.15.78:0/234120201 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c81f6850 con 0x7f62c8072d40 2024-05-21T14:45:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.143+0000 7f62cea00640 1 -- 172.21.15.78:0/234120201 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62c804f730 con 0x7f62c8072d40 2024-05-21T14:45:34.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.147+0000 7f62c4c00640 1 -- 172.21.15.78:0/234120201 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f62c0007400 con 0x7f62c8072d40 2024-05-21T14:45:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.147+0000 7f62c4c00640 1 --2- 172.21.15.78:0/234120201 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f62a40678f0 0x7f62a4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.147+0000 7f62c4c00640 1 -- 172.21.15.78:0/234120201 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f62c00850e0 con 0x7f62c8072d40 2024-05-21T14:45:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.147+0000 7f62c7e00640 1 --2- 172.21.15.78:0/234120201 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f62a40678f0 0x7f62a4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.147+0000 7f62c7e00640 1 --2- 172.21.15.78:0/234120201 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f62a40678f0 0x7f62a4069e00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f62b80012f0 tx=0x7f62b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:34.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.151+0000 7f62c4c00640 1 -- 172.21.15.78:0/234120201 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f62c0055480 con 0x7f62c8072d40 2024-05-21T14:45:34.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.307+0000 7f62cea00640 1 -- 172.21.15.78:0/234120201 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f62c806eb50 con 0x7f62c8072d40 2024-05-21T14:45:34.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.307+0000 7f62c4c00640 1 -- 172.21.15.78:0/234120201 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f62c0059780 con 0x7f62c8072d40 2024-05-21T14:45:34.317 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-05-21T14:45:34.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.311+0000 7f62cea00640 1 -- 172.21.15.78:0/234120201 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f62a40678f0 msgr2=0x7f62a4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:34.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.311+0000 7f62cea00640 1 --2- 172.21.15.78:0/234120201 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f62a40678f0 0x7f62a4069e00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f62b80012f0 tx=0x7f62b8009040 comp rx=0 tx=0).stop 2024-05-21T14:45:34.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.311+0000 7f62cea00640 1 -- 172.21.15.78:0/234120201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c8072d40 msgr2=0x7f62c813eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:34.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.311+0000 7f62cea00640 1 --2- 172.21.15.78:0/234120201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c8072d40 0x7f62c813eee0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f62c000c3f0 tx=0x7f62c000c8b0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.311+0000 7f62cea00640 1 -- 172.21.15.78:0/234120201 shutdown_connections 2024-05-21T14:45:34.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.311+0000 7f62cea00640 1 --2- 172.21.15.78:0/234120201 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f62a40678f0 0x7f62a4069e00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.311+0000 7f62cea00640 1 --2- 172.21.15.78:0/234120201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c8072d40 0x7f62c813eee0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.311+0000 7f62cea00640 1 --2- 172.21.15.78:0/234120201 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f62c80717e0 0x7f62c8141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.311+0000 7f62cea00640 1 --2- 172.21.15.78:0/234120201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62c80713d0 0x7f62c815b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.311+0000 7f62cea00640 1 -- 172.21.15.78:0/234120201 >> 172.21.15.78:0/234120201 conn(0x7f62c80cd1e0 msgr2=0x7f62c806f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:34.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.311+0000 7f62cea00640 1 -- 172.21.15.78:0/234120201 shutdown_connections 2024-05-21T14:45:34.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.311+0000 7f62cea00640 1 -- 172.21.15.78:0/234120201 wait complete. 2024-05-21T14:45:34.339 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-21T14:45:34.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.479+0000 7f79b4000640 1 Processor -- start 2024-05-21T14:45:34.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.479+0000 7f79b4000640 1 -- start start 2024-05-21T14:45:34.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.479+0000 7f79b4000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f79ac1527a0 0x7f79ac0c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:34.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.479+0000 7f79b4000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f79ac0c5980 0x7f79ac162e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:34.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.479+0000 7f79b4000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79ac0737e0 con 0x7f79ac0733d0 2024-05-21T14:45:34.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.479+0000 7f79b4000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f79ac072980 con 0x7f79ac0c5980 2024-05-21T14:45:34.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.479+0000 7f79b4000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f79ac072f40 con 0x7f79ac1527a0 2024-05-21T14:45:34.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.479+0000 7f79b2000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f79ac0c5980 0x7f79ac162e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:34.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.479+0000 7f79b0c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f79ac1527a0 0x7f79ac0c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:34.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.479+0000 7f79b1600640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f79ac0733d0 0x7f79ac071910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.78:33060/0 (socket says 172.21.15.78:33060) 2024-05-21T14:45:34.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.479+0000 7f79b2000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f79ac0c5980 0x7f79ac162e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:48834/0 (socket says 172.21.15.78:48834) 2024-05-21T14:45:34.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.479+0000 7f79b1600640 1 -- 172.21.15.78:0/3743733434 learned_addr learned my addr 172.21.15.78:0/3743733434 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:45:34.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.483+0000 7f79b0c00640 1 -- 172.21.15.78:0/3743733434 >> v2:172.21.15.84:3300/0 conn(0x7f79ac0c5980 msgr2=0x7f79ac162e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:34.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.483+0000 7f79b0c00640 1 --2- 172.21.15.78:0/3743733434 >> v2:172.21.15.84:3300/0 conn(0x7f79ac0c5980 0x7f79ac162e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.483+0000 7f79b0c00640 1 -- 172.21.15.78:0/3743733434 >> v1:172.21.15.84:6789/0 conn(0x7f79ac0733d0 legacy=0x7f79ac071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:34.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.483+0000 7f79b0c00640 1 -- 172.21.15.78:0/3743733434 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ac073aa0 con 0x7f79ac1527a0 2024-05-21T14:45:34.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.483+0000 7f79b2000640 1 --2- 172.21.15.78:0/3743733434 >> v2:172.21.15.84:3300/0 conn(0x7f79ac0c5980 0x7f79ac162e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:45:34.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.483+0000 7f79b0c00640 1 --2- 172.21.15.78:0/3743733434 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f79ac1527a0 0x7f79ac0c5440 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f79ac072b00 tx=0x7f799801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af35057e472612fa server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:34.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.483+0000 7f79abe00640 1 -- 172.21.15.78:0/3743733434 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79980b5070 con 0x7f79ac1527a0 2024-05-21T14:45:34.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.483+0000 7f79abe00640 1 -- 172.21.15.78:0/3743733434 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79980a8990 con 0x7f79ac1527a0 2024-05-21T14:45:34.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.483+0000 7f79abe00640 1 -- 172.21.15.78:0/3743733434 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79980a8d60 con 0x7f79ac1527a0 2024-05-21T14:45:34.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.487+0000 7f79b4000640 1 -- 172.21.15.78:0/3743733434 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f79ac1527a0 msgr2=0x7f79ac0c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:34.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.487+0000 7f79b4000640 1 --2- 172.21.15.78:0/3743733434 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f79ac1527a0 0x7f79ac0c5440 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f79ac072b00 tx=0x7f799801ec90 comp rx=0 tx=0).stop 2024-05-21T14:45:34.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.487+0000 7f79b4000640 1 -- 172.21.15.78:0/3743733434 shutdown_connections 2024-05-21T14:45:34.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.487+0000 7f79b4000640 1 --2- 172.21.15.78:0/3743733434 >> v2:172.21.15.84:3300/0 conn(0x7f79ac0c5980 0x7f79ac162e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.487+0000 7f79b4000640 1 --2- 172.21.15.78:0/3743733434 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f79ac1527a0 0x7f79ac0c5440 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.487+0000 7f79b4000640 1 -- 172.21.15.78:0/3743733434 >> 172.21.15.78:0/3743733434 conn(0x7f79ac0cd1e0 msgr2=0x7f79ac0c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:34.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.487+0000 7f79b4000640 1 -- 172.21.15.78:0/3743733434 shutdown_connections 2024-05-21T14:45:34.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.487+0000 7f79b4000640 1 -- 172.21.15.78:0/3743733434 wait complete. 2024-05-21T14:45:34.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.487+0000 7f79b4000640 1 Processor -- start 2024-05-21T14:45:34.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.487+0000 7f79b4000640 1 -- start start 2024-05-21T14:45:34.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b4000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79ac0733d0 0x7f79ac154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:34.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b4000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f79ac0c5980 0x7f79ac1559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b4000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79ac1527a0 0x7f79ac147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b4000640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac072bd0 con 0x7f79ac0733d0 2024-05-21T14:45:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b4000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac074060 con 0x7f79ac1527a0 2024-05-21T14:45:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b4000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f79ac0ca100 con 0x7f79ac0c5980 2024-05-21T14:45:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b1600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79ac0733d0 0x7f79ac154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b1600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79ac0733d0 0x7f79ac154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49612/0 (socket says 172.21.15.78:49612) 2024-05-21T14:45:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b1600640 1 -- 172.21.15.78:0/3965428855 learned_addr learned my addr 172.21.15.78:0/3965428855 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b0c00640 1 --2- 172.21.15.78:0/3965428855 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f79ac0c5980 0x7f79ac1559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b2000640 1 --2- 172.21.15.78:0/3965428855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79ac1527a0 0x7f79ac147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:34.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b1600640 1 -- 172.21.15.78:0/3965428855 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f79ac0c5980 msgr2=0x7f79ac1559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:34.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b1600640 1 --2- 172.21.15.78:0/3965428855 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f79ac0c5980 0x7f79ac1559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b1600640 1 -- 172.21.15.78:0/3965428855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79ac1527a0 msgr2=0x7f79ac147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:34.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b1600640 1 --2- 172.21.15.78:0/3965428855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79ac1527a0 0x7f79ac147870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b1600640 1 -- 172.21.15.78:0/3965428855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ac155f00 con 0x7f79ac0733d0 2024-05-21T14:45:34.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b2000640 1 --2- 172.21.15.78:0/3965428855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79ac1527a0 0x7f79ac147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:45:34.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b1600640 1 --2- 172.21.15.78:0/3965428855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79ac0733d0 0x7f79ac154db0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f79a000c340 tx=0x7f79a000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:34.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79a9600640 1 -- 172.21.15.78:0/3965428855 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a0017070 con 0x7f79ac0733d0 2024-05-21T14:45:34.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79a9600640 1 -- 172.21.15.78:0/3965428855 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a0005cf0 con 0x7f79ac0733d0 2024-05-21T14:45:34.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79a9600640 1 -- 172.21.15.78:0/3965428855 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a00072f0 con 0x7f79ac0733d0 2024-05-21T14:45:34.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b4000640 1 -- 172.21.15.78:0/3965428855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ac147db0 con 0x7f79ac0733d0 2024-05-21T14:45:34.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b4000640 1 -- 172.21.15.78:0/3965428855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ac153b70 con 0x7f79ac0733d0 2024-05-21T14:45:34.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.491+0000 7f79b4000640 1 -- 172.21.15.78:0/3965428855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79ac0c8a20 con 0x7f79ac0733d0 2024-05-21T14:45:34.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.495+0000 7f79a9600640 1 -- 172.21.15.78:0/3965428855 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f79a001a070 con 0x7f79ac0733d0 2024-05-21T14:45:34.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.495+0000 7f79a9600640 1 --2- 172.21.15.78:0/3965428855 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f798c0678c0 0x7f798c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:34.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.495+0000 7f79a9600640 1 -- 172.21.15.78:0/3965428855 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f79a0084ee0 con 0x7f79ac0733d0 2024-05-21T14:45:34.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.495+0000 7f79b0c00640 1 --2- 172.21.15.78:0/3965428855 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f798c0678c0 0x7f798c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:34.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.495+0000 7f79b0c00640 1 --2- 172.21.15.78:0/3965428855 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f798c0678c0 0x7f798c069dd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f79980b2000 tx=0x7f79980aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:34.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.499+0000 7f79a9600640 1 -- 172.21.15.78:0/3965428855 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f79a00553a0 con 0x7f79ac0733d0 2024-05-21T14:45:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.659+0000 7f79b4000640 1 -- 172.21.15.78:0/3965428855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f79ac14f130 con 0x7f79ac0733d0 2024-05-21T14:45:34.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.659+0000 7f79a9600640 1 -- 172.21.15.78:0/3965428855 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f79a00596a0 con 0x7f79ac0733d0 2024-05-21T14:45:34.671 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-05-21T14:45:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.663+0000 7f79b4000640 1 -- 172.21.15.78:0/3965428855 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f798c0678c0 msgr2=0x7f798c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.663+0000 7f79b4000640 1 --2- 172.21.15.78:0/3965428855 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f798c0678c0 0x7f798c069dd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f79980b2000 tx=0x7f79980aa070 comp rx=0 tx=0).stop 2024-05-21T14:45:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.663+0000 7f79b4000640 1 -- 172.21.15.78:0/3965428855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79ac0733d0 msgr2=0x7f79ac154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.663+0000 7f79b4000640 1 --2- 172.21.15.78:0/3965428855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79ac0733d0 0x7f79ac154db0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f79a000c340 tx=0x7f79a000c800 comp rx=0 tx=0).stop 2024-05-21T14:45:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.663+0000 7f79b4000640 1 -- 172.21.15.78:0/3965428855 shutdown_connections 2024-05-21T14:45:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.663+0000 7f79b4000640 1 --2- 172.21.15.78:0/3965428855 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f798c0678c0 0x7f798c069dd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.663+0000 7f79b4000640 1 --2- 172.21.15.78:0/3965428855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79ac1527a0 0x7f79ac147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.663+0000 7f79b4000640 1 --2- 172.21.15.78:0/3965428855 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f79ac0c5980 0x7f79ac1559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.663+0000 7f79b4000640 1 --2- 172.21.15.78:0/3965428855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79ac0733d0 0x7f79ac154db0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.663+0000 7f79b4000640 1 -- 172.21.15.78:0/3965428855 >> 172.21.15.78:0/3965428855 conn(0x7f79ac0cd1e0 msgr2=0x7f79ac067680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:34.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.663+0000 7f79b4000640 1 -- 172.21.15.78:0/3965428855 shutdown_connections 2024-05-21T14:45:34.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.663+0000 7f79b4000640 1 -- 172.21.15.78:0/3965428855 wait complete. 2024-05-21T14:45:34.693 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-21T14:45:34.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.835+0000 7f2077e00640 1 Processor -- start 2024-05-21T14:45:34.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.835+0000 7f2077e00640 1 -- start start 2024-05-21T14:45:34.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.835+0000 7f2077e00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f20701527a0 0x7f20700c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:34.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.835+0000 7f2077e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f20700c5980 0x7f2070162e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:34.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.835+0000 7f2077e00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20700737e0 con 0x7f20700733d0 2024-05-21T14:45:34.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.835+0000 7f2077e00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f2070072980 con 0x7f20700c5980 2024-05-21T14:45:34.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.835+0000 7f2077e00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f2070072f40 con 0x7f20701527a0 2024-05-21T14:45:34.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.835+0000 7f2075400640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f20700733d0 0x7f2070071910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53208/0 (socket says 172.21.15.78:53208) 2024-05-21T14:45:34.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.835+0000 7f2075400640 1 -- 172.21.15.78:0/4045338004 learned_addr learned my addr 172.21.15.78:0/4045338004 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:45:34.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.835+0000 7f2075e00640 1 --2- 172.21.15.78:0/4045338004 >> v2:172.21.15.78:3300/0 conn(0x7f20700c5980 0x7f2070162e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:34.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.839+0000 7f2074a00640 1 --2- 172.21.15.78:0/4045338004 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f20701527a0 0x7f20700c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:34.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.839+0000 7f2075e00640 1 -- 172.21.15.78:0/4045338004 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f20701527a0 msgr2=0x7f20700c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:34.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.839+0000 7f2075e00640 1 --2- 172.21.15.78:0/4045338004 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f20701527a0 0x7f20700c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.839+0000 7f2075e00640 1 -- 172.21.15.78:0/4045338004 >> v1:172.21.15.78:6789/0 conn(0x7f20700733d0 legacy=0x7f2070071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:34.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.839+0000 7f2075e00640 1 -- 172.21.15.78:0/4045338004 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2070073aa0 con 0x7f20700c5980 2024-05-21T14:45:34.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.839+0000 7f2074a00640 1 --2- 172.21.15.78:0/4045338004 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f20701527a0 0x7f20700c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:45:34.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.839+0000 7f2075e00640 1 --2- 172.21.15.78:0/4045338004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20700c5980 0x7f2070162e30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2070072b00 tx=0x7f206801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db55da265579899 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:34.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.839+0000 7f206fe00640 1 -- 172.21.15.78:0/4045338004 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20680b5070 con 0x7f20700c5980 2024-05-21T14:45:34.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.839+0000 7f206fe00640 1 -- 172.21.15.78:0/4045338004 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20680a8990 con 0x7f20700c5980 2024-05-21T14:45:34.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.839+0000 7f206fe00640 1 -- 172.21.15.78:0/4045338004 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20680a8d60 con 0x7f20700c5980 2024-05-21T14:45:34.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.843+0000 7f2077e00640 1 -- 172.21.15.78:0/4045338004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20700c5980 msgr2=0x7f2070162e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:34.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.843+0000 7f2077e00640 1 --2- 172.21.15.78:0/4045338004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20700c5980 0x7f2070162e30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2070072b00 tx=0x7f206801ec90 comp rx=0 tx=0).stop 2024-05-21T14:45:34.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.843+0000 7f2077e00640 1 -- 172.21.15.78:0/4045338004 shutdown_connections 2024-05-21T14:45:34.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.843+0000 7f2077e00640 1 --2- 172.21.15.78:0/4045338004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20700c5980 0x7f2070162e30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.843+0000 7f2077e00640 1 --2- 172.21.15.78:0/4045338004 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f20701527a0 0x7f20700c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.843+0000 7f2077e00640 1 -- 172.21.15.78:0/4045338004 >> 172.21.15.78:0/4045338004 conn(0x7f20700cd1e0 msgr2=0x7f20700c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:34.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.843+0000 7f2077e00640 1 -- 172.21.15.78:0/4045338004 shutdown_connections 2024-05-21T14:45:34.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.843+0000 7f2077e00640 1 -- 172.21.15.78:0/4045338004 wait complete. 2024-05-21T14:45:34.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.843+0000 7f2077e00640 1 Processor -- start 2024-05-21T14:45:34.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.843+0000 7f2077e00640 1 -- start start 2024-05-21T14:45:34.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.843+0000 7f2077e00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f20700733d0 0x7f2070155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:34.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.843+0000 7f2077e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20700c5980 0x7f2070152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:34.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.843+0000 7f2077e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20701527a0 0x7f20701e3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:34.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.843+0000 7f2077e00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2070072bd0 con 0x7f20701527a0 2024-05-21T14:45:34.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.843+0000 7f2077e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2070074060 con 0x7f20700c5980 2024-05-21T14:45:34.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.843+0000 7f2077e00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f20700ca100 con 0x7f20700733d0 2024-05-21T14:45:34.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f2075e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20701527a0 0x7f20701e3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:34.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f2075e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20701527a0 0x7f20701e3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49622/0 (socket says 172.21.15.78:49622) 2024-05-21T14:45:34.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f2075e00640 1 -- 172.21.15.78:0/3984419766 learned_addr learned my addr 172.21.15.78:0/3984419766 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:34.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f2075400640 1 --2- 172.21.15.78:0/3984419766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f20700733d0 0x7f2070155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:34.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f2074a00640 1 --2- 172.21.15.78:0/3984419766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20700c5980 0x7f2070152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:34.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f2075e00640 1 -- 172.21.15.78:0/3984419766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f20700733d0 msgr2=0x7f2070155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:34.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f2075e00640 1 --2- 172.21.15.78:0/3984419766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f20700733d0 0x7f2070155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f2075e00640 1 -- 172.21.15.78:0/3984419766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20700c5980 msgr2=0x7f2070152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:34.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f2075e00640 1 --2- 172.21.15.78:0/3984419766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20700c5980 0x7f2070152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:34.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f2075e00640 1 -- 172.21.15.78:0/3984419766 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2070153870 con 0x7f20701527a0 2024-05-21T14:45:34.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f2075e00640 1 --2- 172.21.15.78:0/3984419766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20701527a0 0x7f20701e3820 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f206801c8c0 tx=0x7f206801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:34.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f206d600640 1 -- 172.21.15.78:0/3984419766 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20680bf070 con 0x7f20701527a0 2024-05-21T14:45:34.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f206d600640 1 -- 172.21.15.78:0/3984419766 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20680b0780 con 0x7f20701527a0 2024-05-21T14:45:34.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f2077e00640 1 -- 172.21.15.78:0/3984419766 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f207014bbb0 con 0x7f20701527a0 2024-05-21T14:45:34.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f206d600640 1 -- 172.21.15.78:0/3984419766 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20680b5040 con 0x7f20701527a0 2024-05-21T14:45:34.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f2077e00640 1 -- 172.21.15.78:0/3984419766 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2070154890 con 0x7f20701527a0 2024-05-21T14:45:34.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f2077e00640 1 -- 172.21.15.78:0/3984419766 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f207014b9a0 con 0x7f20701527a0 2024-05-21T14:45:34.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.847+0000 7f206d600640 1 -- 172.21.15.78:0/3984419766 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f20680c2070 con 0x7f20701527a0 2024-05-21T14:45:34.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.851+0000 7f206d600640 1 --2- 172.21.15.78:0/3984419766 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f20500678c0 0x7f2050069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:34.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.851+0000 7f206d600640 1 -- 172.21.15.78:0/3984419766 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f20681224e0 con 0x7f20701527a0 2024-05-21T14:45:34.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.851+0000 7f2075400640 1 --2- 172.21.15.78:0/3984419766 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f20500678c0 0x7f2050069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:34.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.851+0000 7f2075400640 1 --2- 172.21.15.78:0/3984419766 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f20500678c0 0x7f2050069dd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f20640012f0 tx=0x7f2064009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:34.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:34.855+0000 7f206d600640 1 -- 172.21.15.78:0/3984419766 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f20680187f0 con 0x7f20701527a0 2024-05-21T14:45:35.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.011+0000 7f2077e00640 1 -- 172.21.15.78:0/3984419766 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f20700c8a20 con 0x7f20701527a0 2024-05-21T14:45:35.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.011+0000 7f206d600640 1 -- 172.21.15.78:0/3984419766 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f20680f2f70 con 0x7f20701527a0 2024-05-21T14:45:35.020 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-05-21T14:45:35.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.011+0000 7f2077e00640 1 -- 172.21.15.78:0/3984419766 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f20500678c0 msgr2=0x7f2050069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:35.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.011+0000 7f2077e00640 1 --2- 172.21.15.78:0/3984419766 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f20500678c0 0x7f2050069dd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f20640012f0 tx=0x7f2064009040 comp rx=0 tx=0).stop 2024-05-21T14:45:35.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.011+0000 7f2077e00640 1 -- 172.21.15.78:0/3984419766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20701527a0 msgr2=0x7f20701e3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:35.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.011+0000 7f2077e00640 1 --2- 172.21.15.78:0/3984419766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20701527a0 0x7f20701e3820 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f206801c8c0 tx=0x7f206801ba30 comp rx=0 tx=0).stop 2024-05-21T14:45:35.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.011+0000 7f2077e00640 1 -- 172.21.15.78:0/3984419766 shutdown_connections 2024-05-21T14:45:35.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.011+0000 7f2077e00640 1 --2- 172.21.15.78:0/3984419766 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f20500678c0 0x7f2050069dd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.011+0000 7f2077e00640 1 --2- 172.21.15.78:0/3984419766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20701527a0 0x7f20701e3820 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.011+0000 7f2077e00640 1 --2- 172.21.15.78:0/3984419766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20700c5980 0x7f2070152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.011+0000 7f2077e00640 1 --2- 172.21.15.78:0/3984419766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f20700733d0 0x7f2070155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.011+0000 7f2077e00640 1 -- 172.21.15.78:0/3984419766 >> 172.21.15.78:0/3984419766 conn(0x7f20700cd1e0 msgr2=0x7f2070151580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:35.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.011+0000 7f2077e00640 1 -- 172.21.15.78:0/3984419766 shutdown_connections 2024-05-21T14:45:35.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.011+0000 7f2077e00640 1 -- 172.21.15.78:0/3984419766 wait complete. 2024-05-21T14:45:35.042 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-21T14:45:35.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.179+0000 7fc126800640 1 Processor -- start 2024-05-21T14:45:35.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.179+0000 7fc126800640 1 -- start start 2024-05-21T14:45:35.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.179+0000 7fc126800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc1200c7f90 0x7fc1201538d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:35.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.179+0000 7fc126800640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc1200c6540 0x7fc1200735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:35.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.179+0000 7fc126800640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1200c7240 con 0x7fc1200c5c30 2024-05-21T14:45:35.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.179+0000 7fc126800640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fc120153e10 con 0x7fc1200c6540 2024-05-21T14:45:35.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.179+0000 7fc126800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fc1200c4370 con 0x7fc1200c7f90 2024-05-21T14:45:35.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.179+0000 7fc11fe00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc1200c6540 0x7fc1200735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:35.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.179+0000 7fc11f400640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc1200c5c30 0x7fc12015cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53210/0 (socket says 172.21.15.78:53210) 2024-05-21T14:45:35.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.183+0000 7fc11f400640 1 -- 172.21.15.78:0/3737968540 learned_addr learned my addr 172.21.15.78:0/3737968540 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:45:35.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.183+0000 7fc116a00640 1 --2- 172.21.15.78:0/3737968540 >> v2:172.21.15.84:3300/0 conn(0x7fc1200c7f90 0x7fc1201538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:35.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.183+0000 7fc11fe00640 1 -- 172.21.15.78:0/3737968540 >> v2:172.21.15.84:3300/0 conn(0x7fc1200c7f90 msgr2=0x7fc1201538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:35.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.183+0000 7fc11fe00640 1 --2- 172.21.15.78:0/3737968540 >> v2:172.21.15.84:3300/0 conn(0x7fc1200c7f90 0x7fc1201538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.183+0000 7fc11fe00640 1 -- 172.21.15.78:0/3737968540 >> v1:172.21.15.78:6789/0 conn(0x7fc1200c5c30 legacy=0x7fc12015cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:35.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.183+0000 7fc11fe00640 1 -- 172.21.15.78:0/3737968540 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1200c74e0 con 0x7fc1200c6540 2024-05-21T14:45:35.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.183+0000 7fc11fe00640 1 --2- 172.21.15.78:0/3737968540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1200c6540 0x7fc1200735e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc1200c44f0 tx=0x7fc11801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d690fa86b61eec9b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:35.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.183+0000 7fc11ea00640 1 -- 172.21.15.78:0/3737968540 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1180b2070 con 0x7fc1200c6540 2024-05-21T14:45:35.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.183+0000 7fc11ea00640 1 -- 172.21.15.78:0/3737968540 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1180a57f0 con 0x7fc1200c6540 2024-05-21T14:45:35.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.183+0000 7fc11ea00640 1 -- 172.21.15.78:0/3737968540 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1180a5bc0 con 0x7fc1200c6540 2024-05-21T14:45:35.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.187+0000 7fc126800640 1 -- 172.21.15.78:0/3737968540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1200c6540 msgr2=0x7fc1200735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:35.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.187+0000 7fc126800640 1 --2- 172.21.15.78:0/3737968540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1200c6540 0x7fc1200735e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc1200c44f0 tx=0x7fc11801c930 comp rx=0 tx=0).stop 2024-05-21T14:45:35.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.187+0000 7fc126800640 1 -- 172.21.15.78:0/3737968540 shutdown_connections 2024-05-21T14:45:35.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.187+0000 7fc126800640 1 --2- 172.21.15.78:0/3737968540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1200c6540 0x7fc1200735e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.187+0000 7fc126800640 1 --2- 172.21.15.78:0/3737968540 >> v2:172.21.15.84:3300/0 conn(0x7fc1200c7f90 0x7fc1201538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.187+0000 7fc126800640 1 -- 172.21.15.78:0/3737968540 >> 172.21.15.78:0/3737968540 conn(0x7fc1200cd1e0 msgr2=0x7fc1200c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:35.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.187+0000 7fc126800640 1 -- 172.21.15.78:0/3737968540 shutdown_connections 2024-05-21T14:45:35.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.187+0000 7fc126800640 1 -- 172.21.15.78:0/3737968540 wait complete. 2024-05-21T14:45:35.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.187+0000 7fc126800640 1 Processor -- start 2024-05-21T14:45:35.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.187+0000 7fc126800640 1 -- start start 2024-05-21T14:45:35.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc126800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1200c5c30 0x7fc120162680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc126800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc1200c6540 0x7fc1201527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc126800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1200c7f90 0x7fc120149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc126800640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc1201669c0 con 0x7fc1200c5c30 2024-05-21T14:45:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc126800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc120166840 con 0x7fc1200c7f90 2024-05-21T14:45:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc126800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fc120166b40 con 0x7fc1200c6540 2024-05-21T14:45:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc11f400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1200c5c30 0x7fc120162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc11f400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1200c5c30 0x7fc120162680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49644/0 (socket says 172.21.15.78:49644) 2024-05-21T14:45:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc11f400640 1 -- 172.21.15.78:0/4148751144 learned_addr learned my addr 172.21.15.78:0/4148751144 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc116a00640 1 --2- 172.21.15.78:0/4148751144 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc1200c6540 0x7fc1201527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc11fe00640 1 --2- 172.21.15.78:0/4148751144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1200c7f90 0x7fc120149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc11f400640 1 -- 172.21.15.78:0/4148751144 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc1200c6540 msgr2=0x7fc1201527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc11f400640 1 --2- 172.21.15.78:0/4148751144 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc1200c6540 0x7fc1201527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc11f400640 1 -- 172.21.15.78:0/4148751144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1200c7f90 msgr2=0x7fc120149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc11f400640 1 --2- 172.21.15.78:0/4148751144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1200c7f90 0x7fc120149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc11f400640 1 -- 172.21.15.78:0/4148751144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc120162bc0 con 0x7fc1200c5c30 2024-05-21T14:45:35.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc11f400640 1 --2- 172.21.15.78:0/4148751144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1200c5c30 0x7fc120162680 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc11000c370 tx=0x7fc11000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:35.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc117e00640 1 -- 172.21.15.78:0/4148751144 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc110017070 con 0x7fc1200c5c30 2024-05-21T14:45:35.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc117e00640 1 -- 172.21.15.78:0/4148751144 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc110005cf0 con 0x7fc1200c5c30 2024-05-21T14:45:35.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc117e00640 1 -- 172.21.15.78:0/4148751144 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1100072f0 con 0x7fc1200c5c30 2024-05-21T14:45:35.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc126800640 1 -- 172.21.15.78:0/4148751144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1200c36f0 con 0x7fc1200c5c30 2024-05-21T14:45:35.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc126800640 1 -- 172.21.15.78:0/4148751144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1201f5bf0 con 0x7fc1200c5c30 2024-05-21T14:45:35.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc126800640 1 -- 172.21.15.78:0/4148751144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc120153a60 con 0x7fc1200c5c30 2024-05-21T14:45:35.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.191+0000 7fc117e00640 1 -- 172.21.15.78:0/4148751144 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc11001a070 con 0x7fc1200c5c30 2024-05-21T14:45:35.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.195+0000 7fc117e00640 1 --2- 172.21.15.78:0/4148751144 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fc0fc0678f0 0x7fc0fc069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:35.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.195+0000 7fc117e00640 1 -- 172.21.15.78:0/4148751144 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fc110084f50 con 0x7fc1200c5c30 2024-05-21T14:45:35.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.195+0000 7fc116a00640 1 --2- 172.21.15.78:0/4148751144 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fc0fc0678f0 0x7fc0fc069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:35.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.195+0000 7fc116a00640 1 --2- 172.21.15.78:0/4148751144 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fc0fc0678f0 0x7fc0fc069e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc1200c3910 tx=0x7fc108008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.199+0000 7fc117e00640 1 -- 172.21.15.78:0/4148751144 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fc110055a70 con 0x7fc1200c5c30 2024-05-21T14:45:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.363+0000 7fc126800640 1 -- 172.21.15.78:0/4148751144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc1200c7b40 con 0x7fc1200c5c30 2024-05-21T14:45:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.363+0000 7fc117e00640 1 -- 172.21.15.78:0/4148751144 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fc110055370 con 0x7fc1200c5c30 2024-05-21T14:45:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-05-21T14:45:35.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.367+0000 7fc126800640 1 -- 172.21.15.78:0/4148751144 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fc0fc0678f0 msgr2=0x7fc0fc069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:35.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.367+0000 7fc126800640 1 --2- 172.21.15.78:0/4148751144 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fc0fc0678f0 0x7fc0fc069e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc1200c3910 tx=0x7fc108008040 comp rx=0 tx=0).stop 2024-05-21T14:45:35.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.367+0000 7fc126800640 1 -- 172.21.15.78:0/4148751144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1200c5c30 msgr2=0x7fc120162680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:35.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.367+0000 7fc126800640 1 --2- 172.21.15.78:0/4148751144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1200c5c30 0x7fc120162680 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc11000c370 tx=0x7fc11000c830 comp rx=0 tx=0).stop 2024-05-21T14:45:35.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.367+0000 7fc126800640 1 -- 172.21.15.78:0/4148751144 shutdown_connections 2024-05-21T14:45:35.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.367+0000 7fc126800640 1 --2- 172.21.15.78:0/4148751144 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fc0fc0678f0 0x7fc0fc069e00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.367+0000 7fc126800640 1 --2- 172.21.15.78:0/4148751144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1200c7f90 0x7fc120149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.367+0000 7fc126800640 1 --2- 172.21.15.78:0/4148751144 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc1200c6540 0x7fc1201527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.367+0000 7fc126800640 1 --2- 172.21.15.78:0/4148751144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1200c5c30 0x7fc120162680 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.367+0000 7fc126800640 1 -- 172.21.15.78:0/4148751144 >> 172.21.15.78:0/4148751144 conn(0x7fc1200cd1e0 msgr2=0x7fc12014e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:35.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.367+0000 7fc126800640 1 -- 172.21.15.78:0/4148751144 shutdown_connections 2024-05-21T14:45:35.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.367+0000 7fc126800640 1 -- 172.21.15.78:0/4148751144 wait complete. 2024-05-21T14:45:35.395 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-21T14:45:35.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T14:45:35.396 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-21T14:45:35.456 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2024-05-21T14:45:35.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T14:45:35.457 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-21T14:45:35.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T14:45:35.492 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-05-21T14:45:35.543 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-21T14:45:35.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T14:45:35.544 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-21T14:45:35.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T14:45:35.612 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2024-05-21T14:45:35.805 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-21T14:45:35.815 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-21T14:45:35.816 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T14:45:35.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb36b200640 1 Processor -- start 2024-05-21T14:45:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb36b200640 1 -- start start 2024-05-21T14:45:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb36b200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb36c073990 0x7fb36c15cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb36b200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb36c161f80 0x7fb36c1643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb36b200640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb36c073da0 con 0x7fb36c153790 2024-05-21T14:45:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb36b200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fb36c0c99c0 con 0x7fb36c161f80 2024-05-21T14:45:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb36b200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb36c159610 con 0x7fb36c073990 2024-05-21T14:45:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb369400640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb36c153790 0x7fb36c0c6f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53212/0 (socket says 172.21.15.78:53212) 2024-05-21T14:45:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb369400640 1 -- 172.21.15.78:0/3031823877 learned_addr learned my addr 172.21.15.78:0/3031823877 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:45:35.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb369e00640 1 --2- 172.21.15.78:0/3031823877 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb36c073990 0x7fb36c15cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb36a800640 1 --2- 172.21.15.78:0/3031823877 >> v2:172.21.15.84:3300/0 conn(0x7fb36c161f80 0x7fb36c1643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb368a00640 1 -- 172.21.15.78:0/3031823877 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 367598029 0 0) 0x7fb358001120 con 0x7fb36c153790 2024-05-21T14:45:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb368a00640 1 -- 172.21.15.78:0/3031823877 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb350003530 con 0x7fb36c153790 2024-05-21T14:45:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb368a00640 1 -- 172.21.15.78:0/3031823877 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 566851721 0 0) 0x7fb350003530 con 0x7fb36c153790 2024-05-21T14:45:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb368a00640 1 -- 172.21.15.78:0/3031823877 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb36c073990 msgr2=0x7fb36c15cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb368a00640 1 --2- 172.21.15.78:0/3031823877 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb36c073990 0x7fb36c15cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb368a00640 1 -- 172.21.15.78:0/3031823877 >> v2:172.21.15.84:3300/0 conn(0x7fb36c161f80 msgr2=0x7fb36c1643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb368a00640 1 --2- 172.21.15.78:0/3031823877 >> v2:172.21.15.84:3300/0 conn(0x7fb36c161f80 0x7fb36c1643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb368a00640 1 -- 172.21.15.78:0/3031823877 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36c0c9c80 con 0x7fb36c153790 2024-05-21T14:45:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb368a00640 1 -- 172.21.15.78:0/3031823877 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7fb358001850 con 0x7fb36c153790 2024-05-21T14:45:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb368a00640 1 -- 172.21.15.78:0/3031823877 >> v1:172.21.15.78:6789/0 conn(0x7fb36c153790 legacy=0x7fb36c0c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb368a00640 1 --2- 172.21.15.78:0/3031823877 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb36c073990 0x7fb350003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:35.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb368a00640 1 --2- 172.21.15.78:0/3031823877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb350003fb0 0x7fb350004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb368a00640 1 --2- 172.21.15.78:0/3031823877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb350004d50 0x7fb350005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb368a00640 1 -- 172.21.15.78:0/3031823877 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c0c99c0 con 0x7fb350004d50 2024-05-21T14:45:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb368a00640 1 -- 172.21.15.78:0/3031823877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c159610 con 0x7fb350003fb0 2024-05-21T14:45:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb368a00640 1 -- 172.21.15.78:0/3031823877 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb35000bb30 con 0x7fb36c073990 2024-05-21T14:45:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.955+0000 7fb36a800640 1 --2- 172.21.15.78:0/3031823877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb350004d50 0x7fb350005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.959+0000 7fb369400640 1 --2- 172.21.15.78:0/3031823877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb350003fb0 0x7fb350004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.959+0000 7fb369e00640 1 --2- 172.21.15.78:0/3031823877 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb36c073990 0x7fb350003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.959+0000 7fb36a800640 1 -- 172.21.15.78:0/3031823877 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb36c073990 msgr2=0x7fb350003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.959+0000 7fb36a800640 1 --2- 172.21.15.78:0/3031823877 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb36c073990 0x7fb350003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.959+0000 7fb36a800640 1 -- 172.21.15.78:0/3031823877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb350003fb0 msgr2=0x7fb350004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.959+0000 7fb36a800640 1 --2- 172.21.15.78:0/3031823877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb350003fb0 0x7fb350004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.959+0000 7fb36a800640 1 -- 172.21.15.78:0/3031823877 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb350003530 con 0x7fb350004d50 2024-05-21T14:45:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.959+0000 7fb36a800640 1 --2- 172.21.15.78:0/3031823877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb350004d50 0x7fb350005160 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb364009ab0 tx=0x7fb36401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c3fc8602e2e6f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.959+0000 7fb368a00640 1 -- 172.21.15.78:0/3031823877 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3640b2070 con 0x7fb350004d50 2024-05-21T14:45:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.959+0000 7fb368a00640 1 -- 172.21.15.78:0/3031823877 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3640a5570 con 0x7fb350004d50 2024-05-21T14:45:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.959+0000 7fb368a00640 1 -- 172.21.15.78:0/3031823877 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3640096b0 con 0x7fb350004d50 2024-05-21T14:45:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.963+0000 7fb36b200640 1 -- 172.21.15.78:0/3031823877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb350004d50 msgr2=0x7fb350005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.963+0000 7fb36b200640 1 --2- 172.21.15.78:0/3031823877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb350004d50 0x7fb350005160 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb364009ab0 tx=0x7fb36401ca90 comp rx=0 tx=0).stop 2024-05-21T14:45:35.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.963+0000 7fb36a800640 1 -- 172.21.15.78:0/3031823877 reap_dead start 2024-05-21T14:45:35.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.963+0000 7fb36b200640 1 -- 172.21.15.78:0/3031823877 shutdown_connections 2024-05-21T14:45:35.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.963+0000 7fb36b200640 1 -- 172.21.15.78:0/3031823877 >> 172.21.15.78:0/3031823877 conn(0x7fb36c0ca390 msgr2=0x7fb36c0ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:35.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.963+0000 7fb36b200640 1 -- 172.21.15.78:0/3031823877 shutdown_connections 2024-05-21T14:45:35.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.963+0000 7fb36b200640 1 -- 172.21.15.78:0/3031823877 wait complete. 2024-05-21T14:45:35.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.963+0000 7fb36b200640 1 Processor -- start 2024-05-21T14:45:35.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.963+0000 7fb36b200640 1 -- start start 2024-05-21T14:45:35.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.963+0000 7fb36b200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb350004d50 0x7fb36c154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:35.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.963+0000 7fb36b200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb36c14d770 0x7fb36c145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:35.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.963+0000 7fb36b200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb36c14db80 0x7fb36c145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:35.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb36b200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c159bb0 con 0x7fb36c14d770 2024-05-21T14:45:35.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb36b200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c1598d0 con 0x7fb350004d50 2024-05-21T14:45:35.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb36b200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb36c159e90 con 0x7fb36c14db80 2024-05-21T14:45:35.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb369400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb36c14d770 0x7fb36c145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:35.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb369400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb36c14d770 0x7fb36c145220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49672/0 (socket says 172.21.15.78:49672) 2024-05-21T14:45:35.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb369400640 1 -- 172.21.15.78:0/4001033846 learned_addr learned my addr 172.21.15.78:0/4001033846 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:35.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb369e00640 1 --2- 172.21.15.78:0/4001033846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb350004d50 0x7fb36c154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:35.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb36a800640 1 --2- 172.21.15.78:0/4001033846 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb36c14db80 0x7fb36c145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:35.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb369400640 1 -- 172.21.15.78:0/4001033846 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb36c14db80 msgr2=0x7fb36c145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:35.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb369400640 1 --2- 172.21.15.78:0/4001033846 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb36c14db80 0x7fb36c145760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb369400640 1 -- 172.21.15.78:0/4001033846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb350004d50 msgr2=0x7fb36c154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:35.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb369400640 1 --2- 172.21.15.78:0/4001033846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb350004d50 0x7fb36c154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:35.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb369400640 1 -- 172.21.15.78:0/4001033846 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36c156ea0 con 0x7fb36c14d770 2024-05-21T14:45:35.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb36a800640 1 --2- 172.21.15.78:0/4001033846 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb36c14db80 0x7fb36c145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:45:35.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb369400640 1 --2- 172.21.15.78:0/4001033846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb36c14d770 0x7fb36c145220 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb358001ac0 tx=0x7fb358012630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb362000640 1 -- 172.21.15.78:0/4001033846 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35801c070 con 0x7fb36c14d770 2024-05-21T14:45:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb362000640 1 -- 172.21.15.78:0/4001033846 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb358014750 con 0x7fb36c14d770 2024-05-21T14:45:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb362000640 1 -- 172.21.15.78:0/4001033846 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358014b40 con 0x7fb36c14d770 2024-05-21T14:45:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb36b200640 1 -- 172.21.15.78:0/4001033846 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb36c0cccf0 con 0x7fb36c14d770 2024-05-21T14:45:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb36b200640 1 -- 172.21.15.78:0/4001033846 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb36c154460 con 0x7fb36c14d770 2024-05-21T14:45:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb36b200640 1 -- 172.21.15.78:0/4001033846 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb36c069f30 con 0x7fb36c14d770 2024-05-21T14:45:35.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.967+0000 7fb362000640 1 -- 172.21.15.78:0/4001033846 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb358014ce0 con 0x7fb36c14d770 2024-05-21T14:45:35.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.971+0000 7fb362000640 1 --2- 172.21.15.78:0/4001033846 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb34c0678f0 0x7fb34c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:35.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.971+0000 7fb362000640 1 -- 172.21.15.78:0/4001033846 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb3580882e0 con 0x7fb36c14d770 2024-05-21T14:45:35.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.971+0000 7fb369e00640 1 --2- 172.21.15.78:0/4001033846 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb34c0678f0 0x7fb34c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:35.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.971+0000 7fb369e00640 1 --2- 172.21.15.78:0/4001033846 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb34c0678f0 0x7fb34c069e00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb35c014510 tx=0x7fb35c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:35.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:35.975+0000 7fb362000640 1 -- 172.21.15.78:0/4001033846 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fb36c073da0 con 0x7fb36c14d770 2024-05-21T14:45:36.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.127+0000 7fb36b200640 1 -- 172.21.15.78:0/4001033846 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb36c153f30 con 0x7fb34c0678f0 2024-05-21T14:45:36.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.151+0000 7fb362000640 1 -- 172.21.15.78:0/4001033846 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252068 (secure 0 0 0) 0x7fb36c153f30 con 0x7fb34c0678f0 2024-05-21T14:45:36.160 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:45:36.161 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-05-21T14:45:36.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.151+0000 7fb36b200640 1 -- 172.21.15.78:0/4001033846 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb34c0678f0 msgr2=0x7fb34c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:36.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.151+0000 7fb36b200640 1 --2- 172.21.15.78:0/4001033846 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb34c0678f0 0x7fb34c069e00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb35c014510 tx=0x7fb35c00b040 comp rx=0 tx=0).stop 2024-05-21T14:45:36.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.151+0000 7fb36b200640 1 -- 172.21.15.78:0/4001033846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb36c14d770 msgr2=0x7fb36c145220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:36.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.151+0000 7fb36b200640 1 --2- 172.21.15.78:0/4001033846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb36c14d770 0x7fb36c145220 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb358001ac0 tx=0x7fb358012630 comp rx=0 tx=0).stop 2024-05-21T14:45:36.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.151+0000 7fb36b200640 1 -- 172.21.15.78:0/4001033846 shutdown_connections 2024-05-21T14:45:36.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.151+0000 7fb36b200640 1 --2- 172.21.15.78:0/4001033846 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fb34c0678f0 0x7fb34c069e00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.151+0000 7fb36b200640 1 --2- 172.21.15.78:0/4001033846 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb36c14db80 0x7fb36c145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.151+0000 7fb36b200640 1 --2- 172.21.15.78:0/4001033846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb36c14d770 0x7fb36c145220 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.151+0000 7fb36b200640 1 --2- 172.21.15.78:0/4001033846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb350004d50 0x7fb36c154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.151+0000 7fb36b200640 1 -- 172.21.15.78:0/4001033846 >> 172.21.15.78:0/4001033846 conn(0x7fb36c0ca390 msgr2=0x7fb36c0c8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:36.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.151+0000 7fb36b200640 1 -- 172.21.15.78:0/4001033846 shutdown_connections 2024-05-21T14:45:36.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.151+0000 7fb36b200640 1 -- 172.21.15.78:0/4001033846 wait complete. 2024-05-21T14:45:36.181 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2024-05-21T14:45:34.541257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":612359,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":380,"num_write_kb":2500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":309,"ondisk_log_size":309,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218572,"kb_used_data":2420,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756148,"statfs":{"total":773094113280,"available":772870295552,"internally_reserved":0,"allocated":2478080,"data_stored":1960875,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9027,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004917"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.175028+0000","last_change":"2024-05-21T14:43:19.606707+0000","last_active":"2024-05-21T14:44:00.175028+0000","last_peered":"2024-05-21T14:44:00.175028+0000","last_clean":"2024-05-21T14:44:00.175028+0000","last_became_active":"2024-05-21T14:43:19.606365+0000","last_became_peered":"2024-05-21T14:43:19.606365+0000","last_unstale":"2024-05-21T14:44:00.175028+0000","last_undegraded":"2024-05-21T14:44:00.175028+0000","last_fullsized":"2024-05-21T14:44:00.175028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:26.135357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172853+0000","last_change":"2024-05-21T14:43:19.632879+0000","last_active":"2024-05-21T14:44:00.172853+0000","last_peered":"2024-05-21T14:44:00.172853+0000","last_clean":"2024-05-21T14:44:00.172853+0000","last_became_active":"2024-05-21T14:43:19.632218+0000","last_became_peered":"2024-05-21T14:43:19.632218+0000","last_unstale":"2024-05-21T14:44:00.172853+0000","last_undegraded":"2024-05-21T14:44:00.172853+0000","last_fullsized":"2024-05-21T14:44:00.172853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:35:49.461861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173159+0000","last_change":"2024-05-21T14:43:19.620214+0000","last_active":"2024-05-21T14:44:00.173159+0000","last_peered":"2024-05-21T14:44:00.173159+0000","last_clean":"2024-05-21T14:44:00.173159+0000","last_became_active":"2024-05-21T14:43:19.619012+0000","last_became_peered":"2024-05-21T14:43:19.619012+0000","last_unstale":"2024-05-21T14:44:00.173159+0000","last_undegraded":"2024-05-21T14:44:00.173159+0000","last_fullsized":"2024-05-21T14:44:00.173159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:40:22.415178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.171875+0000","last_change":"2024-05-21T14:43:19.602199+0000","last_active":"2024-05-21T14:44:00.171875+0000","last_peered":"2024-05-21T14:44:00.171875+0000","last_clean":"2024-05-21T14:44:00.171875+0000","last_became_active":"2024-05-21T14:43:19.601797+0000","last_became_peered":"2024-05-21T14:43:19.601797+0000","last_unstale":"2024-05-21T14:44:00.171875+0000","last_undegraded":"2024-05-21T14:44:00.171875+0000","last_fullsized":"2024-05-21T14:44:00.171875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:33:00.071681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173080+0000","last_change":"2024-05-21T14:43:19.623449+0000","last_active":"2024-05-21T14:44:00.173080+0000","last_peered":"2024-05-21T14:44:00.173080+0000","last_clean":"2024-05-21T14:44:00.173080+0000","last_became_active":"2024-05-21T14:43:19.623125+0000","last_became_peered":"2024-05-21T14:43:19.623125+0000","last_unstale":"2024-05-21T14:44:00.173080+0000","last_undegraded":"2024-05-21T14:44:00.173080+0000","last_fullsized":"2024-05-21T14:44:00.173080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:42.178156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.171595+0000","last_change":"2024-05-21T14:43:19.591222+0000","last_active":"2024-05-21T14:44:00.171595+0000","last_peered":"2024-05-21T14:44:00.171595+0000","last_clean":"2024-05-21T14:44:00.171595+0000","last_became_active":"2024-05-21T14:43:19.590858+0000","last_became_peered":"2024-05-21T14:43:19.590858+0000","last_unstale":"2024-05-21T14:44:00.171595+0000","last_undegraded":"2024-05-21T14:44:00.171595+0000","last_fullsized":"2024-05-21T14:44:00.171595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:21:15.737192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172643+0000","last_change":"2024-05-21T14:43:19.614716+0000","last_active":"2024-05-21T14:44:00.172643+0000","last_peered":"2024-05-21T14:44:00.172643+0000","last_clean":"2024-05-21T14:44:00.172643+0000","last_became_active":"2024-05-21T14:43:19.614451+0000","last_became_peered":"2024-05-21T14:43:19.614451+0000","last_unstale":"2024-05-21T14:44:00.172643+0000","last_undegraded":"2024-05-21T14:44:00.172643+0000","last_fullsized":"2024-05-21T14:44:00.172643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:07:01.524574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172223+0000","last_change":"2024-05-21T14:43:19.604029+0000","last_active":"2024-05-21T14:44:00.172223+0000","last_peered":"2024-05-21T14:44:00.172223+0000","last_clean":"2024-05-21T14:44:00.172223+0000","last_became_active":"2024-05-21T14:43:19.603164+0000","last_became_peered":"2024-05-21T14:43:19.603164+0000","last_unstale":"2024-05-21T14:44:00.172223+0000","last_undegraded":"2024-05-21T14:44:00.172223+0000","last_fullsized":"2024-05-21T14:44:00.172223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:14:27.286952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813822+0000","last_change":"2024-05-21T14:43:19.613765+0000","last_active":"2024-05-21T14:43:59.813822+0000","last_peered":"2024-05-21T14:43:59.813822+0000","last_clean":"2024-05-21T14:43:59.813822+0000","last_became_active":"2024-05-21T14:43:19.613429+0000","last_became_peered":"2024-05-21T14:43:19.613429+0000","last_unstale":"2024-05-21T14:43:59.813822+0000","last_undegraded":"2024-05-21T14:43:59.813822+0000","last_fullsized":"2024-05-21T14:43:59.813822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:29:16.905434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174905+0000","last_change":"2024-05-21T14:43:19.607400+0000","last_active":"2024-05-21T14:44:00.174905+0000","last_peered":"2024-05-21T14:44:00.174905+0000","last_clean":"2024-05-21T14:44:00.174905+0000","last_became_active":"2024-05-21T14:43:19.607105+0000","last_became_peered":"2024-05-21T14:43:19.607105+0000","last_unstale":"2024-05-21T14:44:00.174905+0000","last_undegraded":"2024-05-21T14:44:00.174905+0000","last_fullsized":"2024-05-21T14:44:00.174905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:26:22.366105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.171923+0000","last_change":"2024-05-21T14:43:19.606534+0000","last_active":"2024-05-21T14:44:00.171923+0000","last_peered":"2024-05-21T14:44:00.171923+0000","last_clean":"2024-05-21T14:44:00.171923+0000","last_became_active":"2024-05-21T14:43:19.606029+0000","last_became_peered":"2024-05-21T14:43:19.606029+0000","last_unstale":"2024-05-21T14:44:00.171923+0000","last_undegraded":"2024-05-21T14:44:00.171923+0000","last_fullsized":"2024-05-21T14:44:00.171923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:33:48.849701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173535+0000","last_change":"2024-05-21T14:43:19.609910+0000","last_active":"2024-05-21T14:44:00.173535+0000","last_peered":"2024-05-21T14:44:00.173535+0000","last_clean":"2024-05-21T14:44:00.173535+0000","last_became_active":"2024-05-21T14:43:19.609616+0000","last_became_peered":"2024-05-21T14:43:19.609616+0000","last_unstale":"2024-05-21T14:44:00.173535+0000","last_undegraded":"2024-05-21T14:44:00.173535+0000","last_fullsized":"2024-05-21T14:44:00.173535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:36:16.637620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.199675+0000","last_change":"2024-05-21T14:43:19.604001+0000","last_active":"2024-05-21T14:44:00.199675+0000","last_peered":"2024-05-21T14:44:00.199675+0000","last_clean":"2024-05-21T14:44:00.199675+0000","last_became_active":"2024-05-21T14:43:19.596859+0000","last_became_peered":"2024-05-21T14:43:19.596859+0000","last_unstale":"2024-05-21T14:44:00.199675+0000","last_undegraded":"2024-05-21T14:44:00.199675+0000","last_fullsized":"2024-05-21T14:44:00.199675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:45:43.431420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:30.698277+0000","last_change":"2024-05-21T14:43:19.626837+0000","last_active":"2024-05-21T14:45:30.698277+0000","last_peered":"2024-05-21T14:45:30.698277+0000","last_clean":"2024-05-21T14:45:30.698277+0000","last_became_active":"2024-05-21T14:43:19.626213+0000","last_became_peered":"2024-05-21T14:43:19.626213+0000","last_unstale":"2024-05-21T14:45:30.698277+0000","last_undegraded":"2024-05-21T14:45:30.698277+0000","last_fullsized":"2024-05-21T14:45:30.698277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:51.705474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172174+0000","last_change":"2024-05-21T14:43:19.613483+0000","last_active":"2024-05-21T14:44:00.172174+0000","last_peered":"2024-05-21T14:44:00.172174+0000","last_clean":"2024-05-21T14:44:00.172174+0000","last_became_active":"2024-05-21T14:43:19.612581+0000","last_became_peered":"2024-05-21T14:43:19.612581+0000","last_unstale":"2024-05-21T14:44:00.172174+0000","last_undegraded":"2024-05-21T14:44:00.172174+0000","last_fullsized":"2024-05-21T14:44:00.172174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:41:15.797196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173301+0000","last_change":"2024-05-21T14:43:19.609126+0000","last_active":"2024-05-21T14:44:00.173301+0000","last_peered":"2024-05-21T14:44:00.173301+0000","last_clean":"2024-05-21T14:44:00.173301+0000","last_became_active":"2024-05-21T14:43:19.607967+0000","last_became_peered":"2024-05-21T14:43:19.607967+0000","last_unstale":"2024-05-21T14:44:00.173301+0000","last_undegraded":"2024-05-21T14:44:00.173301+0000","last_fullsized":"2024-05-21T14:44:00.173301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:35.881039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174418+0000","last_change":"2024-05-21T14:43:19.613487+0000","last_active":"2024-05-21T14:44:00.174418+0000","last_peered":"2024-05-21T14:44:00.174418+0000","last_clean":"2024-05-21T14:44:00.174418+0000","last_became_active":"2024-05-21T14:43:19.611280+0000","last_became_peered":"2024-05-21T14:43:19.611280+0000","last_unstale":"2024-05-21T14:44:00.174418+0000","last_undegraded":"2024-05-21T14:44:00.174418+0000","last_fullsized":"2024-05-21T14:44:00.174418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:51:21.887715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815794+0000","last_change":"2024-05-21T14:43:19.607601+0000","last_active":"2024-05-21T14:43:59.815794+0000","last_peered":"2024-05-21T14:43:59.815794+0000","last_clean":"2024-05-21T14:43:59.815794+0000","last_became_active":"2024-05-21T14:43:19.606719+0000","last_became_peered":"2024-05-21T14:43:19.606719+0000","last_unstale":"2024-05-21T14:43:59.815794+0000","last_undegraded":"2024-05-21T14:43:59.815794+0000","last_fullsized":"2024-05-21T14:43:59.815794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:04:32.310805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173869+0000","last_change":"2024-05-21T14:43:19.618470+0000","last_active":"2024-05-21T14:44:00.173869+0000","last_peered":"2024-05-21T14:44:00.173869+0000","last_clean":"2024-05-21T14:44:00.173869+0000","last_became_active":"2024-05-21T14:43:19.617408+0000","last_became_peered":"2024-05-21T14:43:19.617408+0000","last_unstale":"2024-05-21T14:44:00.173869+0000","last_undegraded":"2024-05-21T14:44:00.173869+0000","last_fullsized":"2024-05-21T14:44:00.173869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:53:58.877306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173639+0000","last_change":"2024-05-21T14:43:19.609835+0000","last_active":"2024-05-21T14:44:00.173639+0000","last_peered":"2024-05-21T14:44:00.173639+0000","last_clean":"2024-05-21T14:44:00.173639+0000","last_became_active":"2024-05-21T14:43:19.609525+0000","last_became_peered":"2024-05-21T14:43:19.609525+0000","last_unstale":"2024-05-21T14:44:00.173639+0000","last_undegraded":"2024-05-21T14:44:00.173639+0000","last_fullsized":"2024-05-21T14:44:00.173639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:57:04.748898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813570+0000","last_change":"2024-05-21T14:43:19.607732+0000","last_active":"2024-05-21T14:43:59.813570+0000","last_peered":"2024-05-21T14:43:59.813570+0000","last_clean":"2024-05-21T14:43:59.813570+0000","last_became_active":"2024-05-21T14:43:19.606839+0000","last_became_peered":"2024-05-21T14:43:19.606839+0000","last_unstale":"2024-05-21T14:43:59.813570+0000","last_undegraded":"2024-05-21T14:43:59.813570+0000","last_fullsized":"2024-05-21T14:43:59.813570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:43:15.675663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813363+0000","last_change":"2024-05-21T14:43:19.601108+0000","last_active":"2024-05-21T14:43:59.813363+0000","last_peered":"2024-05-21T14:43:59.813363+0000","last_clean":"2024-05-21T14:43:59.813363+0000","last_became_active":"2024-05-21T14:43:19.600780+0000","last_became_peered":"2024-05-21T14:43:19.600780+0000","last_unstale":"2024-05-21T14:43:59.813363+0000","last_undegraded":"2024-05-21T14:43:59.813363+0000","last_fullsized":"2024-05-21T14:43:59.813363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:47:19.062733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172432+0000","last_change":"2024-05-21T14:43:19.620463+0000","last_active":"2024-05-21T14:44:00.172432+0000","last_peered":"2024-05-21T14:44:00.172432+0000","last_clean":"2024-05-21T14:44:00.172432+0000","last_became_active":"2024-05-21T14:43:19.614489+0000","last_became_peered":"2024-05-21T14:43:19.614489+0000","last_unstale":"2024-05-21T14:44:00.172432+0000","last_undegraded":"2024-05-21T14:44:00.172432+0000","last_fullsized":"2024-05-21T14:44:00.172432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:51:07.953352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173470+0000","last_change":"2024-05-21T14:43:19.624683+0000","last_active":"2024-05-21T14:44:00.173470+0000","last_peered":"2024-05-21T14:44:00.173470+0000","last_clean":"2024-05-21T14:44:00.173470+0000","last_became_active":"2024-05-21T14:43:19.624304+0000","last_became_peered":"2024-05-21T14:43:19.624304+0000","last_unstale":"2024-05-21T14:44:00.173470+0000","last_undegraded":"2024-05-21T14:44:00.173470+0000","last_fullsized":"2024-05-21T14:44:00.173470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:53.874968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173284+0000","last_change":"2024-05-21T14:43:19.621030+0000","last_active":"2024-05-21T14:44:00.173284+0000","last_peered":"2024-05-21T14:44:00.173284+0000","last_clean":"2024-05-21T14:44:00.173284+0000","last_became_active":"2024-05-21T14:43:19.619072+0000","last_became_peered":"2024-05-21T14:43:19.619072+0000","last_unstale":"2024-05-21T14:44:00.173284+0000","last_undegraded":"2024-05-21T14:44:00.173284+0000","last_fullsized":"2024-05-21T14:44:00.173284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:22:09.423661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172157+0000","last_change":"2024-05-21T14:43:19.602880+0000","last_active":"2024-05-21T14:44:00.172157+0000","last_peered":"2024-05-21T14:44:00.172157+0000","last_clean":"2024-05-21T14:44:00.172157+0000","last_became_active":"2024-05-21T14:43:19.602577+0000","last_became_peered":"2024-05-21T14:43:19.602577+0000","last_unstale":"2024-05-21T14:44:00.172157+0000","last_undegraded":"2024-05-21T14:44:00.172157+0000","last_fullsized":"2024-05-21T14:44:00.172157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:04:10.094373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.200159+0000","last_change":"2024-05-21T14:43:19.632328+0000","last_active":"2024-05-21T14:44:00.200159+0000","last_peered":"2024-05-21T14:44:00.200159+0000","last_clean":"2024-05-21T14:44:00.200159+0000","last_became_active":"2024-05-21T14:43:19.631351+0000","last_became_peered":"2024-05-21T14:43:19.631351+0000","last_unstale":"2024-05-21T14:44:00.200159+0000","last_undegraded":"2024-05-21T14:44:00.200159+0000","last_fullsized":"2024-05-21T14:44:00.200159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:36:18.467070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.199755+0000","last_change":"2024-05-21T14:43:19.632282+0000","last_active":"2024-05-21T14:44:00.199755+0000","last_peered":"2024-05-21T14:44:00.199755+0000","last_clean":"2024-05-21T14:44:00.199755+0000","last_became_active":"2024-05-21T14:43:19.631522+0000","last_became_peered":"2024-05-21T14:43:19.631522+0000","last_unstale":"2024-05-21T14:44:00.199755+0000","last_undegraded":"2024-05-21T14:44:00.199755+0000","last_fullsized":"2024-05-21T14:44:00.199755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:23:32.646087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172783+0000","last_change":"2024-05-21T14:43:19.620046+0000","last_active":"2024-05-21T14:44:00.172783+0000","last_peered":"2024-05-21T14:44:00.172783+0000","last_clean":"2024-05-21T14:44:00.172783+0000","last_became_active":"2024-05-21T14:43:19.612428+0000","last_became_peered":"2024-05-21T14:43:19.612428+0000","last_unstale":"2024-05-21T14:44:00.172783+0000","last_undegraded":"2024-05-21T14:44:00.172783+0000","last_fullsized":"2024-05-21T14:44:00.172783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:08:33.785399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173737+0000","last_change":"2024-05-21T14:43:19.618198+0000","last_active":"2024-05-21T14:44:00.173737+0000","last_peered":"2024-05-21T14:44:00.173737+0000","last_clean":"2024-05-21T14:44:00.173737+0000","last_became_active":"2024-05-21T14:43:19.617903+0000","last_became_peered":"2024-05-21T14:43:19.617903+0000","last_unstale":"2024-05-21T14:44:00.173737+0000","last_undegraded":"2024-05-21T14:44:00.173737+0000","last_fullsized":"2024-05-21T14:44:00.173737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:59.606862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813652+0000","last_change":"2024-05-21T14:43:19.613942+0000","last_active":"2024-05-21T14:43:59.813652+0000","last_peered":"2024-05-21T14:43:59.813652+0000","last_clean":"2024-05-21T14:43:59.813652+0000","last_became_active":"2024-05-21T14:43:19.613035+0000","last_became_peered":"2024-05-21T14:43:19.613035+0000","last_unstale":"2024-05-21T14:43:59.813652+0000","last_undegraded":"2024-05-21T14:43:59.813652+0000","last_fullsized":"2024-05-21T14:43:59.813652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:47:46.462547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.171393+0000","last_change":"2024-05-21T14:43:19.626414+0000","last_active":"2024-05-21T14:44:00.171393+0000","last_peered":"2024-05-21T14:44:00.171393+0000","last_clean":"2024-05-21T14:44:00.171393+0000","last_became_active":"2024-05-21T14:43:19.626080+0000","last_became_peered":"2024-05-21T14:43:19.626080+0000","last_unstale":"2024-05-21T14:44:00.171393+0000","last_undegraded":"2024-05-21T14:44:00.171393+0000","last_fullsized":"2024-05-21T14:44:00.171393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:37:38.449284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813381+0000","last_change":"2024-05-21T14:43:19.620806+0000","last_active":"2024-05-21T14:43:59.813381+0000","last_peered":"2024-05-21T14:43:59.813381+0000","last_clean":"2024-05-21T14:43:59.813381+0000","last_became_active":"2024-05-21T14:43:19.620449+0000","last_became_peered":"2024-05-21T14:43:19.620449+0000","last_unstale":"2024-05-21T14:43:59.813381+0000","last_undegraded":"2024-05-21T14:43:59.813381+0000","last_fullsized":"2024-05-21T14:43:59.813381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:43:52.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172688+0000","last_change":"2024-05-21T14:43:18.603028+0000","last_active":"2024-05-21T14:44:00.172688+0000","last_peered":"2024-05-21T14:44:00.172688+0000","last_clean":"2024-05-21T14:44:00.172688+0000","last_became_active":"2024-05-21T14:43:18.602036+0000","last_became_peered":"2024-05-21T14:43:18.602036+0000","last_unstale":"2024-05-21T14:44:00.172688+0000","last_undegraded":"2024-05-21T14:44:00.172688+0000","last_fullsized":"2024-05-21T14:44:00.172688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:15:25.384197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813816+0000","last_change":"2024-05-21T14:43:19.599725+0000","last_active":"2024-05-21T14:43:59.813816+0000","last_peered":"2024-05-21T14:43:59.813816+0000","last_clean":"2024-05-21T14:43:59.813816+0000","last_became_active":"2024-05-21T14:43:19.598972+0000","last_became_peered":"2024-05-21T14:43:19.598972+0000","last_unstale":"2024-05-21T14:43:59.813816+0000","last_undegraded":"2024-05-21T14:43:59.813816+0000","last_fullsized":"2024-05-21T14:43:59.813816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:54:00.871046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'7","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173842+0000","last_change":"2024-05-21T14:43:18.615934+0000","last_active":"2024-05-21T14:44:00.173842+0000","last_peered":"2024-05-21T14:44:00.173842+0000","last_clean":"2024-05-21T14:44:00.173842+0000","last_became_active":"2024-05-21T14:43:18.615568+0000","last_became_peered":"2024-05-21T14:43:18.615568+0000","last_unstale":"2024-05-21T14:44:00.173842+0000","last_undegraded":"2024-05-21T14:44:00.173842+0000","last_fullsized":"2024-05-21T14:44:00.173842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:28:54.494319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'3","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.199358+0000","last_change":"2024-05-21T14:43:18.615154+0000","last_active":"2024-05-21T14:44:00.199358+0000","last_peered":"2024-05-21T14:44:00.199358+0000","last_clean":"2024-05-21T14:44:00.199358+0000","last_became_active":"2024-05-21T14:43:18.613838+0000","last_became_peered":"2024-05-21T14:43:18.613838+0000","last_unstale":"2024-05-21T14:44:00.199358+0000","last_undegraded":"2024-05-21T14:44:00.199358+0000","last_fullsized":"2024-05-21T14:44:00.199358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:32:09.174124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172672+0000","last_change":"2024-05-21T14:43:19.633585+0000","last_active":"2024-05-21T14:44:00.172672+0000","last_peered":"2024-05-21T14:44:00.172672+0000","last_clean":"2024-05-21T14:44:00.172672+0000","last_became_active":"2024-05-21T14:43:19.632476+0000","last_became_peered":"2024-05-21T14:43:19.632476+0000","last_unstale":"2024-05-21T14:44:00.172672+0000","last_undegraded":"2024-05-21T14:44:00.172672+0000","last_fullsized":"2024-05-21T14:44:00.172672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:53.023931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'3","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173489+0000","last_change":"2024-05-21T14:43:18.585548+0000","last_active":"2024-05-21T14:44:00.173489+0000","last_peered":"2024-05-21T14:44:00.173489+0000","last_clean":"2024-05-21T14:44:00.173489+0000","last_became_active":"2024-05-21T14:43:18.585099+0000","last_became_peered":"2024-05-21T14:43:18.585099+0000","last_unstale":"2024-05-21T14:44:00.173489+0000","last_undegraded":"2024-05-21T14:44:00.173489+0000","last_fullsized":"2024-05-21T14:44:00.173489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:20:16.856225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813349+0000","last_change":"2024-05-21T14:43:19.614884+0000","last_active":"2024-05-21T14:43:59.813349+0000","last_peered":"2024-05-21T14:43:59.813349+0000","last_clean":"2024-05-21T14:43:59.813349+0000","last_became_active":"2024-05-21T14:43:19.614064+0000","last_became_peered":"2024-05-21T14:43:19.614064+0000","last_unstale":"2024-05-21T14:43:59.813349+0000","last_undegraded":"2024-05-21T14:43:59.813349+0000","last_fullsized":"2024-05-21T14:43:59.813349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:42:17.091043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'4","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813926+0000","last_change":"2024-05-21T14:43:18.602794+0000","last_active":"2024-05-21T14:43:59.813926+0000","last_peered":"2024-05-21T14:43:59.813926+0000","last_clean":"2024-05-21T14:43:59.813926+0000","last_became_active":"2024-05-21T14:43:18.602429+0000","last_became_peered":"2024-05-21T14:43:18.602429+0000","last_unstale":"2024-05-21T14:43:59.813926+0000","last_undegraded":"2024-05-21T14:43:59.813926+0000","last_fullsized":"2024-05-21T14:43:59.813926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:50:14.465202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172190+0000","last_change":"2024-05-21T14:43:19.602663+0000","last_active":"2024-05-21T14:44:00.172190+0000","last_peered":"2024-05-21T14:44:00.172190+0000","last_clean":"2024-05-21T14:44:00.172190+0000","last_became_active":"2024-05-21T14:43:19.602294+0000","last_became_peered":"2024-05-21T14:43:19.602294+0000","last_unstale":"2024-05-21T14:44:00.172190+0000","last_undegraded":"2024-05-21T14:44:00.172190+0000","last_fullsized":"2024-05-21T14:44:00.172190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:48:56.271741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'4","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174916+0000","last_change":"2024-05-21T14:43:18.604601+0000","last_active":"2024-05-21T14:44:00.174916+0000","last_peered":"2024-05-21T14:44:00.174916+0000","last_clean":"2024-05-21T14:44:00.174916+0000","last_became_active":"2024-05-21T14:43:18.604262+0000","last_became_peered":"2024-05-21T14:43:18.604262+0000","last_unstale":"2024-05-21T14:44:00.174916+0000","last_undegraded":"2024-05-21T14:44:00.174916+0000","last_fullsized":"2024-05-21T14:44:00.174916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:15.490579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173377+0000","last_change":"2024-05-21T14:43:19.613952+0000","last_active":"2024-05-21T14:44:00.173377+0000","last_peered":"2024-05-21T14:44:00.173377+0000","last_clean":"2024-05-21T14:44:00.173377+0000","last_became_active":"2024-05-21T14:43:19.613093+0000","last_became_peered":"2024-05-21T14:43:19.613093+0000","last_unstale":"2024-05-21T14:44:00.173377+0000","last_undegraded":"2024-05-21T14:44:00.173377+0000","last_fullsized":"2024-05-21T14:44:00.173377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:03:44.925212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815124+0000","last_change":"2024-05-21T14:43:18.602343+0000","last_active":"2024-05-21T14:43:59.815124+0000","last_peered":"2024-05-21T14:43:59.815124+0000","last_clean":"2024-05-21T14:43:59.815124+0000","last_became_active":"2024-05-21T14:43:18.601500+0000","last_became_peered":"2024-05-21T14:43:18.601500+0000","last_unstale":"2024-05-21T14:43:59.815124+0000","last_undegraded":"2024-05-21T14:43:59.815124+0000","last_fullsized":"2024-05-21T14:43:59.815124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:54:21.960430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173702+0000","last_change":"2024-05-21T14:43:19.608580+0000","last_active":"2024-05-21T14:44:00.173702+0000","last_peered":"2024-05-21T14:44:00.173702+0000","last_clean":"2024-05-21T14:44:00.173702+0000","last_became_active":"2024-05-21T14:43:19.608038+0000","last_became_peered":"2024-05-21T14:43:19.608038+0000","last_unstale":"2024-05-21T14:44:00.173702+0000","last_undegraded":"2024-05-21T14:44:00.173702+0000","last_fullsized":"2024-05-21T14:44:00.173702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:19.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'18","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:30.713287+0000","last_change":"2024-05-21T14:43:18.606824+0000","last_active":"2024-05-21T14:45:30.713287+0000","last_peered":"2024-05-21T14:45:30.713287+0000","last_clean":"2024-05-21T14:45:30.713287+0000","last_became_active":"2024-05-21T14:43:18.606449+0000","last_became_peered":"2024-05-21T14:43:18.606449+0000","last_unstale":"2024-05-21T14:45:30.713287+0000","last_undegraded":"2024-05-21T14:45:30.713287+0000","last_fullsized":"2024-05-21T14:45:30.713287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:43:41.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15565,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174675+0000","last_change":"2024-05-21T14:43:19.634014+0000","last_active":"2024-05-21T14:44:00.174675+0000","last_peered":"2024-05-21T14:44:00.174675+0000","last_clean":"2024-05-21T14:44:00.174675+0000","last_became_active":"2024-05-21T14:43:19.633664+0000","last_became_peered":"2024-05-21T14:43:19.633664+0000","last_unstale":"2024-05-21T14:44:00.174675+0000","last_undegraded":"2024-05-21T14:44:00.174675+0000","last_fullsized":"2024-05-21T14:44:00.174675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:36:07.708164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'9","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.814396+0000","last_change":"2024-05-21T14:43:18.614764+0000","last_active":"2024-05-21T14:43:59.814396+0000","last_peered":"2024-05-21T14:43:59.814396+0000","last_clean":"2024-05-21T14:43:59.814396+0000","last_became_active":"2024-05-21T14:43:18.614214+0000","last_became_peered":"2024-05-21T14:43:18.614214+0000","last_unstale":"2024-05-21T14:43:59.814396+0000","last_undegraded":"2024-05-21T14:43:59.814396+0000","last_fullsized":"2024-05-21T14:43:59.814396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:34:40.294756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.199358+0000","last_change":"2024-05-21T14:43:19.625313+0000","last_active":"2024-05-21T14:44:00.199358+0000","last_peered":"2024-05-21T14:44:00.199358+0000","last_clean":"2024-05-21T14:44:00.199358+0000","last_became_active":"2024-05-21T14:43:19.624474+0000","last_became_peered":"2024-05-21T14:43:19.624474+0000","last_unstale":"2024-05-21T14:44:00.199358+0000","last_undegraded":"2024-05-21T14:44:00.199358+0000","last_fullsized":"2024-05-21T14:44:00.199358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:28.280456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173900+0000","last_change":"2024-05-21T14:43:18.600736+0000","last_active":"2024-05-21T14:44:00.173900+0000","last_peered":"2024-05-21T14:44:00.173900+0000","last_clean":"2024-05-21T14:44:00.173900+0000","last_became_active":"2024-05-21T14:43:18.600415+0000","last_became_peered":"2024-05-21T14:43:18.600415+0000","last_unstale":"2024-05-21T14:44:00.173900+0000","last_undegraded":"2024-05-21T14:44:00.173900+0000","last_fullsized":"2024-05-21T14:44:00.173900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:03:57.207603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173657+0000","last_change":"2024-05-21T14:43:19.599637+0000","last_active":"2024-05-21T14:44:00.173657+0000","last_peered":"2024-05-21T14:44:00.173657+0000","last_clean":"2024-05-21T14:44:00.173657+0000","last_became_active":"2024-05-21T14:43:19.599195+0000","last_became_peered":"2024-05-21T14:43:19.599195+0000","last_unstale":"2024-05-21T14:44:00.173657+0000","last_undegraded":"2024-05-21T14:44:00.173657+0000","last_fullsized":"2024-05-21T14:44:00.173657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:17.350821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172653+0000","last_change":"2024-05-21T14:43:18.603064+0000","last_active":"2024-05-21T14:44:00.172653+0000","last_peered":"2024-05-21T14:44:00.172653+0000","last_clean":"2024-05-21T14:44:00.172653+0000","last_became_active":"2024-05-21T14:43:18.602658+0000","last_became_peered":"2024-05-21T14:43:18.602658+0000","last_unstale":"2024-05-21T14:44:00.172653+0000","last_undegraded":"2024-05-21T14:44:00.172653+0000","last_fullsized":"2024-05-21T14:44:00.172653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:09:28.623131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813178+0000","last_change":"2024-05-21T14:43:19.620760+0000","last_active":"2024-05-21T14:43:59.813178+0000","last_peered":"2024-05-21T14:43:59.813178+0000","last_clean":"2024-05-21T14:43:59.813178+0000","last_became_active":"2024-05-21T14:43:19.620409+0000","last_became_peered":"2024-05-21T14:43:19.620409+0000","last_unstale":"2024-05-21T14:43:59.813178+0000","last_undegraded":"2024-05-21T14:43:59.813178+0000","last_fullsized":"2024-05-21T14:43:59.813178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:49:59.051131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'17","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813245+0000","last_change":"2024-05-21T14:43:18.594225+0000","last_active":"2024-05-21T14:43:59.813245+0000","last_peered":"2024-05-21T14:43:59.813245+0000","last_clean":"2024-05-21T14:43:59.813245+0000","last_became_active":"2024-05-21T14:43:18.592335+0000","last_became_peered":"2024-05-21T14:43:18.592335+0000","last_unstale":"2024-05-21T14:43:59.813245+0000","last_undegraded":"2024-05-21T14:43:59.813245+0000","last_fullsized":"2024-05-21T14:43:59.813245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:00:58.772091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173357+0000","last_change":"2024-05-21T14:43:19.612442+0000","last_active":"2024-05-21T14:44:00.173357+0000","last_peered":"2024-05-21T14:44:00.173357+0000","last_clean":"2024-05-21T14:44:00.173357+0000","last_became_active":"2024-05-21T14:43:19.612110+0000","last_became_peered":"2024-05-21T14:43:19.612110+0000","last_unstale":"2024-05-21T14:44:00.173357+0000","last_undegraded":"2024-05-21T14:44:00.173357+0000","last_fullsized":"2024-05-21T14:44:00.173357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:53.451513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.175020+0000","last_change":"2024-05-21T14:43:18.613433+0000","last_active":"2024-05-21T14:44:00.175020+0000","last_peered":"2024-05-21T14:44:00.175020+0000","last_clean":"2024-05-21T14:44:00.175020+0000","last_became_active":"2024-05-21T14:43:18.613048+0000","last_became_peered":"2024-05-21T14:43:18.613048+0000","last_unstale":"2024-05-21T14:44:00.175020+0000","last_undegraded":"2024-05-21T14:44:00.175020+0000","last_fullsized":"2024-05-21T14:44:00.175020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:00:16.454574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172246+0000","last_change":"2024-05-21T14:43:19.597079+0000","last_active":"2024-05-21T14:44:00.172246+0000","last_peered":"2024-05-21T14:44:00.172246+0000","last_clean":"2024-05-21T14:44:00.172246+0000","last_became_active":"2024-05-21T14:43:19.596736+0000","last_became_peered":"2024-05-21T14:43:19.596736+0000","last_unstale":"2024-05-21T14:44:00.172246+0000","last_undegraded":"2024-05-21T14:44:00.172246+0000","last_fullsized":"2024-05-21T14:44:00.172246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:09:03.687971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815206+0000","last_change":"2024-05-21T14:43:18.620603+0000","last_active":"2024-05-21T14:43:59.815206+0000","last_peered":"2024-05-21T14:43:59.815206+0000","last_clean":"2024-05-21T14:43:59.815206+0000","last_became_active":"2024-05-21T14:43:18.619762+0000","last_became_peered":"2024-05-21T14:43:18.619762+0000","last_unstale":"2024-05-21T14:43:59.815206+0000","last_undegraded":"2024-05-21T14:43:59.815206+0000","last_fullsized":"2024-05-21T14:43:59.815206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:31:49.257435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.819643+0000","last_change":"2024-05-21T14:43:59.818544+0000","last_active":"2024-05-21T14:43:59.819643+0000","last_peered":"2024-05-21T14:43:59.819643+0000","last_clean":"2024-05-21T14:43:59.819643+0000","last_became_active":"2024-05-21T14:43:59.817946+0000","last_became_peered":"2024-05-21T14:43:59.817946+0000","last_unstale":"2024-05-21T14:43:59.819643+0000","last_undegraded":"2024-05-21T14:43:59.819643+0000","last_fullsized":"2024-05-21T14:43:59.819643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:20:02.691907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'3","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173123+0000","last_change":"2024-05-21T14:43:18.610121+0000","last_active":"2024-05-21T14:44:00.173123+0000","last_peered":"2024-05-21T14:44:00.173123+0000","last_clean":"2024-05-21T14:44:00.173123+0000","last_became_active":"2024-05-21T14:43:18.609349+0000","last_became_peered":"2024-05-21T14:43:18.609349+0000","last_unstale":"2024-05-21T14:44:00.173123+0000","last_undegraded":"2024-05-21T14:44:00.173123+0000","last_fullsized":"2024-05-21T14:44:00.173123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:48.330067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173737+0000","last_change":"2024-05-21T14:43:19.605193+0000","last_active":"2024-05-21T14:44:00.173737+0000","last_peered":"2024-05-21T14:44:00.173737+0000","last_clean":"2024-05-21T14:44:00.173737+0000","last_became_active":"2024-05-21T14:43:19.604869+0000","last_became_peered":"2024-05-21T14:43:19.604869+0000","last_unstale":"2024-05-21T14:44:00.173737+0000","last_undegraded":"2024-05-21T14:44:00.173737+0000","last_fullsized":"2024-05-21T14:44:00.173737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:58:05.078363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.199978+0000","last_change":"2024-05-21T14:43:18.616535+0000","last_active":"2024-05-21T14:44:00.199978+0000","last_peered":"2024-05-21T14:44:00.199978+0000","last_clean":"2024-05-21T14:44:00.199978+0000","last_became_active":"2024-05-21T14:43:18.615734+0000","last_became_peered":"2024-05-21T14:43:18.615734+0000","last_unstale":"2024-05-21T14:44:00.199978+0000","last_undegraded":"2024-05-21T14:44:00.199978+0000","last_fullsized":"2024-05-21T14:44:00.199978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:10:27.821535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173777+0000","last_change":"2024-05-21T14:43:19.615424+0000","last_active":"2024-05-21T14:44:00.173777+0000","last_peered":"2024-05-21T14:44:00.173777+0000","last_clean":"2024-05-21T14:44:00.173777+0000","last_became_active":"2024-05-21T14:43:19.614915+0000","last_became_peered":"2024-05-21T14:43:19.614915+0000","last_unstale":"2024-05-21T14:44:00.173777+0000","last_undegraded":"2024-05-21T14:44:00.173777+0000","last_fullsized":"2024-05-21T14:44:00.173777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:25:09.153430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813317+0000","last_change":"2024-05-21T14:43:08.080234+0000","last_active":"2024-05-21T14:43:59.813317+0000","last_peered":"2024-05-21T14:43:59.813317+0000","last_clean":"2024-05-21T14:43:59.813317+0000","last_became_active":"2024-05-21T14:43:08.079934+0000","last_became_peered":"2024-05-21T14:43:08.079934+0000","last_unstale":"2024-05-21T14:43:59.813317+0000","last_undegraded":"2024-05-21T14:43:59.813317+0000","last_fullsized":"2024-05-21T14:43:59.813317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_clean_scrub_stamp":"2024-05-21T14:43:07.046978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:54:57.347768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'6","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174205+0000","last_change":"2024-05-21T14:43:18.599850+0000","last_active":"2024-05-21T14:44:00.174205+0000","last_peered":"2024-05-21T14:44:00.174205+0000","last_clean":"2024-05-21T14:44:00.174205+0000","last_became_active":"2024-05-21T14:43:18.599347+0000","last_became_peered":"2024-05-21T14:43:18.599347+0000","last_unstale":"2024-05-21T14:44:00.174205+0000","last_undegraded":"2024-05-21T14:44:00.174205+0000","last_fullsized":"2024-05-21T14:44:00.174205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:01:06.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813371+0000","last_change":"2024-05-21T14:43:19.613056+0000","last_active":"2024-05-21T14:43:59.813371+0000","last_peered":"2024-05-21T14:43:59.813371+0000","last_clean":"2024-05-21T14:43:59.813371+0000","last_became_active":"2024-05-21T14:43:19.611889+0000","last_became_peered":"2024-05-21T14:43:19.611889+0000","last_unstale":"2024-05-21T14:43:59.813371+0000","last_undegraded":"2024-05-21T14:43:59.813371+0000","last_fullsized":"2024-05-21T14:43:59.813371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:46:20.105282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173579+0000","last_change":"2024-05-21T14:43:18.621482+0000","last_active":"2024-05-21T14:44:00.173579+0000","last_peered":"2024-05-21T14:44:00.173579+0000","last_clean":"2024-05-21T14:44:00.173579+0000","last_became_active":"2024-05-21T14:43:18.621229+0000","last_became_peered":"2024-05-21T14:43:18.621229+0000","last_unstale":"2024-05-21T14:44:00.173579+0000","last_undegraded":"2024-05-21T14:44:00.173579+0000","last_fullsized":"2024-05-21T14:44:00.173579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:30:04.326588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.199479+0000","last_change":"2024-05-21T14:43:19.625038+0000","last_active":"2024-05-21T14:44:00.199479+0000","last_peered":"2024-05-21T14:44:00.199479+0000","last_clean":"2024-05-21T14:44:00.199479+0000","last_became_active":"2024-05-21T14:43:19.624114+0000","last_became_peered":"2024-05-21T14:43:19.624114+0000","last_unstale":"2024-05-21T14:44:00.199479+0000","last_undegraded":"2024-05-21T14:44:00.199479+0000","last_fullsized":"2024-05-21T14:44:00.199479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:11.854243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'5","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813950+0000","last_change":"2024-05-21T14:43:18.618518+0000","last_active":"2024-05-21T14:43:59.813950+0000","last_peered":"2024-05-21T14:43:59.813950+0000","last_clean":"2024-05-21T14:43:59.813950+0000","last_became_active":"2024-05-21T14:43:18.617756+0000","last_became_peered":"2024-05-21T14:43:18.617756+0000","last_unstale":"2024-05-21T14:43:59.813950+0000","last_undegraded":"2024-05-21T14:43:59.813950+0000","last_fullsized":"2024-05-21T14:43:59.813950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:52:12.999877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172592+0000","last_change":"2024-05-21T14:43:19.613595+0000","last_active":"2024-05-21T14:44:00.172592+0000","last_peered":"2024-05-21T14:44:00.172592+0000","last_clean":"2024-05-21T14:44:00.172592+0000","last_became_active":"2024-05-21T14:43:19.612730+0000","last_became_peered":"2024-05-21T14:43:19.612730+0000","last_unstale":"2024-05-21T14:44:00.172592+0000","last_undegraded":"2024-05-21T14:44:00.172592+0000","last_fullsized":"2024-05-21T14:44:00.172592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:01:02.847071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'5","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173991+0000","last_change":"2024-05-21T14:43:18.608596+0000","last_active":"2024-05-21T14:44:00.173991+0000","last_peered":"2024-05-21T14:44:00.173991+0000","last_clean":"2024-05-21T14:44:00.173991+0000","last_became_active":"2024-05-21T14:43:18.608262+0000","last_became_peered":"2024-05-21T14:43:18.608262+0000","last_unstale":"2024-05-21T14:44:00.173991+0000","last_undegraded":"2024-05-21T14:44:00.173991+0000","last_fullsized":"2024-05-21T14:44:00.173991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:14.962554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173231+0000","last_change":"2024-05-21T14:43:19.607815+0000","last_active":"2024-05-21T14:44:00.173231+0000","last_peered":"2024-05-21T14:44:00.173231+0000","last_clean":"2024-05-21T14:44:00.173231+0000","last_became_active":"2024-05-21T14:43:19.607513+0000","last_became_peered":"2024-05-21T14:43:19.607513+0000","last_unstale":"2024-05-21T14:44:00.173231+0000","last_undegraded":"2024-05-21T14:44:00.173231+0000","last_fullsized":"2024-05-21T14:44:00.173231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:01:35.332981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172926+0000","last_change":"2024-05-21T14:43:18.603626+0000","last_active":"2024-05-21T14:44:00.172926+0000","last_peered":"2024-05-21T14:44:00.172926+0000","last_clean":"2024-05-21T14:44:00.172926+0000","last_became_active":"2024-05-21T14:43:18.602704+0000","last_became_peered":"2024-05-21T14:43:18.602704+0000","last_unstale":"2024-05-21T14:44:00.172926+0000","last_undegraded":"2024-05-21T14:44:00.172926+0000","last_fullsized":"2024-05-21T14:44:00.172926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:03.976820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.171881+0000","last_change":"2024-05-21T14:43:19.634449+0000","last_active":"2024-05-21T14:44:00.171881+0000","last_peered":"2024-05-21T14:44:00.171881+0000","last_clean":"2024-05-21T14:44:00.171881+0000","last_became_active":"2024-05-21T14:43:19.633751+0000","last_became_peered":"2024-05-21T14:43:19.633751+0000","last_unstale":"2024-05-21T14:44:00.171881+0000","last_undegraded":"2024-05-21T14:44:00.171881+0000","last_fullsized":"2024-05-21T14:44:00.171881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:04:51.415303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174026+0000","last_change":"2024-05-21T14:43:18.608335+0000","last_active":"2024-05-21T14:44:00.174026+0000","last_peered":"2024-05-21T14:44:00.174026+0000","last_clean":"2024-05-21T14:44:00.174026+0000","last_became_active":"2024-05-21T14:43:18.607999+0000","last_became_peered":"2024-05-21T14:43:18.607999+0000","last_unstale":"2024-05-21T14:44:00.174026+0000","last_undegraded":"2024-05-21T14:44:00.174026+0000","last_fullsized":"2024-05-21T14:44:00.174026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:21.325953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.199821+0000","last_change":"2024-05-21T14:43:19.626742+0000","last_active":"2024-05-21T14:44:00.199821+0000","last_peered":"2024-05-21T14:44:00.199821+0000","last_clean":"2024-05-21T14:44:00.199821+0000","last_became_active":"2024-05-21T14:43:19.626024+0000","last_became_peered":"2024-05-21T14:43:19.626024+0000","last_unstale":"2024-05-21T14:44:00.199821+0000","last_undegraded":"2024-05-21T14:44:00.199821+0000","last_fullsized":"2024-05-21T14:44:00.199821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:48:15.426224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'10","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:43.667167+0000","last_change":"2024-05-21T14:43:18.616913+0000","last_active":"2024-05-21T14:44:43.667167+0000","last_peered":"2024-05-21T14:44:43.667167+0000","last_clean":"2024-05-21T14:44:43.667167+0000","last_became_active":"2024-05-21T14:43:18.616214+0000","last_became_peered":"2024-05-21T14:43:18.616214+0000","last_unstale":"2024-05-21T14:44:43.667167+0000","last_undegraded":"2024-05-21T14:44:43.667167+0000","last_fullsized":"2024-05-21T14:44:43.667167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:22.112018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815085+0000","last_change":"2024-05-21T14:43:19.607521+0000","last_active":"2024-05-21T14:43:59.815085+0000","last_peered":"2024-05-21T14:43:59.815085+0000","last_clean":"2024-05-21T14:43:59.815085+0000","last_became_active":"2024-05-21T14:43:19.606673+0000","last_became_peered":"2024-05-21T14:43:19.606673+0000","last_unstale":"2024-05-21T14:43:59.815085+0000","last_undegraded":"2024-05-21T14:43:59.815085+0000","last_fullsized":"2024-05-21T14:43:59.815085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:50:50.373410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'7","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174519+0000","last_change":"2024-05-21T14:43:18.615846+0000","last_active":"2024-05-21T14:44:00.174519+0000","last_peered":"2024-05-21T14:44:00.174519+0000","last_clean":"2024-05-21T14:44:00.174519+0000","last_became_active":"2024-05-21T14:43:18.615506+0000","last_became_peered":"2024-05-21T14:43:18.615506+0000","last_unstale":"2024-05-21T14:44:00.174519+0000","last_undegraded":"2024-05-21T14:44:00.174519+0000","last_fullsized":"2024-05-21T14:44:00.174519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:07:17.030757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815066+0000","last_change":"2024-05-21T14:43:19.611473+0000","last_active":"2024-05-21T14:43:59.815066+0000","last_peered":"2024-05-21T14:43:59.815066+0000","last_clean":"2024-05-21T14:43:59.815066+0000","last_became_active":"2024-05-21T14:43:19.610600+0000","last_became_peered":"2024-05-21T14:43:19.610600+0000","last_unstale":"2024-05-21T14:43:59.815066+0000","last_undegraded":"2024-05-21T14:43:59.815066+0000","last_fullsized":"2024-05-21T14:43:59.815066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:48:07.659795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172286+0000","last_change":"2024-05-21T14:43:18.604951+0000","last_active":"2024-05-21T14:44:00.172286+0000","last_peered":"2024-05-21T14:44:00.172286+0000","last_clean":"2024-05-21T14:44:00.172286+0000","last_became_active":"2024-05-21T14:43:18.602186+0000","last_became_peered":"2024-05-21T14:43:18.602186+0000","last_unstale":"2024-05-21T14:44:00.172286+0000","last_undegraded":"2024-05-21T14:44:00.172286+0000","last_fullsized":"2024-05-21T14:44:00.172286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:34:10.395484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173521+0000","last_change":"2024-05-21T14:43:19.600827+0000","last_active":"2024-05-21T14:44:00.173521+0000","last_peered":"2024-05-21T14:44:00.173521+0000","last_clean":"2024-05-21T14:44:00.173521+0000","last_became_active":"2024-05-21T14:43:19.600499+0000","last_became_peered":"2024-05-21T14:43:19.600499+0000","last_unstale":"2024-05-21T14:44:00.173521+0000","last_undegraded":"2024-05-21T14:44:00.173521+0000","last_fullsized":"2024-05-21T14:44:00.173521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:55:36.231321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'7","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813798+0000","last_change":"2024-05-21T14:43:18.615190+0000","last_active":"2024-05-21T14:43:59.813798+0000","last_peered":"2024-05-21T14:43:59.813798+0000","last_clean":"2024-05-21T14:43:59.813798+0000","last_became_active":"2024-05-21T14:43:18.614306+0000","last_became_peered":"2024-05-21T14:43:18.614306+0000","last_unstale":"2024-05-21T14:43:59.813798+0000","last_undegraded":"2024-05-21T14:43:59.813798+0000","last_fullsized":"2024-05-21T14:43:59.813798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:53.472559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813081+0000","last_change":"2024-05-21T14:43:19.610903+0000","last_active":"2024-05-21T14:43:59.813081+0000","last_peered":"2024-05-21T14:43:59.813081+0000","last_clean":"2024-05-21T14:43:59.813081+0000","last_became_active":"2024-05-21T14:43:19.610101+0000","last_became_peered":"2024-05-21T14:43:19.610101+0000","last_unstale":"2024-05-21T14:43:59.813081+0000","last_undegraded":"2024-05-21T14:43:59.813081+0000","last_fullsized":"2024-05-21T14:43:59.813081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:16:24.580581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'3","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.200092+0000","last_change":"2024-05-21T14:43:18.617785+0000","last_active":"2024-05-21T14:44:00.200092+0000","last_peered":"2024-05-21T14:44:00.200092+0000","last_clean":"2024-05-21T14:44:00.200092+0000","last_became_active":"2024-05-21T14:43:18.617041+0000","last_became_peered":"2024-05-21T14:43:18.617041+0000","last_unstale":"2024-05-21T14:44:00.200092+0000","last_undegraded":"2024-05-21T14:44:00.200092+0000","last_fullsized":"2024-05-21T14:44:00.200092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:02:50.837158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.814404+0000","last_change":"2024-05-21T14:43:19.627096+0000","last_active":"2024-05-21T14:43:59.814404+0000","last_peered":"2024-05-21T14:43:59.814404+0000","last_clean":"2024-05-21T14:43:59.814404+0000","last_became_active":"2024-05-21T14:43:19.626265+0000","last_became_peered":"2024-05-21T14:43:19.626265+0000","last_unstale":"2024-05-21T14:43:59.814404+0000","last_undegraded":"2024-05-21T14:43:59.814404+0000","last_fullsized":"2024-05-21T14:43:59.814404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:23:47.818120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'4","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174065+0000","last_change":"2024-05-21T14:43:18.599635+0000","last_active":"2024-05-21T14:44:00.174065+0000","last_peered":"2024-05-21T14:44:00.174065+0000","last_clean":"2024-05-21T14:44:00.174065+0000","last_became_active":"2024-05-21T14:43:18.598996+0000","last_became_peered":"2024-05-21T14:43:18.598996+0000","last_unstale":"2024-05-21T14:44:00.174065+0000","last_undegraded":"2024-05-21T14:44:00.174065+0000","last_fullsized":"2024-05-21T14:44:00.174065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:17:09.383291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173812+0000","last_change":"2024-05-21T14:43:19.617686+0000","last_active":"2024-05-21T14:44:00.173812+0000","last_peered":"2024-05-21T14:44:00.173812+0000","last_clean":"2024-05-21T14:44:00.173812+0000","last_became_active":"2024-05-21T14:43:19.617398+0000","last_became_peered":"2024-05-21T14:43:19.617398+0000","last_unstale":"2024-05-21T14:44:00.173812+0000","last_undegraded":"2024-05-21T14:44:00.173812+0000","last_fullsized":"2024-05-21T14:44:00.173812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:21:06.527871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173659+0000","last_change":"2024-05-21T14:43:19.601673+0000","last_active":"2024-05-21T14:44:00.173659+0000","last_peered":"2024-05-21T14:44:00.173659+0000","last_clean":"2024-05-21T14:44:00.173659+0000","last_became_active":"2024-05-21T14:43:19.601286+0000","last_became_peered":"2024-05-21T14:43:19.601286+0000","last_unstale":"2024-05-21T14:44:00.173659+0000","last_undegraded":"2024-05-21T14:44:00.173659+0000","last_fullsized":"2024-05-21T14:44:00.173659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:21:22.955055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173839+0000","last_change":"2024-05-21T14:43:18.613555+0000","last_active":"2024-05-21T14:44:00.173839+0000","last_peered":"2024-05-21T14:44:00.173839+0000","last_clean":"2024-05-21T14:44:00.173839+0000","last_became_active":"2024-05-21T14:43:18.613117+0000","last_became_peered":"2024-05-21T14:43:18.613117+0000","last_unstale":"2024-05-21T14:44:00.173839+0000","last_undegraded":"2024-05-21T14:44:00.173839+0000","last_fullsized":"2024-05-21T14:44:00.173839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:38.151165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813689+0000","last_change":"2024-05-21T14:43:19.596736+0000","last_active":"2024-05-21T14:43:59.813689+0000","last_peered":"2024-05-21T14:43:59.813689+0000","last_clean":"2024-05-21T14:43:59.813689+0000","last_became_active":"2024-05-21T14:43:19.596157+0000","last_became_peered":"2024-05-21T14:43:19.596157+0000","last_unstale":"2024-05-21T14:43:59.813689+0000","last_undegraded":"2024-05-21T14:43:59.813689+0000","last_fullsized":"2024-05-21T14:43:59.813689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:22:14.002930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'12","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174699+0000","last_change":"2024-05-21T14:43:18.614044+0000","last_active":"2024-05-21T14:44:00.174699+0000","last_peered":"2024-05-21T14:44:00.174699+0000","last_clean":"2024-05-21T14:44:00.174699+0000","last_became_active":"2024-05-21T14:43:18.613730+0000","last_became_peered":"2024-05-21T14:43:18.613730+0000","last_unstale":"2024-05-21T14:44:00.174699+0000","last_undegraded":"2024-05-21T14:44:00.174699+0000","last_fullsized":"2024-05-21T14:44:00.174699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:41:34.787779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173341+0000","last_change":"2024-05-21T14:43:19.621999+0000","last_active":"2024-05-21T14:44:00.173341+0000","last_peered":"2024-05-21T14:44:00.173341+0000","last_clean":"2024-05-21T14:44:00.173341+0000","last_became_active":"2024-05-21T14:43:19.614744+0000","last_became_peered":"2024-05-21T14:43:19.614744+0000","last_unstale":"2024-05-21T14:44:00.173341+0000","last_undegraded":"2024-05-21T14:44:00.173341+0000","last_fullsized":"2024-05-21T14:44:00.173341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:32:37.316833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173242+0000","last_change":"2024-05-21T14:43:18.614193+0000","last_active":"2024-05-21T14:44:00.173242+0000","last_peered":"2024-05-21T14:44:00.173242+0000","last_clean":"2024-05-21T14:44:00.173242+0000","last_became_active":"2024-05-21T14:43:18.609797+0000","last_became_peered":"2024-05-21T14:43:18.609797+0000","last_unstale":"2024-05-21T14:44:00.173242+0000","last_undegraded":"2024-05-21T14:44:00.173242+0000","last_fullsized":"2024-05-21T14:44:00.173242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:39:55.623816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173163+0000","last_change":"2024-05-21T14:43:19.610578+0000","last_active":"2024-05-21T14:44:00.173163+0000","last_peered":"2024-05-21T14:44:00.173163+0000","last_clean":"2024-05-21T14:44:00.173163+0000","last_became_active":"2024-05-21T14:43:19.606575+0000","last_became_peered":"2024-05-21T14:43:19.606575+0000","last_unstale":"2024-05-21T14:44:00.173163+0000","last_undegraded":"2024-05-21T14:44:00.173163+0000","last_fullsized":"2024-05-21T14:44:00.173163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:50:06.088520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'13","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815910+0000","last_change":"2024-05-21T14:43:18.601862+0000","last_active":"2024-05-21T14:43:59.815910+0000","last_peered":"2024-05-21T14:43:59.815910+0000","last_clean":"2024-05-21T14:43:59.815910+0000","last_became_active":"2024-05-21T14:43:18.601311+0000","last_became_peered":"2024-05-21T14:43:18.601311+0000","last_unstale":"2024-05-21T14:43:59.815910+0000","last_undegraded":"2024-05-21T14:43:59.815910+0000","last_fullsized":"2024-05-21T14:43:59.815910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:02.736061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":21987,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":43974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":95528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":684342,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509471,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":101528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":95870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":108781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509471,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":684930,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509472,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":95690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":94206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":15633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":17403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T14:45:36.185 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T14:45:36.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.359+0000 7fc111200640 1 Processor -- start 2024-05-21T14:45:36.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.359+0000 7fc111200640 1 -- start start 2024-05-21T14:45:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.359+0000 7fc111200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc10c0c6760 0x7fc10c0c7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.359+0000 7fc111200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc10c159f20 0x7fc10c073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.359+0000 7fc111200640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc10c153cd0 con 0x7fc10c0736d0 2024-05-21T14:45:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.359+0000 7fc111200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fc10c15cbb0 con 0x7fc10c0c6760 2024-05-21T14:45:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.359+0000 7fc111200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fc10c15cdf0 con 0x7fc10c159f20 2024-05-21T14:45:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.359+0000 7fc109e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc10c0c6760 0x7fc10c0c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.359+0000 7fc10a800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc10c159f20 0x7fc10c073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.359+0000 7fc109e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc10c0c6760 0x7fc10c0c7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.78:48936/0 (socket says 172.21.15.78:48936) 2024-05-21T14:45:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.359+0000 7fc109e00640 1 -- 172.21.15.78:0/1225341268 learned_addr learned my addr 172.21.15.78:0/1225341268 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.359+0000 7fc10a800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc10c159f20 0x7fc10c073ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.78:47262/0 (socket says 172.21.15.78:47262) 2024-05-21T14:45:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.359+0000 7fc109e00640 1 -- 172.21.15.78:0/1225341268 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc10c159f20 msgr2=0x7fc10c073ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.359+0000 7fc109e00640 1 --2- 172.21.15.78:0/1225341268 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc10c159f20 0x7fc10c073ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.359+0000 7fc109e00640 1 -- 172.21.15.78:0/1225341268 >> v1:172.21.15.84:6789/0 conn(0x7fc10c0736d0 legacy=0x7fc10c159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.359+0000 7fc109e00640 1 -- 172.21.15.78:0/1225341268 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10c15d0d0 con 0x7fc10c0c6760 2024-05-21T14:45:36.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.363+0000 7fc109e00640 1 --2- 172.21.15.78:0/1225341268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc10c0c6760 0x7fc10c0c7310 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009e50 tx=0x7fc0fc01ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc6b7a0b36889c69 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:36.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.363+0000 7fc109400640 1 -- 172.21.15.78:0/1225341268 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc0a5700 con 0x7fc10c0c6760 2024-05-21T14:45:36.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.363+0000 7fc109400640 1 -- 172.21.15.78:0/1225341268 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0fc0a58a0 con 0x7fc10c0c6760 2024-05-21T14:45:36.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.363+0000 7fc109400640 1 -- 172.21.15.78:0/1225341268 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc0a5c70 con 0x7fc10c0c6760 2024-05-21T14:45:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.363+0000 7fc111200640 1 -- 172.21.15.78:0/1225341268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc10c0c6760 msgr2=0x7fc10c0c7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.363+0000 7fc111200640 1 --2- 172.21.15.78:0/1225341268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc10c0c6760 0x7fc10c0c7310 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009e50 tx=0x7fc0fc01ca30 comp rx=0 tx=0).stop 2024-05-21T14:45:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.363+0000 7fc111200640 1 -- 172.21.15.78:0/1225341268 shutdown_connections 2024-05-21T14:45:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.363+0000 7fc111200640 1 --2- 172.21.15.78:0/1225341268 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc10c159f20 0x7fc10c073ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.363+0000 7fc111200640 1 --2- 172.21.15.78:0/1225341268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc10c0c6760 0x7fc10c0c7310 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.363+0000 7fc111200640 1 -- 172.21.15.78:0/1225341268 >> 172.21.15.78:0/1225341268 conn(0x7fc10c0c9380 msgr2=0x7fc10c0c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.363+0000 7fc111200640 1 -- 172.21.15.78:0/1225341268 shutdown_connections 2024-05-21T14:45:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.363+0000 7fc111200640 1 -- 172.21.15.78:0/1225341268 wait complete. 2024-05-21T14:45:36.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.367+0000 7fc111200640 1 Processor -- start 2024-05-21T14:45:36.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.367+0000 7fc111200640 1 -- start start 2024-05-21T14:45:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.367+0000 7fc111200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc10c0736d0 0x7fc10c14b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.367+0000 7fc111200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc10c0c6760 0x7fc10c14cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.367+0000 7fc111200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc10c159f20 0x7fc10c146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.367+0000 7fc111200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc10c0c79d0 con 0x7fc10c0736d0 2024-05-21T14:45:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.367+0000 7fc111200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc10c0c7850 con 0x7fc10c159f20 2024-05-21T14:45:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.367+0000 7fc111200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fc10c0c6b70 con 0x7fc10c0c6760 2024-05-21T14:45:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.367+0000 7fc109e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc10c0736d0 0x7fc10c14b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.367+0000 7fc109e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc10c0736d0 0x7fc10c14b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49684/0 (socket says 172.21.15.78:49684) 2024-05-21T14:45:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.367+0000 7fc109e00640 1 -- 172.21.15.78:0/155431914 learned_addr learned my addr 172.21.15.78:0/155431914 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.371+0000 7fc10a800640 1 --2- 172.21.15.78:0/155431914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc10c159f20 0x7fc10c146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.371+0000 7fc101400640 1 --2- 172.21.15.78:0/155431914 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc10c0c6760 0x7fc10c14cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:36.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.371+0000 7fc109e00640 1 -- 172.21.15.78:0/155431914 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc10c0c6760 msgr2=0x7fc10c14cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:36.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.371+0000 7fc109e00640 1 --2- 172.21.15.78:0/155431914 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc10c0c6760 0x7fc10c14cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.371+0000 7fc109e00640 1 -- 172.21.15.78:0/155431914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc10c159f20 msgr2=0x7fc10c146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:36.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.371+0000 7fc109e00640 1 --2- 172.21.15.78:0/155431914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc10c159f20 0x7fc10c146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.371+0000 7fc109e00640 1 -- 172.21.15.78:0/155431914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10c15adc0 con 0x7fc10c0736d0 2024-05-21T14:45:36.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.371+0000 7fc109e00640 1 --2- 172.21.15.78:0/155431914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc10c0736d0 0x7fc10c14b9e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc01a660 tx=0x7fc0fc0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:36.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.371+0000 7fc102a00640 1 -- 172.21.15.78:0/155431914 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc0bd020 con 0x7fc10c0736d0 2024-05-21T14:45:36.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.371+0000 7fc102a00640 1 -- 172.21.15.78:0/155431914 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0fc0b8670 con 0x7fc10c0736d0 2024-05-21T14:45:36.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.371+0000 7fc102a00640 1 -- 172.21.15.78:0/155431914 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc009510 con 0x7fc10c0736d0 2024-05-21T14:45:36.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.371+0000 7fc111200640 1 -- 172.21.15.78:0/155431914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc10c15b0a0 con 0x7fc10c0736d0 2024-05-21T14:45:36.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.371+0000 7fc111200640 1 -- 172.21.15.78:0/155431914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc10c1f82b0 con 0x7fc10c0736d0 2024-05-21T14:45:36.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.371+0000 7fc111200640 1 -- 172.21.15.78:0/155431914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc10c157010 con 0x7fc10c0736d0 2024-05-21T14:45:36.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.371+0000 7fc102a00640 1 -- 172.21.15.78:0/155431914 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc0fc0c0070 con 0x7fc10c0736d0 2024-05-21T14:45:36.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.371+0000 7fc102a00640 1 --2- 172.21.15.78:0/155431914 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fc0e80678c0 0x7fc0e8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:36.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.375+0000 7fc102a00640 1 -- 172.21.15.78:0/155431914 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fc0fc120530 con 0x7fc10c0736d0 2024-05-21T14:45:36.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.375+0000 7fc101400640 1 --2- 172.21.15.78:0/155431914 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fc0e80678c0 0x7fc0e8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.375+0000 7fc101400640 1 --2- 172.21.15.78:0/155431914 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fc0e80678c0 0x7fc0e8069dd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc10c1499b0 tx=0x7fc0f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:36.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.379+0000 7fc102a00640 1 -- 172.21.15.78:0/155431914 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fc0fc016620 con 0x7fc10c0736d0 2024-05-21T14:45:36.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.531+0000 7fc111200640 1 -- 172.21.15.78:0/155431914 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc10c14b020 con 0x7fc0e80678c0 2024-05-21T14:45:36.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.551+0000 7fc102a00640 1 -- 172.21.15.78:0/155431914 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252068 (secure 0 0 0) 0x7fc0f40013d0 con 0x7fc0e80678c0 2024-05-21T14:45:36.561 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:45:36.562 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-05-21T14:45:36.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.551+0000 7fc111200640 1 -- 172.21.15.78:0/155431914 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fc0e80678c0 msgr2=0x7fc0e8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:36.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.551+0000 7fc111200640 1 --2- 172.21.15.78:0/155431914 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fc0e80678c0 0x7fc0e8069dd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc10c1499b0 tx=0x7fc0f4009040 comp rx=0 tx=0).stop 2024-05-21T14:45:36.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.551+0000 7fc111200640 1 -- 172.21.15.78:0/155431914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc10c0736d0 msgr2=0x7fc10c14b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:36.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.551+0000 7fc111200640 1 --2- 172.21.15.78:0/155431914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc10c0736d0 0x7fc10c14b9e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc01a660 tx=0x7fc0fc0197d0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.551+0000 7fc111200640 1 -- 172.21.15.78:0/155431914 shutdown_connections 2024-05-21T14:45:36.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.551+0000 7fc111200640 1 --2- 172.21.15.78:0/155431914 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fc0e80678c0 0x7fc0e8069dd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.551+0000 7fc111200640 1 --2- 172.21.15.78:0/155431914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc10c159f20 0x7fc10c146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.551+0000 7fc111200640 1 --2- 172.21.15.78:0/155431914 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc10c0c6760 0x7fc10c14cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.551+0000 7fc111200640 1 --2- 172.21.15.78:0/155431914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc10c0736d0 0x7fc10c14b9e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.551+0000 7fc111200640 1 -- 172.21.15.78:0/155431914 >> 172.21.15.78:0/155431914 conn(0x7fc10c0c9380 msgr2=0x7fc10c06b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:36.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.551+0000 7fc111200640 1 -- 172.21.15.78:0/155431914 shutdown_connections 2024-05-21T14:45:36.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.551+0000 7fc111200640 1 -- 172.21.15.78:0/155431914 wait complete. 2024-05-21T14:45:36.581 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2024-05-21T14:45:34.541257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":612359,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":380,"num_write_kb":2500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":309,"ondisk_log_size":309,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218572,"kb_used_data":2420,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756148,"statfs":{"total":773094113280,"available":772870295552,"internally_reserved":0,"allocated":2478080,"data_stored":1960875,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9027,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004917"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.175028+0000","last_change":"2024-05-21T14:43:19.606707+0000","last_active":"2024-05-21T14:44:00.175028+0000","last_peered":"2024-05-21T14:44:00.175028+0000","last_clean":"2024-05-21T14:44:00.175028+0000","last_became_active":"2024-05-21T14:43:19.606365+0000","last_became_peered":"2024-05-21T14:43:19.606365+0000","last_unstale":"2024-05-21T14:44:00.175028+0000","last_undegraded":"2024-05-21T14:44:00.175028+0000","last_fullsized":"2024-05-21T14:44:00.175028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:26.135357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172853+0000","last_change":"2024-05-21T14:43:19.632879+0000","last_active":"2024-05-21T14:44:00.172853+0000","last_peered":"2024-05-21T14:44:00.172853+0000","last_clean":"2024-05-21T14:44:00.172853+0000","last_became_active":"2024-05-21T14:43:19.632218+0000","last_became_peered":"2024-05-21T14:43:19.632218+0000","last_unstale":"2024-05-21T14:44:00.172853+0000","last_undegraded":"2024-05-21T14:44:00.172853+0000","last_fullsized":"2024-05-21T14:44:00.172853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:35:49.461861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173159+0000","last_change":"2024-05-21T14:43:19.620214+0000","last_active":"2024-05-21T14:44:00.173159+0000","last_peered":"2024-05-21T14:44:00.173159+0000","last_clean":"2024-05-21T14:44:00.173159+0000","last_became_active":"2024-05-21T14:43:19.619012+0000","last_became_peered":"2024-05-21T14:43:19.619012+0000","last_unstale":"2024-05-21T14:44:00.173159+0000","last_undegraded":"2024-05-21T14:44:00.173159+0000","last_fullsized":"2024-05-21T14:44:00.173159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:40:22.415178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.171875+0000","last_change":"2024-05-21T14:43:19.602199+0000","last_active":"2024-05-21T14:44:00.171875+0000","last_peered":"2024-05-21T14:44:00.171875+0000","last_clean":"2024-05-21T14:44:00.171875+0000","last_became_active":"2024-05-21T14:43:19.601797+0000","last_became_peered":"2024-05-21T14:43:19.601797+0000","last_unstale":"2024-05-21T14:44:00.171875+0000","last_undegraded":"2024-05-21T14:44:00.171875+0000","last_fullsized":"2024-05-21T14:44:00.171875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:33:00.071681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173080+0000","last_change":"2024-05-21T14:43:19.623449+0000","last_active":"2024-05-21T14:44:00.173080+0000","last_peered":"2024-05-21T14:44:00.173080+0000","last_clean":"2024-05-21T14:44:00.173080+0000","last_became_active":"2024-05-21T14:43:19.623125+0000","last_became_peered":"2024-05-21T14:43:19.623125+0000","last_unstale":"2024-05-21T14:44:00.173080+0000","last_undegraded":"2024-05-21T14:44:00.173080+0000","last_fullsized":"2024-05-21T14:44:00.173080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:42.178156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.171595+0000","last_change":"2024-05-21T14:43:19.591222+0000","last_active":"2024-05-21T14:44:00.171595+0000","last_peered":"2024-05-21T14:44:00.171595+0000","last_clean":"2024-05-21T14:44:00.171595+0000","last_became_active":"2024-05-21T14:43:19.590858+0000","last_became_peered":"2024-05-21T14:43:19.590858+0000","last_unstale":"2024-05-21T14:44:00.171595+0000","last_undegraded":"2024-05-21T14:44:00.171595+0000","last_fullsized":"2024-05-21T14:44:00.171595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:21:15.737192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172643+0000","last_change":"2024-05-21T14:43:19.614716+0000","last_active":"2024-05-21T14:44:00.172643+0000","last_peered":"2024-05-21T14:44:00.172643+0000","last_clean":"2024-05-21T14:44:00.172643+0000","last_became_active":"2024-05-21T14:43:19.614451+0000","last_became_peered":"2024-05-21T14:43:19.614451+0000","last_unstale":"2024-05-21T14:44:00.172643+0000","last_undegraded":"2024-05-21T14:44:00.172643+0000","last_fullsized":"2024-05-21T14:44:00.172643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:07:01.524574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172223+0000","last_change":"2024-05-21T14:43:19.604029+0000","last_active":"2024-05-21T14:44:00.172223+0000","last_peered":"2024-05-21T14:44:00.172223+0000","last_clean":"2024-05-21T14:44:00.172223+0000","last_became_active":"2024-05-21T14:43:19.603164+0000","last_became_peered":"2024-05-21T14:43:19.603164+0000","last_unstale":"2024-05-21T14:44:00.172223+0000","last_undegraded":"2024-05-21T14:44:00.172223+0000","last_fullsized":"2024-05-21T14:44:00.172223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:14:27.286952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813822+0000","last_change":"2024-05-21T14:43:19.613765+0000","last_active":"2024-05-21T14:43:59.813822+0000","last_peered":"2024-05-21T14:43:59.813822+0000","last_clean":"2024-05-21T14:43:59.813822+0000","last_became_active":"2024-05-21T14:43:19.613429+0000","last_became_peered":"2024-05-21T14:43:19.613429+0000","last_unstale":"2024-05-21T14:43:59.813822+0000","last_undegraded":"2024-05-21T14:43:59.813822+0000","last_fullsized":"2024-05-21T14:43:59.813822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:29:16.905434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174905+0000","last_change":"2024-05-21T14:43:19.607400+0000","last_active":"2024-05-21T14:44:00.174905+0000","last_peered":"2024-05-21T14:44:00.174905+0000","last_clean":"2024-05-21T14:44:00.174905+0000","last_became_active":"2024-05-21T14:43:19.607105+0000","last_became_peered":"2024-05-21T14:43:19.607105+0000","last_unstale":"2024-05-21T14:44:00.174905+0000","last_undegraded":"2024-05-21T14:44:00.174905+0000","last_fullsized":"2024-05-21T14:44:00.174905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:26:22.366105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.171923+0000","last_change":"2024-05-21T14:43:19.606534+0000","last_active":"2024-05-21T14:44:00.171923+0000","last_peered":"2024-05-21T14:44:00.171923+0000","last_clean":"2024-05-21T14:44:00.171923+0000","last_became_active":"2024-05-21T14:43:19.606029+0000","last_became_peered":"2024-05-21T14:43:19.606029+0000","last_unstale":"2024-05-21T14:44:00.171923+0000","last_undegraded":"2024-05-21T14:44:00.171923+0000","last_fullsized":"2024-05-21T14:44:00.171923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:33:48.849701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173535+0000","last_change":"2024-05-21T14:43:19.609910+0000","last_active":"2024-05-21T14:44:00.173535+0000","last_peered":"2024-05-21T14:44:00.173535+0000","last_clean":"2024-05-21T14:44:00.173535+0000","last_became_active":"2024-05-21T14:43:19.609616+0000","last_became_peered":"2024-05-21T14:43:19.609616+0000","last_unstale":"2024-05-21T14:44:00.173535+0000","last_undegraded":"2024-05-21T14:44:00.173535+0000","last_fullsized":"2024-05-21T14:44:00.173535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:36:16.637620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.199675+0000","last_change":"2024-05-21T14:43:19.604001+0000","last_active":"2024-05-21T14:44:00.199675+0000","last_peered":"2024-05-21T14:44:00.199675+0000","last_clean":"2024-05-21T14:44:00.199675+0000","last_became_active":"2024-05-21T14:43:19.596859+0000","last_became_peered":"2024-05-21T14:43:19.596859+0000","last_unstale":"2024-05-21T14:44:00.199675+0000","last_undegraded":"2024-05-21T14:44:00.199675+0000","last_fullsized":"2024-05-21T14:44:00.199675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:45:43.431420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:30.698277+0000","last_change":"2024-05-21T14:43:19.626837+0000","last_active":"2024-05-21T14:45:30.698277+0000","last_peered":"2024-05-21T14:45:30.698277+0000","last_clean":"2024-05-21T14:45:30.698277+0000","last_became_active":"2024-05-21T14:43:19.626213+0000","last_became_peered":"2024-05-21T14:43:19.626213+0000","last_unstale":"2024-05-21T14:45:30.698277+0000","last_undegraded":"2024-05-21T14:45:30.698277+0000","last_fullsized":"2024-05-21T14:45:30.698277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:51.705474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172174+0000","last_change":"2024-05-21T14:43:19.613483+0000","last_active":"2024-05-21T14:44:00.172174+0000","last_peered":"2024-05-21T14:44:00.172174+0000","last_clean":"2024-05-21T14:44:00.172174+0000","last_became_active":"2024-05-21T14:43:19.612581+0000","last_became_peered":"2024-05-21T14:43:19.612581+0000","last_unstale":"2024-05-21T14:44:00.172174+0000","last_undegraded":"2024-05-21T14:44:00.172174+0000","last_fullsized":"2024-05-21T14:44:00.172174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:41:15.797196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173301+0000","last_change":"2024-05-21T14:43:19.609126+0000","last_active":"2024-05-21T14:44:00.173301+0000","last_peered":"2024-05-21T14:44:00.173301+0000","last_clean":"2024-05-21T14:44:00.173301+0000","last_became_active":"2024-05-21T14:43:19.607967+0000","last_became_peered":"2024-05-21T14:43:19.607967+0000","last_unstale":"2024-05-21T14:44:00.173301+0000","last_undegraded":"2024-05-21T14:44:00.173301+0000","last_fullsized":"2024-05-21T14:44:00.173301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:35.881039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174418+0000","last_change":"2024-05-21T14:43:19.613487+0000","last_active":"2024-05-21T14:44:00.174418+0000","last_peered":"2024-05-21T14:44:00.174418+0000","last_clean":"2024-05-21T14:44:00.174418+0000","last_became_active":"2024-05-21T14:43:19.611280+0000","last_became_peered":"2024-05-21T14:43:19.611280+0000","last_unstale":"2024-05-21T14:44:00.174418+0000","last_undegraded":"2024-05-21T14:44:00.174418+0000","last_fullsized":"2024-05-21T14:44:00.174418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:51:21.887715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815794+0000","last_change":"2024-05-21T14:43:19.607601+0000","last_active":"2024-05-21T14:43:59.815794+0000","last_peered":"2024-05-21T14:43:59.815794+0000","last_clean":"2024-05-21T14:43:59.815794+0000","last_became_active":"2024-05-21T14:43:19.606719+0000","last_became_peered":"2024-05-21T14:43:19.606719+0000","last_unstale":"2024-05-21T14:43:59.815794+0000","last_undegraded":"2024-05-21T14:43:59.815794+0000","last_fullsized":"2024-05-21T14:43:59.815794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:04:32.310805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173869+0000","last_change":"2024-05-21T14:43:19.618470+0000","last_active":"2024-05-21T14:44:00.173869+0000","last_peered":"2024-05-21T14:44:00.173869+0000","last_clean":"2024-05-21T14:44:00.173869+0000","last_became_active":"2024-05-21T14:43:19.617408+0000","last_became_peered":"2024-05-21T14:43:19.617408+0000","last_unstale":"2024-05-21T14:44:00.173869+0000","last_undegraded":"2024-05-21T14:44:00.173869+0000","last_fullsized":"2024-05-21T14:44:00.173869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:53:58.877306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173639+0000","last_change":"2024-05-21T14:43:19.609835+0000","last_active":"2024-05-21T14:44:00.173639+0000","last_peered":"2024-05-21T14:44:00.173639+0000","last_clean":"2024-05-21T14:44:00.173639+0000","last_became_active":"2024-05-21T14:43:19.609525+0000","last_became_peered":"2024-05-21T14:43:19.609525+0000","last_unstale":"2024-05-21T14:44:00.173639+0000","last_undegraded":"2024-05-21T14:44:00.173639+0000","last_fullsized":"2024-05-21T14:44:00.173639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:57:04.748898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813570+0000","last_change":"2024-05-21T14:43:19.607732+0000","last_active":"2024-05-21T14:43:59.813570+0000","last_peered":"2024-05-21T14:43:59.813570+0000","last_clean":"2024-05-21T14:43:59.813570+0000","last_became_active":"2024-05-21T14:43:19.606839+0000","last_became_peered":"2024-05-21T14:43:19.606839+0000","last_unstale":"2024-05-21T14:43:59.813570+0000","last_undegraded":"2024-05-21T14:43:59.813570+0000","last_fullsized":"2024-05-21T14:43:59.813570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:43:15.675663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813363+0000","last_change":"2024-05-21T14:43:19.601108+0000","last_active":"2024-05-21T14:43:59.813363+0000","last_peered":"2024-05-21T14:43:59.813363+0000","last_clean":"2024-05-21T14:43:59.813363+0000","last_became_active":"2024-05-21T14:43:19.600780+0000","last_became_peered":"2024-05-21T14:43:19.600780+0000","last_unstale":"2024-05-21T14:43:59.813363+0000","last_undegraded":"2024-05-21T14:43:59.813363+0000","last_fullsized":"2024-05-21T14:43:59.813363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:47:19.062733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172432+0000","last_change":"2024-05-21T14:43:19.620463+0000","last_active":"2024-05-21T14:44:00.172432+0000","last_peered":"2024-05-21T14:44:00.172432+0000","last_clean":"2024-05-21T14:44:00.172432+0000","last_became_active":"2024-05-21T14:43:19.614489+0000","last_became_peered":"2024-05-21T14:43:19.614489+0000","last_unstale":"2024-05-21T14:44:00.172432+0000","last_undegraded":"2024-05-21T14:44:00.172432+0000","last_fullsized":"2024-05-21T14:44:00.172432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:51:07.953352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173470+0000","last_change":"2024-05-21T14:43:19.624683+0000","last_active":"2024-05-21T14:44:00.173470+0000","last_peered":"2024-05-21T14:44:00.173470+0000","last_clean":"2024-05-21T14:44:00.173470+0000","last_became_active":"2024-05-21T14:43:19.624304+0000","last_became_peered":"2024-05-21T14:43:19.624304+0000","last_unstale":"2024-05-21T14:44:00.173470+0000","last_undegraded":"2024-05-21T14:44:00.173470+0000","last_fullsized":"2024-05-21T14:44:00.173470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:53.874968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173284+0000","last_change":"2024-05-21T14:43:19.621030+0000","last_active":"2024-05-21T14:44:00.173284+0000","last_peered":"2024-05-21T14:44:00.173284+0000","last_clean":"2024-05-21T14:44:00.173284+0000","last_became_active":"2024-05-21T14:43:19.619072+0000","last_became_peered":"2024-05-21T14:43:19.619072+0000","last_unstale":"2024-05-21T14:44:00.173284+0000","last_undegraded":"2024-05-21T14:44:00.173284+0000","last_fullsized":"2024-05-21T14:44:00.173284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:22:09.423661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172157+0000","last_change":"2024-05-21T14:43:19.602880+0000","last_active":"2024-05-21T14:44:00.172157+0000","last_peered":"2024-05-21T14:44:00.172157+0000","last_clean":"2024-05-21T14:44:00.172157+0000","last_became_active":"2024-05-21T14:43:19.602577+0000","last_became_peered":"2024-05-21T14:43:19.602577+0000","last_unstale":"2024-05-21T14:44:00.172157+0000","last_undegraded":"2024-05-21T14:44:00.172157+0000","last_fullsized":"2024-05-21T14:44:00.172157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:04:10.094373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.200159+0000","last_change":"2024-05-21T14:43:19.632328+0000","last_active":"2024-05-21T14:44:00.200159+0000","last_peered":"2024-05-21T14:44:00.200159+0000","last_clean":"2024-05-21T14:44:00.200159+0000","last_became_active":"2024-05-21T14:43:19.631351+0000","last_became_peered":"2024-05-21T14:43:19.631351+0000","last_unstale":"2024-05-21T14:44:00.200159+0000","last_undegraded":"2024-05-21T14:44:00.200159+0000","last_fullsized":"2024-05-21T14:44:00.200159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:36:18.467070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.199755+0000","last_change":"2024-05-21T14:43:19.632282+0000","last_active":"2024-05-21T14:44:00.199755+0000","last_peered":"2024-05-21T14:44:00.199755+0000","last_clean":"2024-05-21T14:44:00.199755+0000","last_became_active":"2024-05-21T14:43:19.631522+0000","last_became_peered":"2024-05-21T14:43:19.631522+0000","last_unstale":"2024-05-21T14:44:00.199755+0000","last_undegraded":"2024-05-21T14:44:00.199755+0000","last_fullsized":"2024-05-21T14:44:00.199755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:23:32.646087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172783+0000","last_change":"2024-05-21T14:43:19.620046+0000","last_active":"2024-05-21T14:44:00.172783+0000","last_peered":"2024-05-21T14:44:00.172783+0000","last_clean":"2024-05-21T14:44:00.172783+0000","last_became_active":"2024-05-21T14:43:19.612428+0000","last_became_peered":"2024-05-21T14:43:19.612428+0000","last_unstale":"2024-05-21T14:44:00.172783+0000","last_undegraded":"2024-05-21T14:44:00.172783+0000","last_fullsized":"2024-05-21T14:44:00.172783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:08:33.785399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173737+0000","last_change":"2024-05-21T14:43:19.618198+0000","last_active":"2024-05-21T14:44:00.173737+0000","last_peered":"2024-05-21T14:44:00.173737+0000","last_clean":"2024-05-21T14:44:00.173737+0000","last_became_active":"2024-05-21T14:43:19.617903+0000","last_became_peered":"2024-05-21T14:43:19.617903+0000","last_unstale":"2024-05-21T14:44:00.173737+0000","last_undegraded":"2024-05-21T14:44:00.173737+0000","last_fullsized":"2024-05-21T14:44:00.173737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:59.606862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813652+0000","last_change":"2024-05-21T14:43:19.613942+0000","last_active":"2024-05-21T14:43:59.813652+0000","last_peered":"2024-05-21T14:43:59.813652+0000","last_clean":"2024-05-21T14:43:59.813652+0000","last_became_active":"2024-05-21T14:43:19.613035+0000","last_became_peered":"2024-05-21T14:43:19.613035+0000","last_unstale":"2024-05-21T14:43:59.813652+0000","last_undegraded":"2024-05-21T14:43:59.813652+0000","last_fullsized":"2024-05-21T14:43:59.813652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:47:46.462547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.171393+0000","last_change":"2024-05-21T14:43:19.626414+0000","last_active":"2024-05-21T14:44:00.171393+0000","last_peered":"2024-05-21T14:44:00.171393+0000","last_clean":"2024-05-21T14:44:00.171393+0000","last_became_active":"2024-05-21T14:43:19.626080+0000","last_became_peered":"2024-05-21T14:43:19.626080+0000","last_unstale":"2024-05-21T14:44:00.171393+0000","last_undegraded":"2024-05-21T14:44:00.171393+0000","last_fullsized":"2024-05-21T14:44:00.171393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:37:38.449284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813381+0000","last_change":"2024-05-21T14:43:19.620806+0000","last_active":"2024-05-21T14:43:59.813381+0000","last_peered":"2024-05-21T14:43:59.813381+0000","last_clean":"2024-05-21T14:43:59.813381+0000","last_became_active":"2024-05-21T14:43:19.620449+0000","last_became_peered":"2024-05-21T14:43:19.620449+0000","last_unstale":"2024-05-21T14:43:59.813381+0000","last_undegraded":"2024-05-21T14:43:59.813381+0000","last_fullsized":"2024-05-21T14:43:59.813381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:43:52.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172688+0000","last_change":"2024-05-21T14:43:18.603028+0000","last_active":"2024-05-21T14:44:00.172688+0000","last_peered":"2024-05-21T14:44:00.172688+0000","last_clean":"2024-05-21T14:44:00.172688+0000","last_became_active":"2024-05-21T14:43:18.602036+0000","last_became_peered":"2024-05-21T14:43:18.602036+0000","last_unstale":"2024-05-21T14:44:00.172688+0000","last_undegraded":"2024-05-21T14:44:00.172688+0000","last_fullsized":"2024-05-21T14:44:00.172688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:15:25.384197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813816+0000","last_change":"2024-05-21T14:43:19.599725+0000","last_active":"2024-05-21T14:43:59.813816+0000","last_peered":"2024-05-21T14:43:59.813816+0000","last_clean":"2024-05-21T14:43:59.813816+0000","last_became_active":"2024-05-21T14:43:19.598972+0000","last_became_peered":"2024-05-21T14:43:19.598972+0000","last_unstale":"2024-05-21T14:43:59.813816+0000","last_undegraded":"2024-05-21T14:43:59.813816+0000","last_fullsized":"2024-05-21T14:43:59.813816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:54:00.871046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'7","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173842+0000","last_change":"2024-05-21T14:43:18.615934+0000","last_active":"2024-05-21T14:44:00.173842+0000","last_peered":"2024-05-21T14:44:00.173842+0000","last_clean":"2024-05-21T14:44:00.173842+0000","last_became_active":"2024-05-21T14:43:18.615568+0000","last_became_peered":"2024-05-21T14:43:18.615568+0000","last_unstale":"2024-05-21T14:44:00.173842+0000","last_undegraded":"2024-05-21T14:44:00.173842+0000","last_fullsized":"2024-05-21T14:44:00.173842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:28:54.494319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'3","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.199358+0000","last_change":"2024-05-21T14:43:18.615154+0000","last_active":"2024-05-21T14:44:00.199358+0000","last_peered":"2024-05-21T14:44:00.199358+0000","last_clean":"2024-05-21T14:44:00.199358+0000","last_became_active":"2024-05-21T14:43:18.613838+0000","last_became_peered":"2024-05-21T14:43:18.613838+0000","last_unstale":"2024-05-21T14:44:00.199358+0000","last_undegraded":"2024-05-21T14:44:00.199358+0000","last_fullsized":"2024-05-21T14:44:00.199358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:32:09.174124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172672+0000","last_change":"2024-05-21T14:43:19.633585+0000","last_active":"2024-05-21T14:44:00.172672+0000","last_peered":"2024-05-21T14:44:00.172672+0000","last_clean":"2024-05-21T14:44:00.172672+0000","last_became_active":"2024-05-21T14:43:19.632476+0000","last_became_peered":"2024-05-21T14:43:19.632476+0000","last_unstale":"2024-05-21T14:44:00.172672+0000","last_undegraded":"2024-05-21T14:44:00.172672+0000","last_fullsized":"2024-05-21T14:44:00.172672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:53.023931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'3","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173489+0000","last_change":"2024-05-21T14:43:18.585548+0000","last_active":"2024-05-21T14:44:00.173489+0000","last_peered":"2024-05-21T14:44:00.173489+0000","last_clean":"2024-05-21T14:44:00.173489+0000","last_became_active":"2024-05-21T14:43:18.585099+0000","last_became_peered":"2024-05-21T14:43:18.585099+0000","last_unstale":"2024-05-21T14:44:00.173489+0000","last_undegraded":"2024-05-21T14:44:00.173489+0000","last_fullsized":"2024-05-21T14:44:00.173489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:20:16.856225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813349+0000","last_change":"2024-05-21T14:43:19.614884+0000","last_active":"2024-05-21T14:43:59.813349+0000","last_peered":"2024-05-21T14:43:59.813349+0000","last_clean":"2024-05-21T14:43:59.813349+0000","last_became_active":"2024-05-21T14:43:19.614064+0000","last_became_peered":"2024-05-21T14:43:19.614064+0000","last_unstale":"2024-05-21T14:43:59.813349+0000","last_undegraded":"2024-05-21T14:43:59.813349+0000","last_fullsized":"2024-05-21T14:43:59.813349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:42:17.091043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"23'4","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813926+0000","last_change":"2024-05-21T14:43:18.602794+0000","last_active":"2024-05-21T14:43:59.813926+0000","last_peered":"2024-05-21T14:43:59.813926+0000","last_clean":"2024-05-21T14:43:59.813926+0000","last_became_active":"2024-05-21T14:43:18.602429+0000","last_became_peered":"2024-05-21T14:43:18.602429+0000","last_unstale":"2024-05-21T14:43:59.813926+0000","last_undegraded":"2024-05-21T14:43:59.813926+0000","last_fullsized":"2024-05-21T14:43:59.813926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:50:14.465202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172190+0000","last_change":"2024-05-21T14:43:19.602663+0000","last_active":"2024-05-21T14:44:00.172190+0000","last_peered":"2024-05-21T14:44:00.172190+0000","last_clean":"2024-05-21T14:44:00.172190+0000","last_became_active":"2024-05-21T14:43:19.602294+0000","last_became_peered":"2024-05-21T14:43:19.602294+0000","last_unstale":"2024-05-21T14:44:00.172190+0000","last_undegraded":"2024-05-21T14:44:00.172190+0000","last_fullsized":"2024-05-21T14:44:00.172190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:48:56.271741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'4","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174916+0000","last_change":"2024-05-21T14:43:18.604601+0000","last_active":"2024-05-21T14:44:00.174916+0000","last_peered":"2024-05-21T14:44:00.174916+0000","last_clean":"2024-05-21T14:44:00.174916+0000","last_became_active":"2024-05-21T14:43:18.604262+0000","last_became_peered":"2024-05-21T14:43:18.604262+0000","last_unstale":"2024-05-21T14:44:00.174916+0000","last_undegraded":"2024-05-21T14:44:00.174916+0000","last_fullsized":"2024-05-21T14:44:00.174916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:15.490579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173377+0000","last_change":"2024-05-21T14:43:19.613952+0000","last_active":"2024-05-21T14:44:00.173377+0000","last_peered":"2024-05-21T14:44:00.173377+0000","last_clean":"2024-05-21T14:44:00.173377+0000","last_became_active":"2024-05-21T14:43:19.613093+0000","last_became_peered":"2024-05-21T14:43:19.613093+0000","last_unstale":"2024-05-21T14:44:00.173377+0000","last_undegraded":"2024-05-21T14:44:00.173377+0000","last_fullsized":"2024-05-21T14:44:00.173377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:03:44.925212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815124+0000","last_change":"2024-05-21T14:43:18.602343+0000","last_active":"2024-05-21T14:43:59.815124+0000","last_peered":"2024-05-21T14:43:59.815124+0000","last_clean":"2024-05-21T14:43:59.815124+0000","last_became_active":"2024-05-21T14:43:18.601500+0000","last_became_peered":"2024-05-21T14:43:18.601500+0000","last_unstale":"2024-05-21T14:43:59.815124+0000","last_undegraded":"2024-05-21T14:43:59.815124+0000","last_fullsized":"2024-05-21T14:43:59.815124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:54:21.960430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173702+0000","last_change":"2024-05-21T14:43:19.608580+0000","last_active":"2024-05-21T14:44:00.173702+0000","last_peered":"2024-05-21T14:44:00.173702+0000","last_clean":"2024-05-21T14:44:00.173702+0000","last_became_active":"2024-05-21T14:43:19.608038+0000","last_became_peered":"2024-05-21T14:43:19.608038+0000","last_unstale":"2024-05-21T14:44:00.173702+0000","last_undegraded":"2024-05-21T14:44:00.173702+0000","last_fullsized":"2024-05-21T14:44:00.173702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:19.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'18","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:30.713287+0000","last_change":"2024-05-21T14:43:18.606824+0000","last_active":"2024-05-21T14:45:30.713287+0000","last_peered":"2024-05-21T14:45:30.713287+0000","last_clean":"2024-05-21T14:45:30.713287+0000","last_became_active":"2024-05-21T14:43:18.606449+0000","last_became_peered":"2024-05-21T14:43:18.606449+0000","last_unstale":"2024-05-21T14:45:30.713287+0000","last_undegraded":"2024-05-21T14:45:30.713287+0000","last_fullsized":"2024-05-21T14:45:30.713287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:43:41.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15565,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174675+0000","last_change":"2024-05-21T14:43:19.634014+0000","last_active":"2024-05-21T14:44:00.174675+0000","last_peered":"2024-05-21T14:44:00.174675+0000","last_clean":"2024-05-21T14:44:00.174675+0000","last_became_active":"2024-05-21T14:43:19.633664+0000","last_became_peered":"2024-05-21T14:43:19.633664+0000","last_unstale":"2024-05-21T14:44:00.174675+0000","last_undegraded":"2024-05-21T14:44:00.174675+0000","last_fullsized":"2024-05-21T14:44:00.174675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:36:07.708164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'9","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.814396+0000","last_change":"2024-05-21T14:43:18.614764+0000","last_active":"2024-05-21T14:43:59.814396+0000","last_peered":"2024-05-21T14:43:59.814396+0000","last_clean":"2024-05-21T14:43:59.814396+0000","last_became_active":"2024-05-21T14:43:18.614214+0000","last_became_peered":"2024-05-21T14:43:18.614214+0000","last_unstale":"2024-05-21T14:43:59.814396+0000","last_undegraded":"2024-05-21T14:43:59.814396+0000","last_fullsized":"2024-05-21T14:43:59.814396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:34:40.294756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.199358+0000","last_change":"2024-05-21T14:43:19.625313+0000","last_active":"2024-05-21T14:44:00.199358+0000","last_peered":"2024-05-21T14:44:00.199358+0000","last_clean":"2024-05-21T14:44:00.199358+0000","last_became_active":"2024-05-21T14:43:19.624474+0000","last_became_peered":"2024-05-21T14:43:19.624474+0000","last_unstale":"2024-05-21T14:44:00.199358+0000","last_undegraded":"2024-05-21T14:44:00.199358+0000","last_fullsized":"2024-05-21T14:44:00.199358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:28.280456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173900+0000","last_change":"2024-05-21T14:43:18.600736+0000","last_active":"2024-05-21T14:44:00.173900+0000","last_peered":"2024-05-21T14:44:00.173900+0000","last_clean":"2024-05-21T14:44:00.173900+0000","last_became_active":"2024-05-21T14:43:18.600415+0000","last_became_peered":"2024-05-21T14:43:18.600415+0000","last_unstale":"2024-05-21T14:44:00.173900+0000","last_undegraded":"2024-05-21T14:44:00.173900+0000","last_fullsized":"2024-05-21T14:44:00.173900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:03:57.207603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173657+0000","last_change":"2024-05-21T14:43:19.599637+0000","last_active":"2024-05-21T14:44:00.173657+0000","last_peered":"2024-05-21T14:44:00.173657+0000","last_clean":"2024-05-21T14:44:00.173657+0000","last_became_active":"2024-05-21T14:43:19.599195+0000","last_became_peered":"2024-05-21T14:43:19.599195+0000","last_unstale":"2024-05-21T14:44:00.173657+0000","last_undegraded":"2024-05-21T14:44:00.173657+0000","last_fullsized":"2024-05-21T14:44:00.173657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:17.350821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172653+0000","last_change":"2024-05-21T14:43:18.603064+0000","last_active":"2024-05-21T14:44:00.172653+0000","last_peered":"2024-05-21T14:44:00.172653+0000","last_clean":"2024-05-21T14:44:00.172653+0000","last_became_active":"2024-05-21T14:43:18.602658+0000","last_became_peered":"2024-05-21T14:43:18.602658+0000","last_unstale":"2024-05-21T14:44:00.172653+0000","last_undegraded":"2024-05-21T14:44:00.172653+0000","last_fullsized":"2024-05-21T14:44:00.172653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:09:28.623131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813178+0000","last_change":"2024-05-21T14:43:19.620760+0000","last_active":"2024-05-21T14:43:59.813178+0000","last_peered":"2024-05-21T14:43:59.813178+0000","last_clean":"2024-05-21T14:43:59.813178+0000","last_became_active":"2024-05-21T14:43:19.620409+0000","last_became_peered":"2024-05-21T14:43:19.620409+0000","last_unstale":"2024-05-21T14:43:59.813178+0000","last_undegraded":"2024-05-21T14:43:59.813178+0000","last_fullsized":"2024-05-21T14:43:59.813178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:49:59.051131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'17","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813245+0000","last_change":"2024-05-21T14:43:18.594225+0000","last_active":"2024-05-21T14:43:59.813245+0000","last_peered":"2024-05-21T14:43:59.813245+0000","last_clean":"2024-05-21T14:43:59.813245+0000","last_became_active":"2024-05-21T14:43:18.592335+0000","last_became_peered":"2024-05-21T14:43:18.592335+0000","last_unstale":"2024-05-21T14:43:59.813245+0000","last_undegraded":"2024-05-21T14:43:59.813245+0000","last_fullsized":"2024-05-21T14:43:59.813245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:00:58.772091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173357+0000","last_change":"2024-05-21T14:43:19.612442+0000","last_active":"2024-05-21T14:44:00.173357+0000","last_peered":"2024-05-21T14:44:00.173357+0000","last_clean":"2024-05-21T14:44:00.173357+0000","last_became_active":"2024-05-21T14:43:19.612110+0000","last_became_peered":"2024-05-21T14:43:19.612110+0000","last_unstale":"2024-05-21T14:44:00.173357+0000","last_undegraded":"2024-05-21T14:44:00.173357+0000","last_fullsized":"2024-05-21T14:44:00.173357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:53.451513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.175020+0000","last_change":"2024-05-21T14:43:18.613433+0000","last_active":"2024-05-21T14:44:00.175020+0000","last_peered":"2024-05-21T14:44:00.175020+0000","last_clean":"2024-05-21T14:44:00.175020+0000","last_became_active":"2024-05-21T14:43:18.613048+0000","last_became_peered":"2024-05-21T14:43:18.613048+0000","last_unstale":"2024-05-21T14:44:00.175020+0000","last_undegraded":"2024-05-21T14:44:00.175020+0000","last_fullsized":"2024-05-21T14:44:00.175020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:00:16.454574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172246+0000","last_change":"2024-05-21T14:43:19.597079+0000","last_active":"2024-05-21T14:44:00.172246+0000","last_peered":"2024-05-21T14:44:00.172246+0000","last_clean":"2024-05-21T14:44:00.172246+0000","last_became_active":"2024-05-21T14:43:19.596736+0000","last_became_peered":"2024-05-21T14:43:19.596736+0000","last_unstale":"2024-05-21T14:44:00.172246+0000","last_undegraded":"2024-05-21T14:44:00.172246+0000","last_fullsized":"2024-05-21T14:44:00.172246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:09:03.687971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815206+0000","last_change":"2024-05-21T14:43:18.620603+0000","last_active":"2024-05-21T14:43:59.815206+0000","last_peered":"2024-05-21T14:43:59.815206+0000","last_clean":"2024-05-21T14:43:59.815206+0000","last_became_active":"2024-05-21T14:43:18.619762+0000","last_became_peered":"2024-05-21T14:43:18.619762+0000","last_unstale":"2024-05-21T14:43:59.815206+0000","last_undegraded":"2024-05-21T14:43:59.815206+0000","last_fullsized":"2024-05-21T14:43:59.815206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:31:49.257435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.819643+0000","last_change":"2024-05-21T14:43:59.818544+0000","last_active":"2024-05-21T14:43:59.819643+0000","last_peered":"2024-05-21T14:43:59.819643+0000","last_clean":"2024-05-21T14:43:59.819643+0000","last_became_active":"2024-05-21T14:43:59.817946+0000","last_became_peered":"2024-05-21T14:43:59.817946+0000","last_unstale":"2024-05-21T14:43:59.819643+0000","last_undegraded":"2024-05-21T14:43:59.819643+0000","last_fullsized":"2024-05-21T14:43:59.819643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:20:02.691907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'3","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173123+0000","last_change":"2024-05-21T14:43:18.610121+0000","last_active":"2024-05-21T14:44:00.173123+0000","last_peered":"2024-05-21T14:44:00.173123+0000","last_clean":"2024-05-21T14:44:00.173123+0000","last_became_active":"2024-05-21T14:43:18.609349+0000","last_became_peered":"2024-05-21T14:43:18.609349+0000","last_unstale":"2024-05-21T14:44:00.173123+0000","last_undegraded":"2024-05-21T14:44:00.173123+0000","last_fullsized":"2024-05-21T14:44:00.173123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:48.330067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173737+0000","last_change":"2024-05-21T14:43:19.605193+0000","last_active":"2024-05-21T14:44:00.173737+0000","last_peered":"2024-05-21T14:44:00.173737+0000","last_clean":"2024-05-21T14:44:00.173737+0000","last_became_active":"2024-05-21T14:43:19.604869+0000","last_became_peered":"2024-05-21T14:43:19.604869+0000","last_unstale":"2024-05-21T14:44:00.173737+0000","last_undegraded":"2024-05-21T14:44:00.173737+0000","last_fullsized":"2024-05-21T14:44:00.173737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:58:05.078363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.199978+0000","last_change":"2024-05-21T14:43:18.616535+0000","last_active":"2024-05-21T14:44:00.199978+0000","last_peered":"2024-05-21T14:44:00.199978+0000","last_clean":"2024-05-21T14:44:00.199978+0000","last_became_active":"2024-05-21T14:43:18.615734+0000","last_became_peered":"2024-05-21T14:43:18.615734+0000","last_unstale":"2024-05-21T14:44:00.199978+0000","last_undegraded":"2024-05-21T14:44:00.199978+0000","last_fullsized":"2024-05-21T14:44:00.199978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:10:27.821535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173777+0000","last_change":"2024-05-21T14:43:19.615424+0000","last_active":"2024-05-21T14:44:00.173777+0000","last_peered":"2024-05-21T14:44:00.173777+0000","last_clean":"2024-05-21T14:44:00.173777+0000","last_became_active":"2024-05-21T14:43:19.614915+0000","last_became_peered":"2024-05-21T14:43:19.614915+0000","last_unstale":"2024-05-21T14:44:00.173777+0000","last_undegraded":"2024-05-21T14:44:00.173777+0000","last_fullsized":"2024-05-21T14:44:00.173777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:25:09.153430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813317+0000","last_change":"2024-05-21T14:43:08.080234+0000","last_active":"2024-05-21T14:43:59.813317+0000","last_peered":"2024-05-21T14:43:59.813317+0000","last_clean":"2024-05-21T14:43:59.813317+0000","last_became_active":"2024-05-21T14:43:08.079934+0000","last_became_peered":"2024-05-21T14:43:08.079934+0000","last_unstale":"2024-05-21T14:43:59.813317+0000","last_undegraded":"2024-05-21T14:43:59.813317+0000","last_fullsized":"2024-05-21T14:43:59.813317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_clean_scrub_stamp":"2024-05-21T14:43:07.046978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:54:57.347768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'6","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174205+0000","last_change":"2024-05-21T14:43:18.599850+0000","last_active":"2024-05-21T14:44:00.174205+0000","last_peered":"2024-05-21T14:44:00.174205+0000","last_clean":"2024-05-21T14:44:00.174205+0000","last_became_active":"2024-05-21T14:43:18.599347+0000","last_became_peered":"2024-05-21T14:43:18.599347+0000","last_unstale":"2024-05-21T14:44:00.174205+0000","last_undegraded":"2024-05-21T14:44:00.174205+0000","last_fullsized":"2024-05-21T14:44:00.174205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:01:06.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813371+0000","last_change":"2024-05-21T14:43:19.613056+0000","last_active":"2024-05-21T14:43:59.813371+0000","last_peered":"2024-05-21T14:43:59.813371+0000","last_clean":"2024-05-21T14:43:59.813371+0000","last_became_active":"2024-05-21T14:43:19.611889+0000","last_became_peered":"2024-05-21T14:43:19.611889+0000","last_unstale":"2024-05-21T14:43:59.813371+0000","last_undegraded":"2024-05-21T14:43:59.813371+0000","last_fullsized":"2024-05-21T14:43:59.813371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:46:20.105282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173579+0000","last_change":"2024-05-21T14:43:18.621482+0000","last_active":"2024-05-21T14:44:00.173579+0000","last_peered":"2024-05-21T14:44:00.173579+0000","last_clean":"2024-05-21T14:44:00.173579+0000","last_became_active":"2024-05-21T14:43:18.621229+0000","last_became_peered":"2024-05-21T14:43:18.621229+0000","last_unstale":"2024-05-21T14:44:00.173579+0000","last_undegraded":"2024-05-21T14:44:00.173579+0000","last_fullsized":"2024-05-21T14:44:00.173579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:30:04.326588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.199479+0000","last_change":"2024-05-21T14:43:19.625038+0000","last_active":"2024-05-21T14:44:00.199479+0000","last_peered":"2024-05-21T14:44:00.199479+0000","last_clean":"2024-05-21T14:44:00.199479+0000","last_became_active":"2024-05-21T14:43:19.624114+0000","last_became_peered":"2024-05-21T14:43:19.624114+0000","last_unstale":"2024-05-21T14:44:00.199479+0000","last_undegraded":"2024-05-21T14:44:00.199479+0000","last_fullsized":"2024-05-21T14:44:00.199479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:11.854243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'5","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813950+0000","last_change":"2024-05-21T14:43:18.618518+0000","last_active":"2024-05-21T14:43:59.813950+0000","last_peered":"2024-05-21T14:43:59.813950+0000","last_clean":"2024-05-21T14:43:59.813950+0000","last_became_active":"2024-05-21T14:43:18.617756+0000","last_became_peered":"2024-05-21T14:43:18.617756+0000","last_unstale":"2024-05-21T14:43:59.813950+0000","last_undegraded":"2024-05-21T14:43:59.813950+0000","last_fullsized":"2024-05-21T14:43:59.813950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:52:12.999877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172592+0000","last_change":"2024-05-21T14:43:19.613595+0000","last_active":"2024-05-21T14:44:00.172592+0000","last_peered":"2024-05-21T14:44:00.172592+0000","last_clean":"2024-05-21T14:44:00.172592+0000","last_became_active":"2024-05-21T14:43:19.612730+0000","last_became_peered":"2024-05-21T14:43:19.612730+0000","last_unstale":"2024-05-21T14:44:00.172592+0000","last_undegraded":"2024-05-21T14:44:00.172592+0000","last_fullsized":"2024-05-21T14:44:00.172592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:01:02.847071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'5","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173991+0000","last_change":"2024-05-21T14:43:18.608596+0000","last_active":"2024-05-21T14:44:00.173991+0000","last_peered":"2024-05-21T14:44:00.173991+0000","last_clean":"2024-05-21T14:44:00.173991+0000","last_became_active":"2024-05-21T14:43:18.608262+0000","last_became_peered":"2024-05-21T14:43:18.608262+0000","last_unstale":"2024-05-21T14:44:00.173991+0000","last_undegraded":"2024-05-21T14:44:00.173991+0000","last_fullsized":"2024-05-21T14:44:00.173991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:14.962554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173231+0000","last_change":"2024-05-21T14:43:19.607815+0000","last_active":"2024-05-21T14:44:00.173231+0000","last_peered":"2024-05-21T14:44:00.173231+0000","last_clean":"2024-05-21T14:44:00.173231+0000","last_became_active":"2024-05-21T14:43:19.607513+0000","last_became_peered":"2024-05-21T14:43:19.607513+0000","last_unstale":"2024-05-21T14:44:00.173231+0000","last_undegraded":"2024-05-21T14:44:00.173231+0000","last_fullsized":"2024-05-21T14:44:00.173231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:01:35.332981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172926+0000","last_change":"2024-05-21T14:43:18.603626+0000","last_active":"2024-05-21T14:44:00.172926+0000","last_peered":"2024-05-21T14:44:00.172926+0000","last_clean":"2024-05-21T14:44:00.172926+0000","last_became_active":"2024-05-21T14:43:18.602704+0000","last_became_peered":"2024-05-21T14:43:18.602704+0000","last_unstale":"2024-05-21T14:44:00.172926+0000","last_undegraded":"2024-05-21T14:44:00.172926+0000","last_fullsized":"2024-05-21T14:44:00.172926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:03.976820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.171881+0000","last_change":"2024-05-21T14:43:19.634449+0000","last_active":"2024-05-21T14:44:00.171881+0000","last_peered":"2024-05-21T14:44:00.171881+0000","last_clean":"2024-05-21T14:44:00.171881+0000","last_became_active":"2024-05-21T14:43:19.633751+0000","last_became_peered":"2024-05-21T14:43:19.633751+0000","last_unstale":"2024-05-21T14:44:00.171881+0000","last_undegraded":"2024-05-21T14:44:00.171881+0000","last_fullsized":"2024-05-21T14:44:00.171881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:04:51.415303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174026+0000","last_change":"2024-05-21T14:43:18.608335+0000","last_active":"2024-05-21T14:44:00.174026+0000","last_peered":"2024-05-21T14:44:00.174026+0000","last_clean":"2024-05-21T14:44:00.174026+0000","last_became_active":"2024-05-21T14:43:18.607999+0000","last_became_peered":"2024-05-21T14:43:18.607999+0000","last_unstale":"2024-05-21T14:44:00.174026+0000","last_undegraded":"2024-05-21T14:44:00.174026+0000","last_fullsized":"2024-05-21T14:44:00.174026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:21.325953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.199821+0000","last_change":"2024-05-21T14:43:19.626742+0000","last_active":"2024-05-21T14:44:00.199821+0000","last_peered":"2024-05-21T14:44:00.199821+0000","last_clean":"2024-05-21T14:44:00.199821+0000","last_became_active":"2024-05-21T14:43:19.626024+0000","last_became_peered":"2024-05-21T14:43:19.626024+0000","last_unstale":"2024-05-21T14:44:00.199821+0000","last_undegraded":"2024-05-21T14:44:00.199821+0000","last_fullsized":"2024-05-21T14:44:00.199821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:48:15.426224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'10","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:43.667167+0000","last_change":"2024-05-21T14:43:18.616913+0000","last_active":"2024-05-21T14:44:43.667167+0000","last_peered":"2024-05-21T14:44:43.667167+0000","last_clean":"2024-05-21T14:44:43.667167+0000","last_became_active":"2024-05-21T14:43:18.616214+0000","last_became_peered":"2024-05-21T14:43:18.616214+0000","last_unstale":"2024-05-21T14:44:43.667167+0000","last_undegraded":"2024-05-21T14:44:43.667167+0000","last_fullsized":"2024-05-21T14:44:43.667167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:22.112018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815085+0000","last_change":"2024-05-21T14:43:19.607521+0000","last_active":"2024-05-21T14:43:59.815085+0000","last_peered":"2024-05-21T14:43:59.815085+0000","last_clean":"2024-05-21T14:43:59.815085+0000","last_became_active":"2024-05-21T14:43:19.606673+0000","last_became_peered":"2024-05-21T14:43:19.606673+0000","last_unstale":"2024-05-21T14:43:59.815085+0000","last_undegraded":"2024-05-21T14:43:59.815085+0000","last_fullsized":"2024-05-21T14:43:59.815085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:50:50.373410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'7","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174519+0000","last_change":"2024-05-21T14:43:18.615846+0000","last_active":"2024-05-21T14:44:00.174519+0000","last_peered":"2024-05-21T14:44:00.174519+0000","last_clean":"2024-05-21T14:44:00.174519+0000","last_became_active":"2024-05-21T14:43:18.615506+0000","last_became_peered":"2024-05-21T14:43:18.615506+0000","last_unstale":"2024-05-21T14:44:00.174519+0000","last_undegraded":"2024-05-21T14:44:00.174519+0000","last_fullsized":"2024-05-21T14:44:00.174519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:07:17.030757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815066+0000","last_change":"2024-05-21T14:43:19.611473+0000","last_active":"2024-05-21T14:43:59.815066+0000","last_peered":"2024-05-21T14:43:59.815066+0000","last_clean":"2024-05-21T14:43:59.815066+0000","last_became_active":"2024-05-21T14:43:19.610600+0000","last_became_peered":"2024-05-21T14:43:19.610600+0000","last_unstale":"2024-05-21T14:43:59.815066+0000","last_undegraded":"2024-05-21T14:43:59.815066+0000","last_fullsized":"2024-05-21T14:43:59.815066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:48:07.659795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172286+0000","last_change":"2024-05-21T14:43:18.604951+0000","last_active":"2024-05-21T14:44:00.172286+0000","last_peered":"2024-05-21T14:44:00.172286+0000","last_clean":"2024-05-21T14:44:00.172286+0000","last_became_active":"2024-05-21T14:43:18.602186+0000","last_became_peered":"2024-05-21T14:43:18.602186+0000","last_unstale":"2024-05-21T14:44:00.172286+0000","last_undegraded":"2024-05-21T14:44:00.172286+0000","last_fullsized":"2024-05-21T14:44:00.172286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:34:10.395484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173521+0000","last_change":"2024-05-21T14:43:19.600827+0000","last_active":"2024-05-21T14:44:00.173521+0000","last_peered":"2024-05-21T14:44:00.173521+0000","last_clean":"2024-05-21T14:44:00.173521+0000","last_became_active":"2024-05-21T14:43:19.600499+0000","last_became_peered":"2024-05-21T14:43:19.600499+0000","last_unstale":"2024-05-21T14:44:00.173521+0000","last_undegraded":"2024-05-21T14:44:00.173521+0000","last_fullsized":"2024-05-21T14:44:00.173521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:55:36.231321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'7","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813798+0000","last_change":"2024-05-21T14:43:18.615190+0000","last_active":"2024-05-21T14:43:59.813798+0000","last_peered":"2024-05-21T14:43:59.813798+0000","last_clean":"2024-05-21T14:43:59.813798+0000","last_became_active":"2024-05-21T14:43:18.614306+0000","last_became_peered":"2024-05-21T14:43:18.614306+0000","last_unstale":"2024-05-21T14:43:59.813798+0000","last_undegraded":"2024-05-21T14:43:59.813798+0000","last_fullsized":"2024-05-21T14:43:59.813798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:53.472559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813081+0000","last_change":"2024-05-21T14:43:19.610903+0000","last_active":"2024-05-21T14:43:59.813081+0000","last_peered":"2024-05-21T14:43:59.813081+0000","last_clean":"2024-05-21T14:43:59.813081+0000","last_became_active":"2024-05-21T14:43:19.610101+0000","last_became_peered":"2024-05-21T14:43:19.610101+0000","last_unstale":"2024-05-21T14:43:59.813081+0000","last_undegraded":"2024-05-21T14:43:59.813081+0000","last_fullsized":"2024-05-21T14:43:59.813081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:16:24.580581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'3","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.200092+0000","last_change":"2024-05-21T14:43:18.617785+0000","last_active":"2024-05-21T14:44:00.200092+0000","last_peered":"2024-05-21T14:44:00.200092+0000","last_clean":"2024-05-21T14:44:00.200092+0000","last_became_active":"2024-05-21T14:43:18.617041+0000","last_became_peered":"2024-05-21T14:43:18.617041+0000","last_unstale":"2024-05-21T14:44:00.200092+0000","last_undegraded":"2024-05-21T14:44:00.200092+0000","last_fullsized":"2024-05-21T14:44:00.200092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:02:50.837158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.814404+0000","last_change":"2024-05-21T14:43:19.627096+0000","last_active":"2024-05-21T14:43:59.814404+0000","last_peered":"2024-05-21T14:43:59.814404+0000","last_clean":"2024-05-21T14:43:59.814404+0000","last_became_active":"2024-05-21T14:43:19.626265+0000","last_became_peered":"2024-05-21T14:43:19.626265+0000","last_unstale":"2024-05-21T14:43:59.814404+0000","last_undegraded":"2024-05-21T14:43:59.814404+0000","last_fullsized":"2024-05-21T14:43:59.814404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:23:47.818120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'4","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174065+0000","last_change":"2024-05-21T14:43:18.599635+0000","last_active":"2024-05-21T14:44:00.174065+0000","last_peered":"2024-05-21T14:44:00.174065+0000","last_clean":"2024-05-21T14:44:00.174065+0000","last_became_active":"2024-05-21T14:43:18.598996+0000","last_became_peered":"2024-05-21T14:43:18.598996+0000","last_unstale":"2024-05-21T14:44:00.174065+0000","last_undegraded":"2024-05-21T14:44:00.174065+0000","last_fullsized":"2024-05-21T14:44:00.174065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:17:09.383291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173812+0000","last_change":"2024-05-21T14:43:19.617686+0000","last_active":"2024-05-21T14:44:00.173812+0000","last_peered":"2024-05-21T14:44:00.173812+0000","last_clean":"2024-05-21T14:44:00.173812+0000","last_became_active":"2024-05-21T14:43:19.617398+0000","last_became_peered":"2024-05-21T14:43:19.617398+0000","last_unstale":"2024-05-21T14:44:00.173812+0000","last_undegraded":"2024-05-21T14:44:00.173812+0000","last_fullsized":"2024-05-21T14:44:00.173812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:21:06.527871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173659+0000","last_change":"2024-05-21T14:43:19.601673+0000","last_active":"2024-05-21T14:44:00.173659+0000","last_peered":"2024-05-21T14:44:00.173659+0000","last_clean":"2024-05-21T14:44:00.173659+0000","last_became_active":"2024-05-21T14:43:19.601286+0000","last_became_peered":"2024-05-21T14:43:19.601286+0000","last_unstale":"2024-05-21T14:44:00.173659+0000","last_undegraded":"2024-05-21T14:44:00.173659+0000","last_fullsized":"2024-05-21T14:44:00.173659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:21:22.955055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173839+0000","last_change":"2024-05-21T14:43:18.613555+0000","last_active":"2024-05-21T14:44:00.173839+0000","last_peered":"2024-05-21T14:44:00.173839+0000","last_clean":"2024-05-21T14:44:00.173839+0000","last_became_active":"2024-05-21T14:43:18.613117+0000","last_became_peered":"2024-05-21T14:43:18.613117+0000","last_unstale":"2024-05-21T14:44:00.173839+0000","last_undegraded":"2024-05-21T14:44:00.173839+0000","last_fullsized":"2024-05-21T14:44:00.173839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:38.151165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813689+0000","last_change":"2024-05-21T14:43:19.596736+0000","last_active":"2024-05-21T14:43:59.813689+0000","last_peered":"2024-05-21T14:43:59.813689+0000","last_clean":"2024-05-21T14:43:59.813689+0000","last_became_active":"2024-05-21T14:43:19.596157+0000","last_became_peered":"2024-05-21T14:43:19.596157+0000","last_unstale":"2024-05-21T14:43:59.813689+0000","last_undegraded":"2024-05-21T14:43:59.813689+0000","last_fullsized":"2024-05-21T14:43:59.813689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:22:14.002930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'12","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174699+0000","last_change":"2024-05-21T14:43:18.614044+0000","last_active":"2024-05-21T14:44:00.174699+0000","last_peered":"2024-05-21T14:44:00.174699+0000","last_clean":"2024-05-21T14:44:00.174699+0000","last_became_active":"2024-05-21T14:43:18.613730+0000","last_became_peered":"2024-05-21T14:43:18.613730+0000","last_unstale":"2024-05-21T14:44:00.174699+0000","last_undegraded":"2024-05-21T14:44:00.174699+0000","last_fullsized":"2024-05-21T14:44:00.174699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:41:34.787779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173341+0000","last_change":"2024-05-21T14:43:19.621999+0000","last_active":"2024-05-21T14:44:00.173341+0000","last_peered":"2024-05-21T14:44:00.173341+0000","last_clean":"2024-05-21T14:44:00.173341+0000","last_became_active":"2024-05-21T14:43:19.614744+0000","last_became_peered":"2024-05-21T14:43:19.614744+0000","last_unstale":"2024-05-21T14:44:00.173341+0000","last_undegraded":"2024-05-21T14:44:00.173341+0000","last_fullsized":"2024-05-21T14:44:00.173341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:32:37.316833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173242+0000","last_change":"2024-05-21T14:43:18.614193+0000","last_active":"2024-05-21T14:44:00.173242+0000","last_peered":"2024-05-21T14:44:00.173242+0000","last_clean":"2024-05-21T14:44:00.173242+0000","last_became_active":"2024-05-21T14:43:18.609797+0000","last_became_peered":"2024-05-21T14:43:18.609797+0000","last_unstale":"2024-05-21T14:44:00.173242+0000","last_undegraded":"2024-05-21T14:44:00.173242+0000","last_fullsized":"2024-05-21T14:44:00.173242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:39:55.623816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173163+0000","last_change":"2024-05-21T14:43:19.610578+0000","last_active":"2024-05-21T14:44:00.173163+0000","last_peered":"2024-05-21T14:44:00.173163+0000","last_clean":"2024-05-21T14:44:00.173163+0000","last_became_active":"2024-05-21T14:43:19.606575+0000","last_became_peered":"2024-05-21T14:43:19.606575+0000","last_unstale":"2024-05-21T14:44:00.173163+0000","last_undegraded":"2024-05-21T14:44:00.173163+0000","last_fullsized":"2024-05-21T14:44:00.173163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:50:06.088520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'13","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815910+0000","last_change":"2024-05-21T14:43:18.601862+0000","last_active":"2024-05-21T14:43:59.815910+0000","last_peered":"2024-05-21T14:43:59.815910+0000","last_clean":"2024-05-21T14:43:59.815910+0000","last_became_active":"2024-05-21T14:43:18.601311+0000","last_became_peered":"2024-05-21T14:43:18.601311+0000","last_unstale":"2024-05-21T14:43:59.815910+0000","last_undegraded":"2024-05-21T14:43:59.815910+0000","last_fullsized":"2024-05-21T14:43:59.815910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:02.736061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":21987,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":43974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":95528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":684342,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509471,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":101528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":95870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":108781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509471,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":684930,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509472,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":95690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":94206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":15633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":17403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T14:45:36.585 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-21T14:45:36.585 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T14:45:36.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.763+0000 7f77ca800640 1 Processor -- start 2024-05-21T14:45:36.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.763+0000 7f77ca800640 1 -- start start 2024-05-21T14:45:36.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.763+0000 7f77ca800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f77c41529d0 0x7f77c4072e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:36.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.763+0000 7f77ca800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f77c4071fe0 0x7f77c40723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:36.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.763+0000 7f77ca800640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f77c40c5640 0x7f77c40c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:36.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.763+0000 7f77ca800640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f77c4073380 con 0x7f77c40c5640 2024-05-21T14:45:36.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.763+0000 7f77ca800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f77c40715f0 con 0x7f77c4071fe0 2024-05-21T14:45:36.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.763+0000 7f77ca800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f77c4072b80 con 0x7f77c41529d0 2024-05-21T14:45:36.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.767+0000 7f77c3e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f77c40c5640 0x7f77c40c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:36.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.767+0000 7f77c3e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f77c40c5640 0x7f77c40c5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49686/0 (socket says 172.21.15.78:49686) 2024-05-21T14:45:36.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.767+0000 7f77c3e00640 1 -- 172.21.15.78:0/3239702668 learned_addr learned my addr 172.21.15.78:0/3239702668 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:36.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.767+0000 7f77c3400640 1 --2- 172.21.15.78:0/3239702668 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f77c41529d0 0x7f77c4072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.767+0000 7f77baa00640 1 --2- 172.21.15.78:0/3239702668 >> v2:172.21.15.84:3300/0 conn(0x7f77c4071fe0 0x7f77c40723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.767+0000 7f77c3e00640 1 -- 172.21.15.78:0/3239702668 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f77c41529d0 msgr2=0x7f77c4072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.767+0000 7f77c3e00640 1 --2- 172.21.15.78:0/3239702668 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f77c41529d0 0x7f77c4072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.767+0000 7f77c3e00640 1 -- 172.21.15.78:0/3239702668 >> v2:172.21.15.84:3300/0 conn(0x7f77c4071fe0 msgr2=0x7f77c40723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.767+0000 7f77c3e00640 1 --2- 172.21.15.78:0/3239702668 >> v2:172.21.15.84:3300/0 conn(0x7f77c4071fe0 0x7f77c40723f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.767+0000 7f77c3e00640 1 -- 172.21.15.78:0/3239702668 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c40c8530 con 0x7f77c40c5640 2024-05-21T14:45:36.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.767+0000 7f77c3e00640 1 --2- 172.21.15.78:0/3239702668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77c40c5640 0x7f77c40c5a50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f77c4070e30 tx=0x7f77bc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1570ece67bdec5c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:36.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.767+0000 7f77c2a00640 1 -- 172.21.15.78:0/3239702668 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc0a5670 con 0x7f77c40c5640 2024-05-21T14:45:36.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.767+0000 7f77c2a00640 1 -- 172.21.15.78:0/3239702668 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77bc0a5810 con 0x7f77c40c5640 2024-05-21T14:45:36.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.767+0000 7f77c2a00640 1 -- 172.21.15.78:0/3239702668 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc0a5be0 con 0x7f77c40c5640 2024-05-21T14:45:36.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.771+0000 7f77ca800640 1 -- 172.21.15.78:0/3239702668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77c40c5640 msgr2=0x7f77c40c5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:36.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.771+0000 7f77ca800640 1 --2- 172.21.15.78:0/3239702668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77c40c5640 0x7f77c40c5a50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f77c4070e30 tx=0x7f77bc01c9f0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.771+0000 7f77ca800640 1 -- 172.21.15.78:0/3239702668 shutdown_connections 2024-05-21T14:45:36.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.771+0000 7f77ca800640 1 --2- 172.21.15.78:0/3239702668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77c40c5640 0x7f77c40c5a50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.771+0000 7f77ca800640 1 --2- 172.21.15.78:0/3239702668 >> v2:172.21.15.84:3300/0 conn(0x7f77c4071fe0 0x7f77c40723f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.771+0000 7f77ca800640 1 --2- 172.21.15.78:0/3239702668 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f77c41529d0 0x7f77c4072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.771+0000 7f77ca800640 1 -- 172.21.15.78:0/3239702668 >> 172.21.15.78:0/3239702668 conn(0x7f77c40c9380 msgr2=0x7f77c40c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:36.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.771+0000 7f77ca800640 1 -- 172.21.15.78:0/3239702668 shutdown_connections 2024-05-21T14:45:36.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.771+0000 7f77ca800640 1 -- 172.21.15.78:0/3239702668 wait complete. 2024-05-21T14:45:36.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.771+0000 7f77ca800640 1 Processor -- start 2024-05-21T14:45:36.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.771+0000 7f77ca800640 1 -- start start 2024-05-21T14:45:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77ca800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77c4071fe0 0x7f77c41f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77ca800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f77c40c5640 0x7f77c4150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77ca800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77c41529d0 0x7f77c414e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77ca800640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f77c406be30 con 0x7f77c4071fe0 2024-05-21T14:45:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77ca800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f77c40c3ab0 con 0x7f77c41529d0 2024-05-21T14:45:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77ca800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f77c406bfb0 con 0x7f77c40c5640 2024-05-21T14:45:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77c3400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77c4071fe0 0x7f77c41f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77c3400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77c4071fe0 0x7f77c41f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49690/0 (socket says 172.21.15.78:49690) 2024-05-21T14:45:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77c3400640 1 -- 172.21.15.78:0/435906755 learned_addr learned my addr 172.21.15.78:0/435906755 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77c3e00640 1 --2- 172.21.15.78:0/435906755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77c41529d0 0x7f77c414e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77baa00640 1 --2- 172.21.15.78:0/435906755 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f77c40c5640 0x7f77c4150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77c3400640 1 -- 172.21.15.78:0/435906755 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f77c40c5640 msgr2=0x7f77c4150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77c3400640 1 --2- 172.21.15.78:0/435906755 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f77c40c5640 0x7f77c4150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77c3400640 1 -- 172.21.15.78:0/435906755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77c41529d0 msgr2=0x7f77c414e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77c3400640 1 --2- 172.21.15.78:0/435906755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77c41529d0 0x7f77c414e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77c3400640 1 -- 172.21.15.78:0/435906755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c4150c70 con 0x7f77c4071fe0 2024-05-21T14:45:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77c3400640 1 --2- 172.21.15.78:0/435906755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77c4071fe0 0x7f77c41f4eb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f77b400d620 tx=0x7f77b400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77bbe00640 1 -- 172.21.15.78:0/435906755 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b40125f0 con 0x7f77c4071fe0 2024-05-21T14:45:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77bbe00640 1 -- 172.21.15.78:0/435906755 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b4019070 con 0x7f77c4071fe0 2024-05-21T14:45:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77bbe00640 1 -- 172.21.15.78:0/435906755 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b40129b0 con 0x7f77c4071fe0 2024-05-21T14:45:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77ca800640 1 -- 172.21.15.78:0/435906755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c41f57b0 con 0x7f77c4071fe0 2024-05-21T14:45:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77ca800640 1 -- 172.21.15.78:0/435906755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c414ff30 con 0x7f77c4071fe0 2024-05-21T14:45:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77ca800640 1 -- 172.21.15.78:0/435906755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77c404f730 con 0x7f77c4071fe0 2024-05-21T14:45:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.775+0000 7f77bbe00640 1 -- 172.21.15.78:0/435906755 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77b4012b50 con 0x7f77c4071fe0 2024-05-21T14:45:36.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.779+0000 7f77bbe00640 1 --2- 172.21.15.78:0/435906755 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f77a00678c0 0x7f77a0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:36.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.779+0000 7f77bbe00640 1 -- 172.21.15.78:0/435906755 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f77b40860a0 con 0x7f77c4071fe0 2024-05-21T14:45:36.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.779+0000 7f77baa00640 1 --2- 172.21.15.78:0/435906755 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f77a00678c0 0x7f77a0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:36.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.779+0000 7f77baa00640 1 --2- 172.21.15.78:0/435906755 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f77a00678c0 0x7f77a0069dd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f77c4147230 tx=0x7f77ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:36.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.783+0000 7f77bbe00640 1 -- 172.21.15.78:0/435906755 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f77b4056ba0 con 0x7f77c4071fe0 2024-05-21T14:45:36.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.935+0000 7f77ca800640 1 -- 172.21.15.78:0/435906755 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f77c4146d10 con 0x7f77a00678c0 2024-05-21T14:45:36.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.955+0000 7f77bbe00640 1 -- 172.21.15.78:0/435906755 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252280 (secure 0 0 0) 0x7f77c4146d10 con 0x7f77a00678c0 2024-05-21T14:45:36.965 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:45:36.966 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-05-21T14:45:36.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.955+0000 7f77ca800640 1 -- 172.21.15.78:0/435906755 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f77a00678c0 msgr2=0x7f77a0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:36.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.955+0000 7f77ca800640 1 --2- 172.21.15.78:0/435906755 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f77a00678c0 0x7f77a0069dd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f77c4147230 tx=0x7f77ac008040 comp rx=0 tx=0).stop 2024-05-21T14:45:36.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.955+0000 7f77ca800640 1 -- 172.21.15.78:0/435906755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77c4071fe0 msgr2=0x7f77c41f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:36.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.955+0000 7f77ca800640 1 --2- 172.21.15.78:0/435906755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77c4071fe0 0x7f77c41f4eb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f77b400d620 tx=0x7f77b400dae0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.955+0000 7f77ca800640 1 -- 172.21.15.78:0/435906755 shutdown_connections 2024-05-21T14:45:36.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.955+0000 7f77ca800640 1 --2- 172.21.15.78:0/435906755 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f77a00678c0 0x7f77a0069dd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.955+0000 7f77ca800640 1 --2- 172.21.15.78:0/435906755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77c41529d0 0x7f77c414e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.955+0000 7f77ca800640 1 --2- 172.21.15.78:0/435906755 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f77c40c5640 0x7f77c4150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.955+0000 7f77ca800640 1 --2- 172.21.15.78:0/435906755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77c4071fe0 0x7f77c41f4eb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:36.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.955+0000 7f77ca800640 1 -- 172.21.15.78:0/435906755 >> 172.21.15.78:0/435906755 conn(0x7f77c40c9380 msgr2=0x7f77c4149380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:36.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.955+0000 7f77ca800640 1 -- 172.21.15.78:0/435906755 shutdown_connections 2024-05-21T14:45:36.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:36.955+0000 7f77ca800640 1 -- 172.21.15.78:0/435906755 wait complete. 2024-05-21T14:45:36.986 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-05-21T14:45:36.552105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":628240,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":397,"num_write_kb":2522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":788,"ondisk_log_size":788,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218592,"kb_used_data":2464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756128,"statfs":{"total":773094113280,"available":772870275072,"internally_reserved":0,"allocated":2523136,"data_stored":2001971,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,3,1,3,7,66],"upper_bound":128},"perf_stat":{"commit_latency_ms":66,"apply_latency_ms":66,"commit_latency_ns":66000000,"apply_latency_ns":66000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24908,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.014765"},"pg_stats":[{"pgid":"3.3f","version":"25'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.490929+0000","last_change":"2024-05-21T14:43:19.606707+0000","last_active":"2024-05-21T14:45:35.490929+0000","last_peered":"2024-05-21T14:45:35.490929+0000","last_clean":"2024-05-21T14:45:35.490929+0000","last_became_active":"2024-05-21T14:43:19.606365+0000","last_became_peered":"2024-05-21T14:43:19.606365+0000","last_unstale":"2024-05-21T14:45:35.490929+0000","last_undegraded":"2024-05-21T14:45:35.490929+0000","last_fullsized":"2024-05-21T14:45:35.490929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:26.135357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.509442+0000","last_change":"2024-05-21T14:43:19.632879+0000","last_active":"2024-05-21T14:45:35.509442+0000","last_peered":"2024-05-21T14:45:35.509442+0000","last_clean":"2024-05-21T14:45:35.509442+0000","last_became_active":"2024-05-21T14:43:19.632218+0000","last_became_peered":"2024-05-21T14:43:19.632218+0000","last_unstale":"2024-05-21T14:45:35.509442+0000","last_undegraded":"2024-05-21T14:45:35.509442+0000","last_fullsized":"2024-05-21T14:45:35.509442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:35:49.461861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'7","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.507761+0000","last_change":"2024-05-21T14:43:19.620214+0000","last_active":"2024-05-21T14:45:35.507761+0000","last_peered":"2024-05-21T14:45:35.507761+0000","last_clean":"2024-05-21T14:45:35.507761+0000","last_became_active":"2024-05-21T14:43:19.619012+0000","last_became_peered":"2024-05-21T14:43:19.619012+0000","last_unstale":"2024-05-21T14:45:35.507761+0000","last_undegraded":"2024-05-21T14:45:35.507761+0000","last_fullsized":"2024-05-21T14:45:35.507761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:40:22.415178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.490571+0000","last_change":"2024-05-21T14:43:19.602199+0000","last_active":"2024-05-21T14:45:35.490571+0000","last_peered":"2024-05-21T14:45:35.490571+0000","last_clean":"2024-05-21T14:45:35.490571+0000","last_became_active":"2024-05-21T14:43:19.601797+0000","last_became_peered":"2024-05-21T14:43:19.601797+0000","last_unstale":"2024-05-21T14:45:35.490571+0000","last_undegraded":"2024-05-21T14:45:35.490571+0000","last_fullsized":"2024-05-21T14:45:35.490571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:33:00.071681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.481775+0000","last_change":"2024-05-21T14:43:19.623449+0000","last_active":"2024-05-21T14:45:35.481775+0000","last_peered":"2024-05-21T14:45:35.481775+0000","last_clean":"2024-05-21T14:45:35.481775+0000","last_became_active":"2024-05-21T14:43:19.623125+0000","last_became_peered":"2024-05-21T14:43:19.623125+0000","last_unstale":"2024-05-21T14:45:35.481775+0000","last_undegraded":"2024-05-21T14:45:35.481775+0000","last_fullsized":"2024-05-21T14:45:35.481775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:42.178156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'6","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.510915+0000","last_change":"2024-05-21T14:43:19.591222+0000","last_active":"2024-05-21T14:45:35.510915+0000","last_peered":"2024-05-21T14:45:35.510915+0000","last_clean":"2024-05-21T14:45:35.510915+0000","last_became_active":"2024-05-21T14:43:19.590858+0000","last_became_peered":"2024-05-21T14:43:19.590858+0000","last_unstale":"2024-05-21T14:45:35.510915+0000","last_undegraded":"2024-05-21T14:45:35.510915+0000","last_fullsized":"2024-05-21T14:45:35.510915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:21:15.737192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'5","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.497469+0000","last_change":"2024-05-21T14:43:19.614716+0000","last_active":"2024-05-21T14:45:35.497469+0000","last_peered":"2024-05-21T14:45:35.497469+0000","last_clean":"2024-05-21T14:45:35.497469+0000","last_became_active":"2024-05-21T14:43:19.614451+0000","last_became_peered":"2024-05-21T14:43:19.614451+0000","last_unstale":"2024-05-21T14:45:35.497469+0000","last_undegraded":"2024-05-21T14:45:35.497469+0000","last_fullsized":"2024-05-21T14:45:35.497469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:07:01.524574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'9","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.510886+0000","last_change":"2024-05-21T14:43:19.604029+0000","last_active":"2024-05-21T14:45:35.510886+0000","last_peered":"2024-05-21T14:45:35.510886+0000","last_clean":"2024-05-21T14:45:35.510886+0000","last_became_active":"2024-05-21T14:43:19.603164+0000","last_became_peered":"2024-05-21T14:43:19.603164+0000","last_unstale":"2024-05-21T14:45:35.510886+0000","last_undegraded":"2024-05-21T14:45:35.510886+0000","last_fullsized":"2024-05-21T14:45:35.510886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:14:27.286952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'11","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.488081+0000","last_change":"2024-05-21T14:43:19.613765+0000","last_active":"2024-05-21T14:45:35.488081+0000","last_peered":"2024-05-21T14:45:35.488081+0000","last_clean":"2024-05-21T14:45:35.488081+0000","last_became_active":"2024-05-21T14:43:19.613429+0000","last_became_peered":"2024-05-21T14:43:19.613429+0000","last_unstale":"2024-05-21T14:45:35.488081+0000","last_undegraded":"2024-05-21T14:45:35.488081+0000","last_fullsized":"2024-05-21T14:45:35.488081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:29:16.905434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'16","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.478200+0000","last_change":"2024-05-21T14:43:19.607400+0000","last_active":"2024-05-21T14:45:35.478200+0000","last_peered":"2024-05-21T14:45:35.478200+0000","last_clean":"2024-05-21T14:45:35.478200+0000","last_became_active":"2024-05-21T14:43:19.607105+0000","last_became_peered":"2024-05-21T14:43:19.607105+0000","last_unstale":"2024-05-21T14:45:35.478200+0000","last_undegraded":"2024-05-21T14:45:35.478200+0000","last_fullsized":"2024-05-21T14:45:35.478200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:26:22.366105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'6","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.490926+0000","last_change":"2024-05-21T14:43:19.606534+0000","last_active":"2024-05-21T14:45:35.490926+0000","last_peered":"2024-05-21T14:45:35.490926+0000","last_clean":"2024-05-21T14:45:35.490926+0000","last_became_active":"2024-05-21T14:43:19.606029+0000","last_became_peered":"2024-05-21T14:43:19.606029+0000","last_unstale":"2024-05-21T14:45:35.490926+0000","last_undegraded":"2024-05-21T14:45:35.490926+0000","last_fullsized":"2024-05-21T14:45:35.490926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:33:48.849701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'7","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.476100+0000","last_change":"2024-05-21T14:43:19.609910+0000","last_active":"2024-05-21T14:45:35.476100+0000","last_peered":"2024-05-21T14:45:35.476100+0000","last_clean":"2024-05-21T14:45:35.476100+0000","last_became_active":"2024-05-21T14:43:19.609616+0000","last_became_peered":"2024-05-21T14:43:19.609616+0000","last_unstale":"2024-05-21T14:45:35.476100+0000","last_undegraded":"2024-05-21T14:45:35.476100+0000","last_fullsized":"2024-05-21T14:45:35.476100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:36:16.637620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.478747+0000","last_change":"2024-05-21T14:43:19.604001+0000","last_active":"2024-05-21T14:45:35.478747+0000","last_peered":"2024-05-21T14:45:35.478747+0000","last_clean":"2024-05-21T14:45:35.478747+0000","last_became_active":"2024-05-21T14:43:19.596859+0000","last_became_peered":"2024-05-21T14:43:19.596859+0000","last_unstale":"2024-05-21T14:45:35.478747+0000","last_undegraded":"2024-05-21T14:45:35.478747+0000","last_fullsized":"2024-05-21T14:45:35.478747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:45:43.431420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.509681+0000","last_change":"2024-05-21T14:43:19.626837+0000","last_active":"2024-05-21T14:45:35.509681+0000","last_peered":"2024-05-21T14:45:35.509681+0000","last_clean":"2024-05-21T14:45:35.509681+0000","last_became_active":"2024-05-21T14:43:19.626213+0000","last_became_peered":"2024-05-21T14:43:19.626213+0000","last_unstale":"2024-05-21T14:45:35.509681+0000","last_undegraded":"2024-05-21T14:45:35.509681+0000","last_fullsized":"2024-05-21T14:45:35.509681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:51.705474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'7","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.504808+0000","last_change":"2024-05-21T14:43:19.613483+0000","last_active":"2024-05-21T14:45:35.504808+0000","last_peered":"2024-05-21T14:45:35.504808+0000","last_clean":"2024-05-21T14:45:35.504808+0000","last_became_active":"2024-05-21T14:43:19.612581+0000","last_became_peered":"2024-05-21T14:43:19.612581+0000","last_unstale":"2024-05-21T14:45:35.504808+0000","last_undegraded":"2024-05-21T14:45:35.504808+0000","last_fullsized":"2024-05-21T14:45:35.504808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:41:15.797196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'9","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.486604+0000","last_change":"2024-05-21T14:43:19.609126+0000","last_active":"2024-05-21T14:45:35.486604+0000","last_peered":"2024-05-21T14:45:35.486604+0000","last_clean":"2024-05-21T14:45:35.486604+0000","last_became_active":"2024-05-21T14:43:19.607967+0000","last_became_peered":"2024-05-21T14:43:19.607967+0000","last_unstale":"2024-05-21T14:45:35.486604+0000","last_undegraded":"2024-05-21T14:45:35.486604+0000","last_fullsized":"2024-05-21T14:45:35.486604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:35.881039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.491018+0000","last_change":"2024-05-21T14:43:19.613487+0000","last_active":"2024-05-21T14:45:35.491018+0000","last_peered":"2024-05-21T14:45:35.491018+0000","last_clean":"2024-05-21T14:45:35.491018+0000","last_became_active":"2024-05-21T14:43:19.611280+0000","last_became_peered":"2024-05-21T14:43:19.611280+0000","last_unstale":"2024-05-21T14:45:35.491018+0000","last_undegraded":"2024-05-21T14:45:35.491018+0000","last_fullsized":"2024-05-21T14:45:35.491018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:51:21.887715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815794+0000","last_change":"2024-05-21T14:43:19.607601+0000","last_active":"2024-05-21T14:43:59.815794+0000","last_peered":"2024-05-21T14:43:59.815794+0000","last_clean":"2024-05-21T14:43:59.815794+0000","last_became_active":"2024-05-21T14:43:19.606719+0000","last_became_peered":"2024-05-21T14:43:19.606719+0000","last_unstale":"2024-05-21T14:43:59.815794+0000","last_undegraded":"2024-05-21T14:43:59.815794+0000","last_fullsized":"2024-05-21T14:43:59.815794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:04:32.310805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'7","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.510515+0000","last_change":"2024-05-21T14:43:19.618470+0000","last_active":"2024-05-21T14:45:35.510515+0000","last_peered":"2024-05-21T14:45:35.510515+0000","last_clean":"2024-05-21T14:45:35.510515+0000","last_became_active":"2024-05-21T14:43:19.617408+0000","last_became_peered":"2024-05-21T14:43:19.617408+0000","last_unstale":"2024-05-21T14:45:35.510515+0000","last_undegraded":"2024-05-21T14:45:35.510515+0000","last_fullsized":"2024-05-21T14:45:35.510515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:53:58.877306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.476828+0000","last_change":"2024-05-21T14:43:19.609835+0000","last_active":"2024-05-21T14:45:35.476828+0000","last_peered":"2024-05-21T14:45:35.476828+0000","last_clean":"2024-05-21T14:45:35.476828+0000","last_became_active":"2024-05-21T14:43:19.609525+0000","last_became_peered":"2024-05-21T14:43:19.609525+0000","last_unstale":"2024-05-21T14:45:35.476828+0000","last_undegraded":"2024-05-21T14:45:35.476828+0000","last_fullsized":"2024-05-21T14:45:35.476828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:57:04.748898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'11","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.513530+0000","last_change":"2024-05-21T14:43:19.607732+0000","last_active":"2024-05-21T14:45:35.513530+0000","last_peered":"2024-05-21T14:45:35.513530+0000","last_clean":"2024-05-21T14:45:35.513530+0000","last_became_active":"2024-05-21T14:43:19.606839+0000","last_became_peered":"2024-05-21T14:43:19.606839+0000","last_unstale":"2024-05-21T14:45:35.513530+0000","last_undegraded":"2024-05-21T14:45:35.513530+0000","last_fullsized":"2024-05-21T14:45:35.513530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:43:15.675663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'10","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.474743+0000","last_change":"2024-05-21T14:43:19.601108+0000","last_active":"2024-05-21T14:45:35.474743+0000","last_peered":"2024-05-21T14:45:35.474743+0000","last_clean":"2024-05-21T14:45:35.474743+0000","last_became_active":"2024-05-21T14:43:19.600780+0000","last_became_peered":"2024-05-21T14:43:19.600780+0000","last_unstale":"2024-05-21T14:45:35.474743+0000","last_undegraded":"2024-05-21T14:45:35.474743+0000","last_fullsized":"2024-05-21T14:45:35.474743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:47:19.062733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.507394+0000","last_change":"2024-05-21T14:43:19.620463+0000","last_active":"2024-05-21T14:45:35.507394+0000","last_peered":"2024-05-21T14:45:35.507394+0000","last_clean":"2024-05-21T14:45:35.507394+0000","last_became_active":"2024-05-21T14:43:19.614489+0000","last_became_peered":"2024-05-21T14:43:19.614489+0000","last_unstale":"2024-05-21T14:45:35.507394+0000","last_undegraded":"2024-05-21T14:45:35.507394+0000","last_fullsized":"2024-05-21T14:45:35.507394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:51:07.953352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'6","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.509195+0000","last_change":"2024-05-21T14:43:19.624683+0000","last_active":"2024-05-21T14:45:35.509195+0000","last_peered":"2024-05-21T14:45:35.509195+0000","last_clean":"2024-05-21T14:45:35.509195+0000","last_became_active":"2024-05-21T14:43:19.624304+0000","last_became_peered":"2024-05-21T14:43:19.624304+0000","last_unstale":"2024-05-21T14:45:35.509195+0000","last_undegraded":"2024-05-21T14:45:35.509195+0000","last_fullsized":"2024-05-21T14:45:35.509195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:53.874968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.509078+0000","last_change":"2024-05-21T14:43:19.621030+0000","last_active":"2024-05-21T14:45:35.509078+0000","last_peered":"2024-05-21T14:45:35.509078+0000","last_clean":"2024-05-21T14:45:35.509078+0000","last_became_active":"2024-05-21T14:43:19.619072+0000","last_became_peered":"2024-05-21T14:43:19.619072+0000","last_unstale":"2024-05-21T14:45:35.509078+0000","last_undegraded":"2024-05-21T14:45:35.509078+0000","last_fullsized":"2024-05-21T14:45:35.509078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:22:09.423661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'15","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.486686+0000","last_change":"2024-05-21T14:43:19.602880+0000","last_active":"2024-05-21T14:45:35.486686+0000","last_peered":"2024-05-21T14:45:35.486686+0000","last_clean":"2024-05-21T14:45:35.486686+0000","last_became_active":"2024-05-21T14:43:19.602577+0000","last_became_peered":"2024-05-21T14:43:19.602577+0000","last_unstale":"2024-05-21T14:45:35.486686+0000","last_undegraded":"2024-05-21T14:45:35.486686+0000","last_fullsized":"2024-05-21T14:45:35.486686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:04:10.094373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'6","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.507849+0000","last_change":"2024-05-21T14:43:19.632328+0000","last_active":"2024-05-21T14:45:35.507849+0000","last_peered":"2024-05-21T14:45:35.507849+0000","last_clean":"2024-05-21T14:45:35.507849+0000","last_became_active":"2024-05-21T14:43:19.631351+0000","last_became_peered":"2024-05-21T14:43:19.631351+0000","last_unstale":"2024-05-21T14:45:35.507849+0000","last_undegraded":"2024-05-21T14:45:35.507849+0000","last_fullsized":"2024-05-21T14:45:35.507849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:36:18.467070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.479802+0000","last_change":"2024-05-21T14:43:19.632282+0000","last_active":"2024-05-21T14:45:35.479802+0000","last_peered":"2024-05-21T14:45:35.479802+0000","last_clean":"2024-05-21T14:45:35.479802+0000","last_became_active":"2024-05-21T14:43:19.631522+0000","last_became_peered":"2024-05-21T14:43:19.631522+0000","last_unstale":"2024-05-21T14:45:35.479802+0000","last_undegraded":"2024-05-21T14:45:35.479802+0000","last_fullsized":"2024-05-21T14:45:35.479802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:23:32.646087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'7","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.502853+0000","last_change":"2024-05-21T14:43:19.620046+0000","last_active":"2024-05-21T14:45:35.502853+0000","last_peered":"2024-05-21T14:45:35.502853+0000","last_clean":"2024-05-21T14:45:35.502853+0000","last_became_active":"2024-05-21T14:43:19.612428+0000","last_became_peered":"2024-05-21T14:43:19.612428+0000","last_unstale":"2024-05-21T14:45:35.502853+0000","last_undegraded":"2024-05-21T14:45:35.502853+0000","last_fullsized":"2024-05-21T14:45:35.502853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:08:33.785399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.495899+0000","last_change":"2024-05-21T14:43:19.618198+0000","last_active":"2024-05-21T14:45:35.495899+0000","last_peered":"2024-05-21T14:45:35.495899+0000","last_clean":"2024-05-21T14:45:35.495899+0000","last_became_active":"2024-05-21T14:43:19.617903+0000","last_became_peered":"2024-05-21T14:43:19.617903+0000","last_unstale":"2024-05-21T14:45:35.495899+0000","last_undegraded":"2024-05-21T14:45:35.495899+0000","last_fullsized":"2024-05-21T14:45:35.495899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:59.606862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813652+0000","last_change":"2024-05-21T14:43:19.613942+0000","last_active":"2024-05-21T14:43:59.813652+0000","last_peered":"2024-05-21T14:43:59.813652+0000","last_clean":"2024-05-21T14:43:59.813652+0000","last_became_active":"2024-05-21T14:43:19.613035+0000","last_became_peered":"2024-05-21T14:43:19.613035+0000","last_unstale":"2024-05-21T14:43:59.813652+0000","last_undegraded":"2024-05-21T14:43:59.813652+0000","last_fullsized":"2024-05-21T14:43:59.813652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:47:46.462547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'9","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.472703+0000","last_change":"2024-05-21T14:43:19.626414+0000","last_active":"2024-05-21T14:45:35.472703+0000","last_peered":"2024-05-21T14:45:35.472703+0000","last_clean":"2024-05-21T14:45:35.472703+0000","last_became_active":"2024-05-21T14:43:19.626080+0000","last_became_peered":"2024-05-21T14:43:19.626080+0000","last_unstale":"2024-05-21T14:45:35.472703+0000","last_undegraded":"2024-05-21T14:45:35.472703+0000","last_fullsized":"2024-05-21T14:45:35.472703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:37:38.449284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'7","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.492631+0000","last_change":"2024-05-21T14:43:19.620806+0000","last_active":"2024-05-21T14:45:35.492631+0000","last_peered":"2024-05-21T14:45:35.492631+0000","last_clean":"2024-05-21T14:45:35.492631+0000","last_became_active":"2024-05-21T14:43:19.620449+0000","last_became_peered":"2024-05-21T14:43:19.620449+0000","last_unstale":"2024-05-21T14:45:35.492631+0000","last_undegraded":"2024-05-21T14:45:35.492631+0000","last_fullsized":"2024-05-21T14:45:35.492631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:43:52.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172688+0000","last_change":"2024-05-21T14:43:18.603028+0000","last_active":"2024-05-21T14:44:00.172688+0000","last_peered":"2024-05-21T14:44:00.172688+0000","last_clean":"2024-05-21T14:44:00.172688+0000","last_became_active":"2024-05-21T14:43:18.602036+0000","last_became_peered":"2024-05-21T14:43:18.602036+0000","last_unstale":"2024-05-21T14:44:00.172688+0000","last_undegraded":"2024-05-21T14:44:00.172688+0000","last_fullsized":"2024-05-21T14:44:00.172688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:15:25.384197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.509869+0000","last_change":"2024-05-21T14:43:19.599725+0000","last_active":"2024-05-21T14:45:35.509869+0000","last_peered":"2024-05-21T14:45:35.509869+0000","last_clean":"2024-05-21T14:45:35.509869+0000","last_became_active":"2024-05-21T14:43:19.598972+0000","last_became_peered":"2024-05-21T14:43:19.598972+0000","last_unstale":"2024-05-21T14:45:35.509869+0000","last_undegraded":"2024-05-21T14:45:35.509869+0000","last_fullsized":"2024-05-21T14:45:35.509869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:54:00.871046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'7","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173842+0000","last_change":"2024-05-21T14:43:18.615934+0000","last_active":"2024-05-21T14:44:00.173842+0000","last_peered":"2024-05-21T14:44:00.173842+0000","last_clean":"2024-05-21T14:44:00.173842+0000","last_became_active":"2024-05-21T14:43:18.615568+0000","last_became_peered":"2024-05-21T14:43:18.615568+0000","last_unstale":"2024-05-21T14:44:00.173842+0000","last_undegraded":"2024-05-21T14:44:00.173842+0000","last_fullsized":"2024-05-21T14:44:00.173842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:28:54.494319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'3","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.199358+0000","last_change":"2024-05-21T14:43:18.615154+0000","last_active":"2024-05-21T14:44:00.199358+0000","last_peered":"2024-05-21T14:44:00.199358+0000","last_clean":"2024-05-21T14:44:00.199358+0000","last_became_active":"2024-05-21T14:43:18.613838+0000","last_became_peered":"2024-05-21T14:43:18.613838+0000","last_unstale":"2024-05-21T14:44:00.199358+0000","last_undegraded":"2024-05-21T14:44:00.199358+0000","last_fullsized":"2024-05-21T14:44:00.199358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:32:09.174124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.511460+0000","last_change":"2024-05-21T14:43:19.633585+0000","last_active":"2024-05-21T14:45:35.511460+0000","last_peered":"2024-05-21T14:45:35.511460+0000","last_clean":"2024-05-21T14:45:35.511460+0000","last_became_active":"2024-05-21T14:43:19.632476+0000","last_became_peered":"2024-05-21T14:43:19.632476+0000","last_unstale":"2024-05-21T14:45:35.511460+0000","last_undegraded":"2024-05-21T14:45:35.511460+0000","last_fullsized":"2024-05-21T14:45:35.511460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:53.023931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'3","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173489+0000","last_change":"2024-05-21T14:43:18.585548+0000","last_active":"2024-05-21T14:44:00.173489+0000","last_peered":"2024-05-21T14:44:00.173489+0000","last_clean":"2024-05-21T14:44:00.173489+0000","last_became_active":"2024-05-21T14:43:18.585099+0000","last_became_peered":"2024-05-21T14:43:18.585099+0000","last_unstale":"2024-05-21T14:44:00.173489+0000","last_undegraded":"2024-05-21T14:44:00.173489+0000","last_fullsized":"2024-05-21T14:44:00.173489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:20:16.856225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.507636+0000","last_change":"2024-05-21T14:43:19.614884+0000","last_active":"2024-05-21T14:45:35.507636+0000","last_peered":"2024-05-21T14:45:35.507636+0000","last_clean":"2024-05-21T14:45:35.507636+0000","last_became_active":"2024-05-21T14:43:19.614064+0000","last_became_peered":"2024-05-21T14:43:19.614064+0000","last_unstale":"2024-05-21T14:45:35.507636+0000","last_undegraded":"2024-05-21T14:45:35.507636+0000","last_fullsized":"2024-05-21T14:45:35.507636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:42:17.091043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813975+0000","last_change":"2024-05-21T14:43:18.602794+0000","last_active":"2024-05-21T14:43:59.813975+0000","last_peered":"2024-05-21T14:43:59.813975+0000","last_clean":"2024-05-21T14:43:59.813975+0000","last_became_active":"2024-05-21T14:43:18.602429+0000","last_became_peered":"2024-05-21T14:43:18.602429+0000","last_unstale":"2024-05-21T14:43:59.813975+0000","last_undegraded":"2024-05-21T14:43:59.813975+0000","last_fullsized":"2024-05-21T14:43:59.813975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:50:14.465202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.486908+0000","last_change":"2024-05-21T14:43:19.602663+0000","last_active":"2024-05-21T14:45:35.486908+0000","last_peered":"2024-05-21T14:45:35.486908+0000","last_clean":"2024-05-21T14:45:35.486908+0000","last_became_active":"2024-05-21T14:43:19.602294+0000","last_became_peered":"2024-05-21T14:43:19.602294+0000","last_unstale":"2024-05-21T14:45:35.486908+0000","last_undegraded":"2024-05-21T14:45:35.486908+0000","last_fullsized":"2024-05-21T14:45:35.486908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:48:56.271741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'4","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174916+0000","last_change":"2024-05-21T14:43:18.604601+0000","last_active":"2024-05-21T14:44:00.174916+0000","last_peered":"2024-05-21T14:44:00.174916+0000","last_clean":"2024-05-21T14:44:00.174916+0000","last_became_active":"2024-05-21T14:43:18.604262+0000","last_became_peered":"2024-05-21T14:43:18.604262+0000","last_unstale":"2024-05-21T14:44:00.174916+0000","last_undegraded":"2024-05-21T14:44:00.174916+0000","last_fullsized":"2024-05-21T14:44:00.174916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:55:15.490579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'9","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.511104+0000","last_change":"2024-05-21T14:43:19.613952+0000","last_active":"2024-05-21T14:45:35.511104+0000","last_peered":"2024-05-21T14:45:35.511104+0000","last_clean":"2024-05-21T14:45:35.511104+0000","last_became_active":"2024-05-21T14:43:19.613093+0000","last_became_peered":"2024-05-21T14:43:19.613093+0000","last_unstale":"2024-05-21T14:45:35.511104+0000","last_undegraded":"2024-05-21T14:45:35.511104+0000","last_fullsized":"2024-05-21T14:45:35.511104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:03:44.925212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815124+0000","last_change":"2024-05-21T14:43:18.602343+0000","last_active":"2024-05-21T14:43:59.815124+0000","last_peered":"2024-05-21T14:43:59.815124+0000","last_clean":"2024-05-21T14:43:59.815124+0000","last_became_active":"2024-05-21T14:43:18.601500+0000","last_became_peered":"2024-05-21T14:43:18.601500+0000","last_unstale":"2024-05-21T14:43:59.815124+0000","last_undegraded":"2024-05-21T14:43:59.815124+0000","last_fullsized":"2024-05-21T14:43:59.815124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:54:21.960430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'11","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.486514+0000","last_change":"2024-05-21T14:43:19.608580+0000","last_active":"2024-05-21T14:45:35.486514+0000","last_peered":"2024-05-21T14:45:35.486514+0000","last_clean":"2024-05-21T14:45:35.486514+0000","last_became_active":"2024-05-21T14:43:19.608038+0000","last_became_peered":"2024-05-21T14:43:19.608038+0000","last_unstale":"2024-05-21T14:45:35.486514+0000","last_undegraded":"2024-05-21T14:45:35.486514+0000","last_fullsized":"2024-05-21T14:45:35.486514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:19.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'24","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.423891+0000","last_change":"2024-05-21T14:43:18.606824+0000","last_active":"2024-05-21T14:45:35.423891+0000","last_peered":"2024-05-21T14:45:35.423891+0000","last_clean":"2024-05-21T14:45:35.423891+0000","last_became_active":"2024-05-21T14:43:18.606449+0000","last_became_peered":"2024-05-21T14:43:18.606449+0000","last_unstale":"2024-05-21T14:45:35.423891+0000","last_undegraded":"2024-05-21T14:45:35.423891+0000","last_fullsized":"2024-05-21T14:45:35.423891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:43:41.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31450,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'6","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.479590+0000","last_change":"2024-05-21T14:43:19.634014+0000","last_active":"2024-05-21T14:45:35.479590+0000","last_peered":"2024-05-21T14:45:35.479590+0000","last_clean":"2024-05-21T14:45:35.479590+0000","last_became_active":"2024-05-21T14:43:19.633664+0000","last_became_peered":"2024-05-21T14:43:19.633664+0000","last_unstale":"2024-05-21T14:45:35.479590+0000","last_undegraded":"2024-05-21T14:45:35.479590+0000","last_fullsized":"2024-05-21T14:45:35.479590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:36:07.708164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'9","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.814396+0000","last_change":"2024-05-21T14:43:18.614764+0000","last_active":"2024-05-21T14:43:59.814396+0000","last_peered":"2024-05-21T14:43:59.814396+0000","last_clean":"2024-05-21T14:43:59.814396+0000","last_became_active":"2024-05-21T14:43:18.614214+0000","last_became_peered":"2024-05-21T14:43:18.614214+0000","last_unstale":"2024-05-21T14:43:59.814396+0000","last_undegraded":"2024-05-21T14:43:59.814396+0000","last_fullsized":"2024-05-21T14:43:59.814396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:34:40.294756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'9","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.508205+0000","last_change":"2024-05-21T14:43:19.625313+0000","last_active":"2024-05-21T14:45:35.508205+0000","last_peered":"2024-05-21T14:45:35.508205+0000","last_clean":"2024-05-21T14:45:35.508205+0000","last_became_active":"2024-05-21T14:43:19.624474+0000","last_became_peered":"2024-05-21T14:43:19.624474+0000","last_unstale":"2024-05-21T14:45:35.508205+0000","last_undegraded":"2024-05-21T14:45:35.508205+0000","last_fullsized":"2024-05-21T14:45:35.508205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:28.280456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'6","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173925+0000","last_change":"2024-05-21T14:43:18.600736+0000","last_active":"2024-05-21T14:44:00.173925+0000","last_peered":"2024-05-21T14:44:00.173925+0000","last_clean":"2024-05-21T14:44:00.173925+0000","last_became_active":"2024-05-21T14:43:18.600415+0000","last_became_peered":"2024-05-21T14:43:18.600415+0000","last_unstale":"2024-05-21T14:44:00.173925+0000","last_undegraded":"2024-05-21T14:44:00.173925+0000","last_fullsized":"2024-05-21T14:44:00.173925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:03:57.207603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'15","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.490064+0000","last_change":"2024-05-21T14:43:19.599637+0000","last_active":"2024-05-21T14:45:35.490064+0000","last_peered":"2024-05-21T14:45:35.490064+0000","last_clean":"2024-05-21T14:45:35.490064+0000","last_became_active":"2024-05-21T14:43:19.599195+0000","last_became_peered":"2024-05-21T14:43:19.599195+0000","last_unstale":"2024-05-21T14:45:35.490064+0000","last_undegraded":"2024-05-21T14:45:35.490064+0000","last_fullsized":"2024-05-21T14:45:35.490064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:17.350821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172653+0000","last_change":"2024-05-21T14:43:18.603064+0000","last_active":"2024-05-21T14:44:00.172653+0000","last_peered":"2024-05-21T14:44:00.172653+0000","last_clean":"2024-05-21T14:44:00.172653+0000","last_became_active":"2024-05-21T14:43:18.602658+0000","last_became_peered":"2024-05-21T14:43:18.602658+0000","last_unstale":"2024-05-21T14:44:00.172653+0000","last_undegraded":"2024-05-21T14:44:00.172653+0000","last_fullsized":"2024-05-21T14:44:00.172653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:09:28.623131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'6","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.499653+0000","last_change":"2024-05-21T14:43:19.620760+0000","last_active":"2024-05-21T14:45:35.499653+0000","last_peered":"2024-05-21T14:45:35.499653+0000","last_clean":"2024-05-21T14:45:35.499653+0000","last_became_active":"2024-05-21T14:43:19.620409+0000","last_became_peered":"2024-05-21T14:43:19.620409+0000","last_unstale":"2024-05-21T14:45:35.499653+0000","last_undegraded":"2024-05-21T14:45:35.499653+0000","last_fullsized":"2024-05-21T14:45:35.499653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:49:59.051131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'18","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813383+0000","last_change":"2024-05-21T14:43:18.594225+0000","last_active":"2024-05-21T14:43:59.813383+0000","last_peered":"2024-05-21T14:43:59.813383+0000","last_clean":"2024-05-21T14:43:59.813383+0000","last_became_active":"2024-05-21T14:43:18.592335+0000","last_became_peered":"2024-05-21T14:43:18.592335+0000","last_unstale":"2024-05-21T14:43:59.813383+0000","last_undegraded":"2024-05-21T14:43:59.813383+0000","last_fullsized":"2024-05-21T14:43:59.813383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:00:58.772091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'6","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.486141+0000","last_change":"2024-05-21T14:43:19.612442+0000","last_active":"2024-05-21T14:45:35.486141+0000","last_peered":"2024-05-21T14:45:35.486141+0000","last_clean":"2024-05-21T14:45:35.486141+0000","last_became_active":"2024-05-21T14:43:19.612110+0000","last_became_peered":"2024-05-21T14:43:19.612110+0000","last_unstale":"2024-05-21T14:45:35.486141+0000","last_undegraded":"2024-05-21T14:45:35.486141+0000","last_fullsized":"2024-05-21T14:45:35.486141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:53.451513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.175051+0000","last_change":"2024-05-21T14:43:18.613433+0000","last_active":"2024-05-21T14:44:00.175051+0000","last_peered":"2024-05-21T14:44:00.175051+0000","last_clean":"2024-05-21T14:44:00.175051+0000","last_became_active":"2024-05-21T14:43:18.613048+0000","last_became_peered":"2024-05-21T14:43:18.613048+0000","last_unstale":"2024-05-21T14:44:00.175051+0000","last_undegraded":"2024-05-21T14:44:00.175051+0000","last_fullsized":"2024-05-21T14:44:00.175051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:00:16.454574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'5","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.475051+0000","last_change":"2024-05-21T14:43:19.597079+0000","last_active":"2024-05-21T14:45:35.475051+0000","last_peered":"2024-05-21T14:45:35.475051+0000","last_clean":"2024-05-21T14:45:35.475051+0000","last_became_active":"2024-05-21T14:43:19.596736+0000","last_became_peered":"2024-05-21T14:43:19.596736+0000","last_unstale":"2024-05-21T14:45:35.475051+0000","last_undegraded":"2024-05-21T14:45:35.475051+0000","last_fullsized":"2024-05-21T14:45:35.475051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:09:03.687971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'5","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815283+0000","last_change":"2024-05-21T14:43:18.620603+0000","last_active":"2024-05-21T14:43:59.815283+0000","last_peered":"2024-05-21T14:43:59.815283+0000","last_clean":"2024-05-21T14:43:59.815283+0000","last_became_active":"2024-05-21T14:43:18.619762+0000","last_became_peered":"2024-05-21T14:43:18.619762+0000","last_unstale":"2024-05-21T14:43:59.815283+0000","last_undegraded":"2024-05-21T14:43:59.815283+0000","last_fullsized":"2024-05-21T14:43:59.815283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:31:49.257435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.819643+0000","last_change":"2024-05-21T14:43:59.818544+0000","last_active":"2024-05-21T14:43:59.819643+0000","last_peered":"2024-05-21T14:43:59.819643+0000","last_clean":"2024-05-21T14:43:59.819643+0000","last_became_active":"2024-05-21T14:43:59.817946+0000","last_became_peered":"2024-05-21T14:43:59.817946+0000","last_unstale":"2024-05-21T14:43:59.819643+0000","last_undegraded":"2024-05-21T14:43:59.819643+0000","last_fullsized":"2024-05-21T14:43:59.819643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:20:02.691907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'3","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173272+0000","last_change":"2024-05-21T14:43:18.610121+0000","last_active":"2024-05-21T14:44:00.173272+0000","last_peered":"2024-05-21T14:44:00.173272+0000","last_clean":"2024-05-21T14:44:00.173272+0000","last_became_active":"2024-05-21T14:43:18.609349+0000","last_became_peered":"2024-05-21T14:43:18.609349+0000","last_unstale":"2024-05-21T14:44:00.173272+0000","last_undegraded":"2024-05-21T14:44:00.173272+0000","last_fullsized":"2024-05-21T14:44:00.173272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:48.330067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'6","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.496823+0000","last_change":"2024-05-21T14:43:19.605193+0000","last_active":"2024-05-21T14:45:35.496823+0000","last_peered":"2024-05-21T14:45:35.496823+0000","last_clean":"2024-05-21T14:45:35.496823+0000","last_became_active":"2024-05-21T14:43:19.604869+0000","last_became_peered":"2024-05-21T14:43:19.604869+0000","last_unstale":"2024-05-21T14:45:35.496823+0000","last_undegraded":"2024-05-21T14:45:35.496823+0000","last_fullsized":"2024-05-21T14:45:35.496823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:58:05.078363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'5","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.200122+0000","last_change":"2024-05-21T14:43:18.616535+0000","last_active":"2024-05-21T14:44:00.200122+0000","last_peered":"2024-05-21T14:44:00.200122+0000","last_clean":"2024-05-21T14:44:00.200122+0000","last_became_active":"2024-05-21T14:43:18.615734+0000","last_became_peered":"2024-05-21T14:43:18.615734+0000","last_unstale":"2024-05-21T14:44:00.200122+0000","last_undegraded":"2024-05-21T14:44:00.200122+0000","last_fullsized":"2024-05-21T14:44:00.200122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:10:27.821535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'6","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.489850+0000","last_change":"2024-05-21T14:43:19.615424+0000","last_active":"2024-05-21T14:45:35.489850+0000","last_peered":"2024-05-21T14:45:35.489850+0000","last_clean":"2024-05-21T14:45:35.489850+0000","last_became_active":"2024-05-21T14:43:19.614915+0000","last_became_peered":"2024-05-21T14:43:19.614915+0000","last_unstale":"2024-05-21T14:45:35.489850+0000","last_undegraded":"2024-05-21T14:45:35.489850+0000","last_fullsized":"2024-05-21T14:45:35.489850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:25:09.153430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813317+0000","last_change":"2024-05-21T14:43:08.080234+0000","last_active":"2024-05-21T14:43:59.813317+0000","last_peered":"2024-05-21T14:43:59.813317+0000","last_clean":"2024-05-21T14:43:59.813317+0000","last_became_active":"2024-05-21T14:43:08.079934+0000","last_became_peered":"2024-05-21T14:43:08.079934+0000","last_unstale":"2024-05-21T14:43:59.813317+0000","last_undegraded":"2024-05-21T14:43:59.813317+0000","last_fullsized":"2024-05-21T14:43:59.813317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:07.046978+0000","last_clean_scrub_stamp":"2024-05-21T14:43:07.046978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:54:57.347768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'6","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174205+0000","last_change":"2024-05-21T14:43:18.599850+0000","last_active":"2024-05-21T14:44:00.174205+0000","last_peered":"2024-05-21T14:44:00.174205+0000","last_clean":"2024-05-21T14:44:00.174205+0000","last_became_active":"2024-05-21T14:43:18.599347+0000","last_became_peered":"2024-05-21T14:43:18.599347+0000","last_unstale":"2024-05-21T14:44:00.174205+0000","last_undegraded":"2024-05-21T14:44:00.174205+0000","last_fullsized":"2024-05-21T14:44:00.174205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:01:06.881884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.513105+0000","last_change":"2024-05-21T14:43:19.613056+0000","last_active":"2024-05-21T14:45:35.513105+0000","last_peered":"2024-05-21T14:45:35.513105+0000","last_clean":"2024-05-21T14:45:35.513105+0000","last_became_active":"2024-05-21T14:43:19.611889+0000","last_became_peered":"2024-05-21T14:43:19.611889+0000","last_unstale":"2024-05-21T14:45:35.513105+0000","last_undegraded":"2024-05-21T14:45:35.513105+0000","last_fullsized":"2024-05-21T14:45:35.513105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:46:20.105282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173579+0000","last_change":"2024-05-21T14:43:18.621482+0000","last_active":"2024-05-21T14:44:00.173579+0000","last_peered":"2024-05-21T14:44:00.173579+0000","last_clean":"2024-05-21T14:44:00.173579+0000","last_became_active":"2024-05-21T14:43:18.621229+0000","last_became_peered":"2024-05-21T14:43:18.621229+0000","last_unstale":"2024-05-21T14:44:00.173579+0000","last_undegraded":"2024-05-21T14:44:00.173579+0000","last_fullsized":"2024-05-21T14:44:00.173579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:30:04.326588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'5","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.465295+0000","last_change":"2024-05-21T14:43:19.625038+0000","last_active":"2024-05-21T14:45:35.465295+0000","last_peered":"2024-05-21T14:45:35.465295+0000","last_clean":"2024-05-21T14:45:35.465295+0000","last_became_active":"2024-05-21T14:43:19.624114+0000","last_became_peered":"2024-05-21T14:43:19.624114+0000","last_unstale":"2024-05-21T14:45:35.465295+0000","last_undegraded":"2024-05-21T14:45:35.465295+0000","last_fullsized":"2024-05-21T14:45:35.465295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:11.854243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"23'5","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813950+0000","last_change":"2024-05-21T14:43:18.618518+0000","last_active":"2024-05-21T14:43:59.813950+0000","last_peered":"2024-05-21T14:43:59.813950+0000","last_clean":"2024-05-21T14:43:59.813950+0000","last_became_active":"2024-05-21T14:43:18.617756+0000","last_became_peered":"2024-05-21T14:43:18.617756+0000","last_unstale":"2024-05-21T14:43:59.813950+0000","last_undegraded":"2024-05-21T14:43:59.813950+0000","last_fullsized":"2024-05-21T14:43:59.813950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:52:12.999877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.503687+0000","last_change":"2024-05-21T14:43:19.613595+0000","last_active":"2024-05-21T14:45:35.503687+0000","last_peered":"2024-05-21T14:45:35.503687+0000","last_clean":"2024-05-21T14:45:35.503687+0000","last_became_active":"2024-05-21T14:43:19.612730+0000","last_became_peered":"2024-05-21T14:43:19.612730+0000","last_unstale":"2024-05-21T14:45:35.503687+0000","last_undegraded":"2024-05-21T14:45:35.503687+0000","last_fullsized":"2024-05-21T14:45:35.503687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:01:02.847071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'5","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173991+0000","last_change":"2024-05-21T14:43:18.608596+0000","last_active":"2024-05-21T14:44:00.173991+0000","last_peered":"2024-05-21T14:44:00.173991+0000","last_clean":"2024-05-21T14:44:00.173991+0000","last_became_active":"2024-05-21T14:43:18.608262+0000","last_became_peered":"2024-05-21T14:43:18.608262+0000","last_unstale":"2024-05-21T14:44:00.173991+0000","last_undegraded":"2024-05-21T14:44:00.173991+0000","last_fullsized":"2024-05-21T14:44:00.173991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:14.962554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'7","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.476564+0000","last_change":"2024-05-21T14:43:19.607815+0000","last_active":"2024-05-21T14:45:35.476564+0000","last_peered":"2024-05-21T14:45:35.476564+0000","last_clean":"2024-05-21T14:45:35.476564+0000","last_became_active":"2024-05-21T14:43:19.607513+0000","last_became_peered":"2024-05-21T14:43:19.607513+0000","last_unstale":"2024-05-21T14:45:35.476564+0000","last_undegraded":"2024-05-21T14:45:35.476564+0000","last_fullsized":"2024-05-21T14:45:35.476564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:01:35.332981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172926+0000","last_change":"2024-05-21T14:43:18.603626+0000","last_active":"2024-05-21T14:44:00.172926+0000","last_peered":"2024-05-21T14:44:00.172926+0000","last_clean":"2024-05-21T14:44:00.172926+0000","last_became_active":"2024-05-21T14:43:18.602704+0000","last_became_peered":"2024-05-21T14:43:18.602704+0000","last_unstale":"2024-05-21T14:44:00.172926+0000","last_undegraded":"2024-05-21T14:44:00.172926+0000","last_fullsized":"2024-05-21T14:44:00.172926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:03.976820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'5","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.472423+0000","last_change":"2024-05-21T14:43:19.634449+0000","last_active":"2024-05-21T14:45:35.472423+0000","last_peered":"2024-05-21T14:45:35.472423+0000","last_clean":"2024-05-21T14:45:35.472423+0000","last_became_active":"2024-05-21T14:43:19.633751+0000","last_became_peered":"2024-05-21T14:43:19.633751+0000","last_unstale":"2024-05-21T14:45:35.472423+0000","last_undegraded":"2024-05-21T14:45:35.472423+0000","last_fullsized":"2024-05-21T14:45:35.472423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:04:51.415303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174026+0000","last_change":"2024-05-21T14:43:18.608335+0000","last_active":"2024-05-21T14:44:00.174026+0000","last_peered":"2024-05-21T14:44:00.174026+0000","last_clean":"2024-05-21T14:44:00.174026+0000","last_became_active":"2024-05-21T14:43:18.607999+0000","last_became_peered":"2024-05-21T14:43:18.607999+0000","last_unstale":"2024-05-21T14:44:00.174026+0000","last_undegraded":"2024-05-21T14:44:00.174026+0000","last_fullsized":"2024-05-21T14:44:00.174026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:21.325953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'9","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.505561+0000","last_change":"2024-05-21T14:43:19.626742+0000","last_active":"2024-05-21T14:45:35.505561+0000","last_peered":"2024-05-21T14:45:35.505561+0000","last_clean":"2024-05-21T14:45:35.505561+0000","last_became_active":"2024-05-21T14:43:19.626024+0000","last_became_peered":"2024-05-21T14:43:19.626024+0000","last_unstale":"2024-05-21T14:45:35.505561+0000","last_undegraded":"2024-05-21T14:45:35.505561+0000","last_fullsized":"2024-05-21T14:45:35.505561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:48:15.426224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'16","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:34.765261+0000","last_change":"2024-05-21T14:43:18.616913+0000","last_active":"2024-05-21T14:45:34.765261+0000","last_peered":"2024-05-21T14:45:34.765261+0000","last_clean":"2024-05-21T14:45:34.765261+0000","last_became_active":"2024-05-21T14:43:18.616214+0000","last_became_peered":"2024-05-21T14:43:18.616214+0000","last_unstale":"2024-05-21T14:45:34.765261+0000","last_undegraded":"2024-05-21T14:45:34.765261+0000","last_fullsized":"2024-05-21T14:45:34.765261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:22.112018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'5","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.500722+0000","last_change":"2024-05-21T14:43:19.607521+0000","last_active":"2024-05-21T14:45:35.500722+0000","last_peered":"2024-05-21T14:45:35.500722+0000","last_clean":"2024-05-21T14:45:35.500722+0000","last_became_active":"2024-05-21T14:43:19.606673+0000","last_became_peered":"2024-05-21T14:43:19.606673+0000","last_unstale":"2024-05-21T14:45:35.500722+0000","last_undegraded":"2024-05-21T14:45:35.500722+0000","last_fullsized":"2024-05-21T14:45:35.500722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:50:50.373410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'8","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:30.972140+0000","last_change":"2024-05-21T14:43:18.615846+0000","last_active":"2024-05-21T14:45:30.972140+0000","last_peered":"2024-05-21T14:45:30.972140+0000","last_clean":"2024-05-21T14:45:30.972140+0000","last_became_active":"2024-05-21T14:43:18.615506+0000","last_became_peered":"2024-05-21T14:43:18.615506+0000","last_unstale":"2024-05-21T14:45:30.972140+0000","last_undegraded":"2024-05-21T14:45:30.972140+0000","last_fullsized":"2024-05-21T14:45:30.972140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:07:17.030757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'7","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.509522+0000","last_change":"2024-05-21T14:43:19.611473+0000","last_active":"2024-05-21T14:45:35.509522+0000","last_peered":"2024-05-21T14:45:35.509522+0000","last_clean":"2024-05-21T14:45:35.509522+0000","last_became_active":"2024-05-21T14:43:19.610600+0000","last_became_peered":"2024-05-21T14:43:19.610600+0000","last_unstale":"2024-05-21T14:45:35.509522+0000","last_undegraded":"2024-05-21T14:45:35.509522+0000","last_fullsized":"2024-05-21T14:45:35.509522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:48:07.659795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172286+0000","last_change":"2024-05-21T14:43:18.604951+0000","last_active":"2024-05-21T14:44:00.172286+0000","last_peered":"2024-05-21T14:44:00.172286+0000","last_clean":"2024-05-21T14:44:00.172286+0000","last_became_active":"2024-05-21T14:43:18.602186+0000","last_became_peered":"2024-05-21T14:43:18.602186+0000","last_unstale":"2024-05-21T14:44:00.172286+0000","last_undegraded":"2024-05-21T14:44:00.172286+0000","last_fullsized":"2024-05-21T14:44:00.172286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:34:10.395484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.465298+0000","last_change":"2024-05-21T14:43:19.600827+0000","last_active":"2024-05-21T14:45:35.465298+0000","last_peered":"2024-05-21T14:45:35.465298+0000","last_clean":"2024-05-21T14:45:35.465298+0000","last_became_active":"2024-05-21T14:43:19.600499+0000","last_became_peered":"2024-05-21T14:43:19.600499+0000","last_unstale":"2024-05-21T14:45:35.465298+0000","last_undegraded":"2024-05-21T14:45:35.465298+0000","last_fullsized":"2024-05-21T14:45:35.465298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:55:36.231321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'7","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813798+0000","last_change":"2024-05-21T14:43:18.615190+0000","last_active":"2024-05-21T14:43:59.813798+0000","last_peered":"2024-05-21T14:43:59.813798+0000","last_clean":"2024-05-21T14:43:59.813798+0000","last_became_active":"2024-05-21T14:43:18.614306+0000","last_became_peered":"2024-05-21T14:43:18.614306+0000","last_unstale":"2024-05-21T14:43:59.813798+0000","last_undegraded":"2024-05-21T14:43:59.813798+0000","last_fullsized":"2024-05-21T14:43:59.813798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:53.472559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'9","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.501271+0000","last_change":"2024-05-21T14:43:19.610903+0000","last_active":"2024-05-21T14:45:35.501271+0000","last_peered":"2024-05-21T14:45:35.501271+0000","last_clean":"2024-05-21T14:45:35.501271+0000","last_became_active":"2024-05-21T14:43:19.610101+0000","last_became_peered":"2024-05-21T14:43:19.610101+0000","last_unstale":"2024-05-21T14:45:35.501271+0000","last_undegraded":"2024-05-21T14:45:35.501271+0000","last_fullsized":"2024-05-21T14:45:35.501271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:16:24.580581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'3","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.200092+0000","last_change":"2024-05-21T14:43:18.617785+0000","last_active":"2024-05-21T14:44:00.200092+0000","last_peered":"2024-05-21T14:44:00.200092+0000","last_clean":"2024-05-21T14:44:00.200092+0000","last_became_active":"2024-05-21T14:43:18.617041+0000","last_became_peered":"2024-05-21T14:43:18.617041+0000","last_unstale":"2024-05-21T14:44:00.200092+0000","last_undegraded":"2024-05-21T14:44:00.200092+0000","last_fullsized":"2024-05-21T14:44:00.200092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:02:50.837158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.814404+0000","last_change":"2024-05-21T14:43:19.627096+0000","last_active":"2024-05-21T14:43:59.814404+0000","last_peered":"2024-05-21T14:43:59.814404+0000","last_clean":"2024-05-21T14:43:59.814404+0000","last_became_active":"2024-05-21T14:43:19.626265+0000","last_became_peered":"2024-05-21T14:43:19.626265+0000","last_unstale":"2024-05-21T14:43:59.814404+0000","last_undegraded":"2024-05-21T14:43:59.814404+0000","last_fullsized":"2024-05-21T14:43:59.814404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:23:47.818120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'5","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:34.765381+0000","last_change":"2024-05-21T14:43:18.599635+0000","last_active":"2024-05-21T14:45:34.765381+0000","last_peered":"2024-05-21T14:45:34.765381+0000","last_clean":"2024-05-21T14:45:34.765381+0000","last_became_active":"2024-05-21T14:43:18.598996+0000","last_became_peered":"2024-05-21T14:43:18.598996+0000","last_unstale":"2024-05-21T14:45:34.765381+0000","last_undegraded":"2024-05-21T14:45:34.765381+0000","last_fullsized":"2024-05-21T14:45:34.765381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:17:09.383291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'5","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.490061+0000","last_change":"2024-05-21T14:43:19.617686+0000","last_active":"2024-05-21T14:45:35.490061+0000","last_peered":"2024-05-21T14:45:35.490061+0000","last_clean":"2024-05-21T14:45:35.490061+0000","last_became_active":"2024-05-21T14:43:19.617398+0000","last_became_peered":"2024-05-21T14:43:19.617398+0000","last_unstale":"2024-05-21T14:45:35.490061+0000","last_undegraded":"2024-05-21T14:45:35.490061+0000","last_fullsized":"2024-05-21T14:45:35.490061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:21:06.527871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'15","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.491039+0000","last_change":"2024-05-21T14:43:19.601673+0000","last_active":"2024-05-21T14:45:35.491039+0000","last_peered":"2024-05-21T14:45:35.491039+0000","last_clean":"2024-05-21T14:45:35.491039+0000","last_became_active":"2024-05-21T14:43:19.601286+0000","last_became_peered":"2024-05-21T14:43:19.601286+0000","last_unstale":"2024-05-21T14:45:35.491039+0000","last_undegraded":"2024-05-21T14:45:35.491039+0000","last_fullsized":"2024-05-21T14:45:35.491039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:21:22.955055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173839+0000","last_change":"2024-05-21T14:43:18.613555+0000","last_active":"2024-05-21T14:44:00.173839+0000","last_peered":"2024-05-21T14:44:00.173839+0000","last_clean":"2024-05-21T14:44:00.173839+0000","last_became_active":"2024-05-21T14:43:18.613117+0000","last_became_peered":"2024-05-21T14:43:18.613117+0000","last_unstale":"2024-05-21T14:44:00.173839+0000","last_undegraded":"2024-05-21T14:44:00.173839+0000","last_fullsized":"2024-05-21T14:44:00.173839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:38.151165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'9","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.472943+0000","last_change":"2024-05-21T14:43:19.596736+0000","last_active":"2024-05-21T14:45:35.472943+0000","last_peered":"2024-05-21T14:45:35.472943+0000","last_clean":"2024-05-21T14:45:35.472943+0000","last_became_active":"2024-05-21T14:43:19.596157+0000","last_became_peered":"2024-05-21T14:43:19.596157+0000","last_unstale":"2024-05-21T14:45:35.472943+0000","last_undegraded":"2024-05-21T14:45:35.472943+0000","last_fullsized":"2024-05-21T14:45:35.472943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:22:14.002930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'13","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.174758+0000","last_change":"2024-05-21T14:43:18.614044+0000","last_active":"2024-05-21T14:44:00.174758+0000","last_peered":"2024-05-21T14:44:00.174758+0000","last_clean":"2024-05-21T14:44:00.174758+0000","last_became_active":"2024-05-21T14:43:18.613730+0000","last_became_peered":"2024-05-21T14:43:18.613730+0000","last_unstale":"2024-05-21T14:44:00.174758+0000","last_undegraded":"2024-05-21T14:44:00.174758+0000","last_fullsized":"2024-05-21T14:44:00.174758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:41:34.787779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'6","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.512506+0000","last_change":"2024-05-21T14:43:19.621999+0000","last_active":"2024-05-21T14:45:35.512506+0000","last_peered":"2024-05-21T14:45:35.512506+0000","last_clean":"2024-05-21T14:45:35.512506+0000","last_became_active":"2024-05-21T14:43:19.614744+0000","last_became_peered":"2024-05-21T14:43:19.614744+0000","last_unstale":"2024-05-21T14:45:35.512506+0000","last_undegraded":"2024-05-21T14:45:35.512506+0000","last_fullsized":"2024-05-21T14:45:35.512506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:32:37.316833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173242+0000","last_change":"2024-05-21T14:43:18.614193+0000","last_active":"2024-05-21T14:44:00.173242+0000","last_peered":"2024-05-21T14:44:00.173242+0000","last_clean":"2024-05-21T14:44:00.173242+0000","last_became_active":"2024-05-21T14:43:18.609797+0000","last_became_peered":"2024-05-21T14:43:18.609797+0000","last_unstale":"2024-05-21T14:44:00.173242+0000","last_undegraded":"2024-05-21T14:44:00.173242+0000","last_fullsized":"2024-05-21T14:44:00.173242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:39:55.623816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'5","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.496860+0000","last_change":"2024-05-21T14:43:19.610578+0000","last_active":"2024-05-21T14:45:35.496860+0000","last_peered":"2024-05-21T14:45:35.496860+0000","last_clean":"2024-05-21T14:45:35.496860+0000","last_became_active":"2024-05-21T14:43:19.606575+0000","last_became_peered":"2024-05-21T14:43:19.606575+0000","last_unstale":"2024-05-21T14:45:35.496860+0000","last_undegraded":"2024-05-21T14:45:35.496860+0000","last_fullsized":"2024-05-21T14:45:35.496860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:50:06.088520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'13","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815910+0000","last_change":"2024-05-21T14:43:18.601862+0000","last_active":"2024-05-21T14:43:59.815910+0000","last_peered":"2024-05-21T14:43:59.815910+0000","last_clean":"2024-05-21T14:43:59.815910+0000","last_became_active":"2024-05-21T14:43:18.601311+0000","last_became_peered":"2024-05-21T14:43:18.601311+0000","last_unstale":"2024-05-21T14:43:59.815910+0000","last_undegraded":"2024-05-21T14:43:59.815910+0000","last_fullsized":"2024-05-21T14:43:59.815910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:02.736061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":463,"ondisk_log_size":463,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37872,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":323584,"data_stored":76148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":95528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":684645,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,1,3,7,54],"upper_bound":128},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509472,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":126436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":95870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509473,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":124666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":684930,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,5,1,0,0,0,12],"upper_bound":128},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509473,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":95690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":94206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":31518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":33288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T14:45:36.990 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:45:37.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.163+0000 7f0465a00640 1 Processor -- start 2024-05-21T14:45:37.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.163+0000 7f0465a00640 1 -- start start 2024-05-21T14:45:37.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.163+0000 7f0465a00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f04600c76f0 0x7f04600c5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:37.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.163+0000 7f0465a00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04600c4f60 con 0x7f04600c7b00 2024-05-21T14:45:37.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.163+0000 7f0465a00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04600c5200 con 0x7f04601536f0 2024-05-21T14:45:37.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.163+0000 7f0465a00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f046006d270 con 0x7f04600c76f0 2024-05-21T14:45:37.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.163+0000 7f045f400640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f04600c7b00 0x7f0460163e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53218/0 (socket says 172.21.15.78:53218) 2024-05-21T14:45:37.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.163+0000 7f045f400640 1 -- 172.21.15.78:0/1999879468 learned_addr learned my addr 172.21.15.78:0/1999879468 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:45:37.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.163+0000 7f0456000640 1 --2- 172.21.15.78:0/1999879468 >> v2:172.21.15.78:3300/0 conn(0x7f04600c76f0 0x7f04600c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:37.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.163+0000 7f0456000640 1 -- 172.21.15.78:0/1999879468 >> v1:172.21.15.84:6789/0 conn(0x7f04601536f0 legacy=0x7f046015cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:37.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.163+0000 7f0456000640 1 -- 172.21.15.78:0/1999879468 >> v1:172.21.15.78:6789/0 conn(0x7f04600c7b00 legacy=0x7f0460163e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:37.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.163+0000 7f0456000640 1 -- 172.21.15.78:0/1999879468 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04600c54e0 con 0x7f04600c76f0 2024-05-21T14:45:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.167+0000 7f0456000640 1 --2- 172.21.15.78:0/1999879468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04600c76f0 0x7f04600c5780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f04480097c0 tx=0x7f044801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b18d34ba94d65d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.167+0000 7f045e000640 1 -- 172.21.15.78:0/1999879468 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04480b0070 con 0x7f04600c76f0 2024-05-21T14:45:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.167+0000 7f045e000640 1 -- 172.21.15.78:0/1999879468 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04480ab600 con 0x7f04600c76f0 2024-05-21T14:45:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.167+0000 7f045e000640 1 -- 172.21.15.78:0/1999879468 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04480ab9d0 con 0x7f04600c76f0 2024-05-21T14:45:37.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.167+0000 7f0465a00640 1 -- 172.21.15.78:0/1999879468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04600c76f0 msgr2=0x7f04600c5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:37.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.167+0000 7f0465a00640 1 --2- 172.21.15.78:0/1999879468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04600c76f0 0x7f04600c5780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f04480097c0 tx=0x7f044801c4a0 comp rx=0 tx=0).stop 2024-05-21T14:45:37.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.167+0000 7f0465a00640 1 -- 172.21.15.78:0/1999879468 shutdown_connections 2024-05-21T14:45:37.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.167+0000 7f0465a00640 1 --2- 172.21.15.78:0/1999879468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04600c76f0 0x7f04600c5780 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:37.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.167+0000 7f0465a00640 1 -- 172.21.15.78:0/1999879468 >> 172.21.15.78:0/1999879468 conn(0x7f04600cacb0 msgr2=0x7f04600cd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:37.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.167+0000 7f0465a00640 1 -- 172.21.15.78:0/1999879468 shutdown_connections 2024-05-21T14:45:37.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.167+0000 7f0465a00640 1 -- 172.21.15.78:0/1999879468 wait complete. 2024-05-21T14:45:37.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f0465a00640 1 Processor -- start 2024-05-21T14:45:37.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f0465a00640 1 -- start start 2024-05-21T14:45:37.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f0465a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04600c76f0 0x7f0460157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:37.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f0465a00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f04600c7b00 0x7f0460159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:37.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f0465a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04601536f0 0x7f046013d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:37.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f0465a00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f046006d700 con 0x7f04600c76f0 2024-05-21T14:45:37.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f0465a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0460153b00 con 0x7f04601536f0 2024-05-21T14:45:37.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f0465a00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0460158460 con 0x7f04600c7b00 2024-05-21T14:45:37.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f045ea00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04600c76f0 0x7f0460157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:37.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f045ea00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04600c76f0 0x7f0460157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49704/0 (socket says 172.21.15.78:49704) 2024-05-21T14:45:37.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f045ea00640 1 -- 172.21.15.78:0/2653730825 learned_addr learned my addr 172.21.15.78:0/2653730825 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:37.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f045f400640 1 --2- 172.21.15.78:0/2653730825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04601536f0 0x7f046013d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:37.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f0456000640 1 --2- 172.21.15.78:0/2653730825 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f04600c7b00 0x7f0460159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:37.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f045ea00640 1 -- 172.21.15.78:0/2653730825 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f04600c7b00 msgr2=0x7f0460159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:37.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f045ea00640 1 --2- 172.21.15.78:0/2653730825 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f04600c7b00 0x7f0460159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:37.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f045ea00640 1 -- 172.21.15.78:0/2653730825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04601536f0 msgr2=0x7f046013d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:37.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f045ea00640 1 --2- 172.21.15.78:0/2653730825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04601536f0 0x7f046013d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:37.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f045ea00640 1 -- 172.21.15.78:0/2653730825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0460151760 con 0x7f04600c76f0 2024-05-21T14:45:37.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.171+0000 7f0456000640 1 --2- 172.21.15.78:0/2653730825 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f04600c7b00 0x7f0460159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:45:37.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.175+0000 7f045ea00640 1 --2- 172.21.15.78:0/2653730825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04600c76f0 0x7f0460157a50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f045000c3f0 tx=0x7f045000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:37.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.175+0000 7f0457400640 1 -- 172.21.15.78:0/2653730825 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0450017070 con 0x7f04600c76f0 2024-05-21T14:45:37.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.175+0000 7f0457400640 1 -- 172.21.15.78:0/2653730825 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04500052d0 con 0x7f04600c76f0 2024-05-21T14:45:37.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.175+0000 7f0465a00640 1 -- 172.21.15.78:0/2653730825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0460157f90 con 0x7f04600c76f0 2024-05-21T14:45:37.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.175+0000 7f0457400640 1 -- 172.21.15.78:0/2653730825 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0450003840 con 0x7f04600c76f0 2024-05-21T14:45:37.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.175+0000 7f0465a00640 1 -- 172.21.15.78:0/2653730825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0460156700 con 0x7f04600c76f0 2024-05-21T14:45:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.175+0000 7f0465a00640 1 -- 172.21.15.78:0/2653730825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f046004f730 con 0x7f04600c76f0 2024-05-21T14:45:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.175+0000 7f0457400640 1 -- 172.21.15.78:0/2653730825 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f045001a070 con 0x7f04600c76f0 2024-05-21T14:45:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.175+0000 7f0457400640 1 --2- 172.21.15.78:0/2653730825 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f043c0678f0 0x7f043c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.175+0000 7f0457400640 1 -- 172.21.15.78:0/2653730825 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f0450085140 con 0x7f04600c76f0 2024-05-21T14:45:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.175+0000 7f0456000640 1 --2- 172.21.15.78:0/2653730825 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f043c0678f0 0x7f043c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.179+0000 7f0456000640 1 --2- 172.21.15.78:0/2653730825 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f043c0678f0 0x7f043c069e00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f04480ad000 tx=0x7f0448008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:37.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.179+0000 7f0457400640 1 -- 172.21.15.78:0/2653730825 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f0450005480 con 0x7f04600c76f0 2024-05-21T14:45:37.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.339+0000 7f0465a00640 1 -- 172.21.15.78:0/2653730825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0460156900 con 0x7f04600c76f0 2024-05-21T14:45:37.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.339+0000 7f0457400640 1 -- 172.21.15.78:0/2653730825 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16585 (secure 0 0 0) 0x7f0450055bc0 con 0x7f04600c76f0 2024-05-21T14:45:37.349 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:45:37.350 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:59.799293+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T14:43:17.088549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T14:43:18.012571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:45:37.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.343+0000 7f0465a00640 1 -- 172.21.15.78:0/2653730825 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f043c0678f0 msgr2=0x7f043c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:37.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.343+0000 7f0465a00640 1 --2- 172.21.15.78:0/2653730825 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f043c0678f0 0x7f043c069e00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f04480ad000 tx=0x7f0448008040 comp rx=0 tx=0).stop 2024-05-21T14:45:37.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.343+0000 7f0465a00640 1 -- 172.21.15.78:0/2653730825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04600c76f0 msgr2=0x7f0460157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:37.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.343+0000 7f0465a00640 1 --2- 172.21.15.78:0/2653730825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04600c76f0 0x7f0460157a50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f045000c3f0 tx=0x7f045000c8b0 comp rx=0 tx=0).stop 2024-05-21T14:45:37.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.343+0000 7f0465a00640 1 -- 172.21.15.78:0/2653730825 shutdown_connections 2024-05-21T14:45:37.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.343+0000 7f0465a00640 1 --2- 172.21.15.78:0/2653730825 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f043c0678f0 0x7f043c069e00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:37.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.343+0000 7f0465a00640 1 --2- 172.21.15.78:0/2653730825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04601536f0 0x7f046013d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:37.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.343+0000 7f0465a00640 1 --2- 172.21.15.78:0/2653730825 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f04600c7b00 0x7f0460159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:37.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.343+0000 7f0465a00640 1 --2- 172.21.15.78:0/2653730825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04600c76f0 0x7f0460157a50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:37.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.343+0000 7f0465a00640 1 -- 172.21.15.78:0/2653730825 >> 172.21.15.78:0/2653730825 conn(0x7f04600cacb0 msgr2=0x7f0460152800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:37.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.343+0000 7f0465a00640 1 -- 172.21.15.78:0/2653730825 shutdown_connections 2024-05-21T14:45:37.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:37.343+0000 7f0465a00640 1 -- 172.21.15.78:0/2653730825 wait complete. 2024-05-21T14:45:38.372 INFO:tasks.ceph:Scrubbing osd.0 2024-05-21T14:45:38.373 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-21T14:45:38.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.519+0000 7f1d7c200640 1 Processor -- start 2024-05-21T14:45:38.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.519+0000 7f1d7c200640 1 -- start start 2024-05-21T14:45:38.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.523+0000 7f1d7c200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1d740c4ef0 0x7f1d74158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:38.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.523+0000 7f1d7c200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1d740c35f0 0x7f1d740c5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:38.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.523+0000 7f1d7c200640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d740c3a00 con 0x7f1d7414e9b0 2024-05-21T14:45:38.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.523+0000 7f1d7c200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f1d740c8a80 con 0x7f1d740c4ef0 2024-05-21T14:45:38.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.523+0000 7f1d7c200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f1d740c8d20 con 0x7f1d740c35f0 2024-05-21T14:45:38.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.523+0000 7f1d7a200640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1d7414e9b0 0x7f1d7406b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53220/0 (socket says 172.21.15.78:53220) 2024-05-21T14:45:38.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.523+0000 7f1d79800640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1d740c4ef0 0x7f1d74158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:38.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.523+0000 7f1d7a200640 1 -- 172.21.15.78:0/2795736542 learned_addr learned my addr 172.21.15.78:0/2795736542 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:45:38.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.523+0000 7f1d78e00640 1 --2- 172.21.15.78:0/2795736542 >> v2:172.21.15.84:3300/0 conn(0x7f1d740c35f0 0x7f1d740c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:38.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.523+0000 7f1d79800640 1 -- 172.21.15.78:0/2795736542 >> v2:172.21.15.84:3300/0 conn(0x7f1d740c35f0 msgr2=0x7f1d740c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:38.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.523+0000 7f1d79800640 1 --2- 172.21.15.78:0/2795736542 >> v2:172.21.15.84:3300/0 conn(0x7f1d740c35f0 0x7f1d740c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.523+0000 7f1d79800640 1 -- 172.21.15.78:0/2795736542 >> v1:172.21.15.78:6789/0 conn(0x7f1d7414e9b0 legacy=0x7f1d7406b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:38.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.523+0000 7f1d79800640 1 -- 172.21.15.78:0/2795736542 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d74157d20 con 0x7f1d740c4ef0 2024-05-21T14:45:38.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.527+0000 7f1d79800640 1 --2- 172.21.15.78:0/2795736542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d740c4ef0 0x7f1d74158800 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1d740cd8d0 tx=0x7f1d6801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55326c3dedf861e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:38.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.527+0000 7f1d73e00640 1 -- 172.21.15.78:0/2795736542 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d680b0070 con 0x7f1d740c4ef0 2024-05-21T14:45:38.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.527+0000 7f1d73e00640 1 -- 172.21.15.78:0/2795736542 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d680ab600 con 0x7f1d740c4ef0 2024-05-21T14:45:38.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.527+0000 7f1d73e00640 1 -- 172.21.15.78:0/2795736542 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d680ab9d0 con 0x7f1d740c4ef0 2024-05-21T14:45:38.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.527+0000 7f1d7c200640 1 -- 172.21.15.78:0/2795736542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d740c4ef0 msgr2=0x7f1d74158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:38.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.527+0000 7f1d7c200640 1 --2- 172.21.15.78:0/2795736542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d740c4ef0 0x7f1d74158800 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1d740cd8d0 tx=0x7f1d6801c480 comp rx=0 tx=0).stop 2024-05-21T14:45:38.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.527+0000 7f1d7c200640 1 -- 172.21.15.78:0/2795736542 shutdown_connections 2024-05-21T14:45:38.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.527+0000 7f1d7c200640 1 --2- 172.21.15.78:0/2795736542 >> v2:172.21.15.84:3300/0 conn(0x7f1d740c35f0 0x7f1d740c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.527+0000 7f1d7c200640 1 --2- 172.21.15.78:0/2795736542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d740c4ef0 0x7f1d74158800 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.527+0000 7f1d7c200640 1 -- 172.21.15.78:0/2795736542 >> 172.21.15.78:0/2795736542 conn(0x7f1d740cd1d0 msgr2=0x7f1d740c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:38.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.527+0000 7f1d7c200640 1 -- 172.21.15.78:0/2795736542 shutdown_connections 2024-05-21T14:45:38.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.527+0000 7f1d7c200640 1 -- 172.21.15.78:0/2795736542 wait complete. 2024-05-21T14:45:38.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d7c200640 1 Processor -- start 2024-05-21T14:45:38.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d7c200640 1 -- start start 2024-05-21T14:45:38.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d7c200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d740c35f0 0x7f1d74157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:38.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d7c200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d740c4ef0 0x7f1d74164660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:38.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d7c200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d7414e9b0 0x7f1d741eb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:38.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d7c200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7406bd30 con 0x7f1d740c4ef0 2024-05-21T14:45:38.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d7c200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7414edc0 con 0x7f1d7414e9b0 2024-05-21T14:45:38.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d7c200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1d7406beb0 con 0x7f1d740c35f0 2024-05-21T14:45:38.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d78e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d740c4ef0 0x7f1d74164660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:38.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d78e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d740c4ef0 0x7f1d74164660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49736/0 (socket says 172.21.15.78:49736) 2024-05-21T14:45:38.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d78e00640 1 -- 172.21.15.78:0/550310324 learned_addr learned my addr 172.21.15.78:0/550310324 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:38.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d7a200640 1 --2- 172.21.15.78:0/550310324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d7414e9b0 0x7f1d741eb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:38.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d79800640 1 --2- 172.21.15.78:0/550310324 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d740c35f0 0x7f1d74157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:38.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d78e00640 1 -- 172.21.15.78:0/550310324 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d740c35f0 msgr2=0x7f1d74157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:38.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d78e00640 1 --2- 172.21.15.78:0/550310324 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d740c35f0 0x7f1d74157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d78e00640 1 -- 172.21.15.78:0/550310324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d7414e9b0 msgr2=0x7f1d741eb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:38.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d78e00640 1 --2- 172.21.15.78:0/550310324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d7414e9b0 0x7f1d741eb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d78e00640 1 -- 172.21.15.78:0/550310324 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d741665b0 con 0x7f1d740c4ef0 2024-05-21T14:45:38.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d78e00640 1 --2- 172.21.15.78:0/550310324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d740c4ef0 0x7f1d74164660 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000d620 tx=0x7f1d6000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:38.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d71600640 1 -- 172.21.15.78:0/550310324 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000b620 con 0x7f1d740c4ef0 2024-05-21T14:45:38.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d71600640 1 -- 172.21.15.78:0/550310324 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d60019070 con 0x7f1d740c4ef0 2024-05-21T14:45:38.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d71600640 1 -- 172.21.15.78:0/550310324 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000b9e0 con 0x7f1d740c4ef0 2024-05-21T14:45:38.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d7c200640 1 -- 172.21.15.78:0/550310324 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d741f4e70 con 0x7f1d740c4ef0 2024-05-21T14:45:38.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.531+0000 7f1d7c200640 1 -- 172.21.15.78:0/550310324 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d741f5430 con 0x7f1d740c4ef0 2024-05-21T14:45:38.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.535+0000 7f1d7c200640 1 -- 172.21.15.78:0/550310324 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1d74164ba0 con 0x7f1d740c4ef0 2024-05-21T14:45:38.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.535+0000 7f1d71600640 1 -- 172.21.15.78:0/550310324 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d6000bb80 con 0x7f1d740c4ef0 2024-05-21T14:45:38.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.535+0000 7f1d71600640 1 --2- 172.21.15.78:0/550310324 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1d540678c0 0x7f1d54069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:38.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.535+0000 7f1d71600640 1 -- 172.21.15.78:0/550310324 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f1d60086150 con 0x7f1d740c4ef0 2024-05-21T14:45:38.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.535+0000 7f1d71600640 1 --2- 172.21.15.78:0/550310324 >> [v2:172.21.15.78:6800/2618175314,v1:172.21.15.78:6801/2618175314] conn(0x7f1d5406fb70 0x7f1d54071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:38.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.535+0000 7f1d71600640 1 -- 172.21.15.78:0/550310324 --> [v2:172.21.15.78:6800/2618175314,v1:172.21.15.78:6801/2618175314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d540726b0 con 0x7f1d5406fb70 2024-05-21T14:45:38.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.535+0000 7f1d71600640 1 -- 172.21.15.78:0/550310324 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1d6008d050 con 0x7f1d740c4ef0 2024-05-21T14:45:38.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.535+0000 7f1d79800640 1 --2- 172.21.15.78:0/550310324 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1d540678c0 0x7f1d54069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:38.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.535+0000 7f1d7a200640 1 --2- 172.21.15.78:0/550310324 >> [v2:172.21.15.78:6800/2618175314,v1:172.21.15.78:6801/2618175314] conn(0x7f1d5406fb70 0x7f1d54071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:38.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.535+0000 7f1d7a200640 1 --2- 172.21.15.78:0/550310324 >> [v2:172.21.15.78:6800/2618175314,v1:172.21.15.78:6801/2618175314] conn(0x7f1d5406fb70 0x7f1d54071fe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:38.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.535+0000 7f1d79800640 1 --2- 172.21.15.78:0/550310324 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1d540678c0 0x7f1d54069dd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1d680ad000 tx=0x7f1d680a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:38.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.539+0000 7f1d71600640 1 -- 172.21.15.78:0/550310324 <== osd.0 v2:172.21.15.78:6800/2618175314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1d540726b0 con 0x7f1d5406fb70 2024-05-21T14:45:38.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.551+0000 7f1d7c200640 1 -- 172.21.15.78:0/550310324 --> [v2:172.21.15.78:6800/2618175314,v1:172.21.15.78:6801/2618175314] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1d7404f730 con 0x7f1d5406fb70 2024-05-21T14:45:38.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.551+0000 7f1d71600640 1 -- 172.21.15.78:0/550310324 <== osd.0 v2:172.21.15.78:6800/2618175314 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1d7404f730 con 0x7f1d5406fb70 2024-05-21T14:45:38.560 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-05-21T14:45:38.560 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T14:45:38.560 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-05-21T14:45:38.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.551+0000 7f1d7c200640 1 -- 172.21.15.78:0/550310324 >> [v2:172.21.15.78:6800/2618175314,v1:172.21.15.78:6801/2618175314] conn(0x7f1d5406fb70 msgr2=0x7f1d54071fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:38.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.551+0000 7f1d7c200640 1 --2- 172.21.15.78:0/550310324 >> [v2:172.21.15.78:6800/2618175314,v1:172.21.15.78:6801/2618175314] conn(0x7f1d5406fb70 0x7f1d54071fe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.551+0000 7f1d7c200640 1 -- 172.21.15.78:0/550310324 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1d540678c0 msgr2=0x7f1d54069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:38.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.551+0000 7f1d7c200640 1 --2- 172.21.15.78:0/550310324 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1d540678c0 0x7f1d54069dd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1d680ad000 tx=0x7f1d680a6000 comp rx=0 tx=0).stop 2024-05-21T14:45:38.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.551+0000 7f1d7c200640 1 -- 172.21.15.78:0/550310324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d740c4ef0 msgr2=0x7f1d74164660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:38.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.551+0000 7f1d7c200640 1 --2- 172.21.15.78:0/550310324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d740c4ef0 0x7f1d74164660 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000d620 tx=0x7f1d6000dae0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.551+0000 7f1d7a200640 1 -- 172.21.15.78:0/550310324 reap_dead start 2024-05-21T14:45:38.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.551+0000 7f1d7c200640 1 -- 172.21.15.78:0/550310324 shutdown_connections 2024-05-21T14:45:38.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.551+0000 7f1d7c200640 1 -- 172.21.15.78:0/550310324 >> 172.21.15.78:0/550310324 conn(0x7f1d740cd1d0 msgr2=0x7f1d74160f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:38.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.551+0000 7f1d7c200640 1 -- 172.21.15.78:0/550310324 shutdown_connections 2024-05-21T14:45:38.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.551+0000 7f1d7c200640 1 -- 172.21.15.78:0/550310324 wait complete. 2024-05-21T14:45:38.579 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-21T14:45:38.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.715+0000 7f0949200640 1 Processor -- start 2024-05-21T14:45:38.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f0949200640 1 -- start start 2024-05-21T14:45:38.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f0949200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f09440733d0 0x7f0944071910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:38.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f0949200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f09441527a0 0x7f09440c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:38.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f0949200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f09440c5980 0x7f094415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:38.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f0949200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f0944072980 con 0x7f09441527a0 2024-05-21T14:45:38.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f0949200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f0944072f40 con 0x7f09440733d0 2024-05-21T14:45:38.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f0949200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0944071e50 con 0x7f09440c5980 2024-05-21T14:45:38.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f093be00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f09441527a0 0x7f09440c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:38.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f093be00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f09441527a0 0x7f09440c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49750/0 (socket says 172.21.15.78:49750) 2024-05-21T14:45:38.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f093be00640 1 -- 172.21.15.78:0/4187094820 learned_addr learned my addr 172.21.15.78:0/4187094820 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:38.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f0941e00640 1 --2- 172.21.15.78:0/4187094820 >> v2:172.21.15.84:3300/0 conn(0x7f09440733d0 0x7f0944071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:38.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f0942800640 1 --2- 172.21.15.78:0/4187094820 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f09440c5980 0x7f094415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:38.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f093be00640 1 -- 172.21.15.78:0/4187094820 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f09440c5980 msgr2=0x7f094415bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:38.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f093be00640 1 --2- 172.21.15.78:0/4187094820 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f09440c5980 0x7f094415bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f093be00640 1 -- 172.21.15.78:0/4187094820 >> v2:172.21.15.84:3300/0 conn(0x7f09440733d0 msgr2=0x7f0944071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:38.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f093be00640 1 --2- 172.21.15.78:0/4187094820 >> v2:172.21.15.84:3300/0 conn(0x7f09440733d0 0x7f0944071910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f093be00640 1 -- 172.21.15.78:0/4187094820 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09440737e0 con 0x7f09441527a0 2024-05-21T14:45:38.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.719+0000 7f0941e00640 1 --2- 172.21.15.78:0/4187094820 >> v2:172.21.15.84:3300/0 conn(0x7f09440733d0 0x7f0944071910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:45:38.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.723+0000 7f093be00640 1 --2- 172.21.15.78:0/4187094820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09441527a0 0x7f09440c5440 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0944070300 tx=0x7f092c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7ad9e337043145 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:38.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.723+0000 7f0941400640 1 -- 172.21.15.78:0/4187094820 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c0b5070 con 0x7f09441527a0 2024-05-21T14:45:38.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.723+0000 7f0941400640 1 -- 172.21.15.78:0/4187094820 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f092c0a89d0 con 0x7f09441527a0 2024-05-21T14:45:38.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.723+0000 7f0941400640 1 -- 172.21.15.78:0/4187094820 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c0a8da0 con 0x7f09441527a0 2024-05-21T14:45:38.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.723+0000 7f0949200640 1 -- 172.21.15.78:0/4187094820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09441527a0 msgr2=0x7f09440c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:38.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.723+0000 7f0949200640 1 --2- 172.21.15.78:0/4187094820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09441527a0 0x7f09440c5440 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0944070300 tx=0x7f092c01ed10 comp rx=0 tx=0).stop 2024-05-21T14:45:38.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.723+0000 7f0949200640 1 -- 172.21.15.78:0/4187094820 shutdown_connections 2024-05-21T14:45:38.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.723+0000 7f0949200640 1 --2- 172.21.15.78:0/4187094820 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f09440c5980 0x7f094415bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.723+0000 7f0949200640 1 --2- 172.21.15.78:0/4187094820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09441527a0 0x7f09440c5440 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.723+0000 7f0949200640 1 --2- 172.21.15.78:0/4187094820 >> v2:172.21.15.84:3300/0 conn(0x7f09440733d0 0x7f0944071910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.723+0000 7f0949200640 1 -- 172.21.15.78:0/4187094820 >> 172.21.15.78:0/4187094820 conn(0x7f09440cd1e0 msgr2=0x7f09440c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:38.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.723+0000 7f0949200640 1 -- 172.21.15.78:0/4187094820 shutdown_connections 2024-05-21T14:45:38.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.723+0000 7f0949200640 1 -- 172.21.15.78:0/4187094820 wait complete. 2024-05-21T14:45:38.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0949200640 1 Processor -- start 2024-05-21T14:45:38.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0949200640 1 -- start start 2024-05-21T14:45:38.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0949200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09440733d0 0x7f09441f1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:38.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0949200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09440c5980 0x7f0944150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0949200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f09441527a0 0x7f094414c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0949200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0944074060 con 0x7f09440733d0 2024-05-21T14:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0949200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0944073d80 con 0x7f09440c5980 2024-05-21T14:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0949200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0944072bd0 con 0x7f09441527a0 2024-05-21T14:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0941e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09440733d0 0x7f09441f1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0941e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09440733d0 0x7f09441f1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49764/0 (socket says 172.21.15.78:49764) 2024-05-21T14:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0941e00640 1 -- 172.21.15.78:0/4233122858 learned_addr learned my addr 172.21.15.78:0/4233122858 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0942800640 1 --2- 172.21.15.78:0/4233122858 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f09441527a0 0x7f094414c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f093be00640 1 --2- 172.21.15.78:0/4233122858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09440c5980 0x7f0944150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0941e00640 1 -- 172.21.15.78:0/4233122858 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f09441527a0 msgr2=0x7f094414c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0941e00640 1 --2- 172.21.15.78:0/4233122858 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f09441527a0 0x7f094414c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0941e00640 1 -- 172.21.15.78:0/4233122858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09440c5980 msgr2=0x7f0944150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:38.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0941e00640 1 --2- 172.21.15.78:0/4233122858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09440c5980 0x7f0944150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0941e00640 1 -- 172.21.15.78:0/4233122858 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0944071aa0 con 0x7f09440733d0 2024-05-21T14:45:38.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0941e00640 1 --2- 172.21.15.78:0/4233122858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09440733d0 0x7f09441f1f70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f093400d830 tx=0x7f093400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:38.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f093a000640 1 -- 172.21.15.78:0/4233122858 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0934018030 con 0x7f09440733d0 2024-05-21T14:45:38.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f093a000640 1 -- 172.21.15.78:0/4233122858 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093400be00 con 0x7f09440733d0 2024-05-21T14:45:38.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0949200640 1 -- 172.21.15.78:0/4233122858 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09440cc3e0 con 0x7f09440733d0 2024-05-21T14:45:38.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f093a000640 1 -- 172.21.15.78:0/4233122858 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09340098b0 con 0x7f09440733d0 2024-05-21T14:45:38.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.727+0000 7f0949200640 1 -- 172.21.15.78:0/4233122858 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09441f5580 con 0x7f09440733d0 2024-05-21T14:45:38.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.731+0000 7f0949200640 1 -- 172.21.15.78:0/4233122858 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0944157de0 con 0x7f09440733d0 2024-05-21T14:45:38.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.731+0000 7f093a000640 1 -- 172.21.15.78:0/4233122858 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f093401b070 con 0x7f09440733d0 2024-05-21T14:45:38.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.731+0000 7f093a000640 1 --2- 172.21.15.78:0/4233122858 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f09200678f0 0x7f0920069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:38.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.731+0000 7f093a000640 1 -- 172.21.15.78:0/4233122858 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f0934085d50 con 0x7f09440733d0 2024-05-21T14:45:38.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.731+0000 7f093be00640 1 --2- 172.21.15.78:0/4233122858 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f09200678f0 0x7f0920069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:38.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.735+0000 7f093be00640 1 --2- 172.21.15.78:0/4233122858 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f09200678f0 0x7f0920069e00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f092c0b2000 tx=0x7f092c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:38.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.735+0000 7f093a000640 1 -- 172.21.15.78:0/4233122858 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f0944157de0 con 0x7f09440733d0 2024-05-21T14:45:38.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.891+0000 7f0949200640 1 -- 172.21.15.78:0/4233122858 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f09440c8a20 con 0x7f09200678f0 2024-05-21T14:45:38.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.891+0000 7f093a000640 1 -- 172.21.15.78:0/4233122858 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f09440c8a20 con 0x7f09200678f0 2024-05-21T14:45:38.901 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 0 to deep-scrub 2024-05-21T14:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.895+0000 7f0949200640 1 -- 172.21.15.78:0/4233122858 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f09200678f0 msgr2=0x7f0920069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.895+0000 7f0949200640 1 --2- 172.21.15.78:0/4233122858 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f09200678f0 0x7f0920069e00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f092c0b2000 tx=0x7f092c009040 comp rx=0 tx=0).stop 2024-05-21T14:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.895+0000 7f0949200640 1 -- 172.21.15.78:0/4233122858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09440733d0 msgr2=0x7f09441f1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.895+0000 7f0949200640 1 --2- 172.21.15.78:0/4233122858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09440733d0 0x7f09441f1f70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f093400d830 tx=0x7f093400dcf0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.895+0000 7f0949200640 1 -- 172.21.15.78:0/4233122858 shutdown_connections 2024-05-21T14:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.895+0000 7f0949200640 1 --2- 172.21.15.78:0/4233122858 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f09200678f0 0x7f0920069e00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.895+0000 7f0949200640 1 --2- 172.21.15.78:0/4233122858 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f09441527a0 0x7f094414c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.895+0000 7f0949200640 1 --2- 172.21.15.78:0/4233122858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09440c5980 0x7f0944150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.895+0000 7f0949200640 1 --2- 172.21.15.78:0/4233122858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09440733d0 0x7f09441f1f70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.895+0000 7f0949200640 1 -- 172.21.15.78:0/4233122858 >> 172.21.15.78:0/4233122858 conn(0x7f09440cd1e0 msgr2=0x7f09440c7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.895+0000 7f0949200640 1 -- 172.21.15.78:0/4233122858 shutdown_connections 2024-05-21T14:45:38.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:38.895+0000 7f0949200640 1 -- 172.21.15.78:0/4233122858 wait complete. 2024-05-21T14:45:38.923 INFO:tasks.ceph:Scrubbing osd.1 2024-05-21T14:45:38.924 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-21T14:45:39.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.063+0000 7ff424400640 1 Processor -- start 2024-05-21T14:45:39.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.063+0000 7ff424400640 1 -- start start 2024-05-21T14:45:39.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.067+0000 7ff424400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff41c074150 0x7ff41c0c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.067+0000 7ff424400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff41c152960 0x7ff41c0c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.067+0000 7ff424400640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff41c071530 con 0x7ff41c073340 2024-05-21T14:45:39.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.067+0000 7ff424400640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7ff41c0712e0 con 0x7ff41c152960 2024-05-21T14:45:39.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.067+0000 7ff424400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff41c158f10 con 0x7ff41c074150 2024-05-21T14:45:39.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.067+0000 7ff421000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff41c152960 0x7ff41c0c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.067+0000 7ff422400640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff41c073340 0x7ff41c073750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53234/0 (socket says 172.21.15.78:53234) 2024-05-21T14:45:39.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.067+0000 7ff422400640 1 -- 172.21.15.78:0/847015458 learned_addr learned my addr 172.21.15.78:0/847015458 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:45:39.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.067+0000 7ff421a00640 1 --2- 172.21.15.78:0/847015458 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff41c074150 0x7ff41c0c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.067+0000 7ff421000640 1 -- 172.21.15.78:0/847015458 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff41c074150 msgr2=0x7ff41c0c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:39.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.067+0000 7ff421000640 1 --2- 172.21.15.78:0/847015458 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff41c074150 0x7ff41c0c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.067+0000 7ff421000640 1 -- 172.21.15.78:0/847015458 >> v1:172.21.15.78:6789/0 conn(0x7ff41c073340 legacy=0x7ff41c073750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.067+0000 7ff41be00640 1 -- 172.21.15.78:0/847015458 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2487681008 0 0) 0x7ff41c071530 con 0x7ff41c073340 2024-05-21T14:45:39.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.067+0000 7ff421000640 1 -- 172.21.15.78:0/847015458 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41c159160 con 0x7ff41c152960 2024-05-21T14:45:39.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.071+0000 7ff421000640 1 --2- 172.21.15.78:0/847015458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff41c152960 0x7ff41c0c4fb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff41c071460 tx=0x7ff40801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52454e4c3f1b229a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:39.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.071+0000 7ff41be00640 1 -- 172.21.15.78:0/847015458 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4080b0070 con 0x7ff41c152960 2024-05-21T14:45:39.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.071+0000 7ff41be00640 1 -- 172.21.15.78:0/847015458 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4080ab600 con 0x7ff41c152960 2024-05-21T14:45:39.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.071+0000 7ff41be00640 1 -- 172.21.15.78:0/847015458 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4080ab9d0 con 0x7ff41c152960 2024-05-21T14:45:39.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.071+0000 7ff424400640 1 -- 172.21.15.78:0/847015458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff41c152960 msgr2=0x7ff41c0c4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.071+0000 7ff424400640 1 --2- 172.21.15.78:0/847015458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff41c152960 0x7ff41c0c4fb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff41c071460 tx=0x7ff40801c380 comp rx=0 tx=0).stop 2024-05-21T14:45:39.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.071+0000 7ff424400640 1 -- 172.21.15.78:0/847015458 shutdown_connections 2024-05-21T14:45:39.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.071+0000 7ff424400640 1 --2- 172.21.15.78:0/847015458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff41c152960 0x7ff41c0c4fb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.071+0000 7ff424400640 1 --2- 172.21.15.78:0/847015458 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff41c074150 0x7ff41c0c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.071+0000 7ff424400640 1 -- 172.21.15.78:0/847015458 >> 172.21.15.78:0/847015458 conn(0x7ff41c0cd1d0 msgr2=0x7ff41c0c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:39.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.071+0000 7ff424400640 1 -- 172.21.15.78:0/847015458 shutdown_connections 2024-05-21T14:45:39.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.071+0000 7ff424400640 1 -- 172.21.15.78:0/847015458 wait complete. 2024-05-21T14:45:39.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff424400640 1 Processor -- start 2024-05-21T14:45:39.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff424400640 1 -- start start 2024-05-21T14:45:39.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff424400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff41c073340 0x7ff41c14bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff424400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff41c074150 0x7ff41c146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff424400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff41c152960 0x7ff41c13f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff424400640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c1656d0 con 0x7ff41c073340 2024-05-21T14:45:39.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff424400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c165550 con 0x7ff41c074150 2024-05-21T14:45:39.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff424400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff41c165850 con 0x7ff41c152960 2024-05-21T14:45:39.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff421a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff41c073340 0x7ff41c14bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff421a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff41c073340 0x7ff41c14bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49790/0 (socket says 172.21.15.78:49790) 2024-05-21T14:45:39.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff421a00640 1 -- 172.21.15.78:0/2459560108 learned_addr learned my addr 172.21.15.78:0/2459560108 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:39.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff421000640 1 --2- 172.21.15.78:0/2459560108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff41c074150 0x7ff41c146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff422400640 1 --2- 172.21.15.78:0/2459560108 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff41c152960 0x7ff41c13f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff421a00640 1 -- 172.21.15.78:0/2459560108 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff41c152960 msgr2=0x7ff41c13f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff421a00640 1 --2- 172.21.15.78:0/2459560108 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff41c152960 0x7ff41c13f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff421a00640 1 -- 172.21.15.78:0/2459560108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff41c074150 msgr2=0x7ff41c146a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff421a00640 1 --2- 172.21.15.78:0/2459560108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff41c074150 0x7ff41c146a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff421a00640 1 -- 172.21.15.78:0/2459560108 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41c146f50 con 0x7ff41c073340 2024-05-21T14:45:39.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff421000640 1 --2- 172.21.15.78:0/2459560108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff41c074150 0x7ff41c146a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:45:39.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff422400640 1 --2- 172.21.15.78:0/2459560108 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff41c152960 0x7ff41c13f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:45:39.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff421a00640 1 --2- 172.21.15.78:0/2459560108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff41c073340 0x7ff41c14bb60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff410009d10 tx=0x7ff41000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:39.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff419600640 1 -- 172.21.15.78:0/2459560108 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410018020 con 0x7ff41c073340 2024-05-21T14:45:39.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff419600640 1 -- 172.21.15.78:0/2459560108 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff410014480 con 0x7ff41c073340 2024-05-21T14:45:39.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff424400640 1 -- 172.21.15.78:0/2459560108 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41c140ea0 con 0x7ff41c073340 2024-05-21T14:45:39.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff419600640 1 -- 172.21.15.78:0/2459560108 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410014830 con 0x7ff41c073340 2024-05-21T14:45:39.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff424400640 1 -- 172.21.15.78:0/2459560108 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff41c141400 con 0x7ff41c073340 2024-05-21T14:45:39.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.075+0000 7ff424400640 1 -- 172.21.15.78:0/2459560108 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff41c04f730 con 0x7ff41c073340 2024-05-21T14:45:39.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.079+0000 7ff419600640 1 -- 172.21.15.78:0/2459560108 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff41001b020 con 0x7ff41c073340 2024-05-21T14:45:39.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.079+0000 7ff419600640 1 --2- 172.21.15.78:0/2459560108 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff3fc0678f0 0x7ff3fc069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.079+0000 7ff419600640 1 -- 172.21.15.78:0/2459560108 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7ff410086ff0 con 0x7ff41c073340 2024-05-21T14:45:39.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.079+0000 7ff419600640 1 --2- 172.21.15.78:0/2459560108 >> [v2:172.21.15.78:6824/840893414,v1:172.21.15.78:6825/840893414] conn(0x7ff3fc06fba0 0x7ff3fc072010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.079+0000 7ff419600640 1 -- 172.21.15.78:0/2459560108 --> [v2:172.21.15.78:6824/840893414,v1:172.21.15.78:6825/840893414] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff41000be50 con 0x7ff3fc06fba0 2024-05-21T14:45:39.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.079+0000 7ff419600640 1 -- 172.21.15.78:0/2459560108 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff4100873a0 con 0x7ff41c073340 2024-05-21T14:45:39.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.079+0000 7ff421000640 1 --2- 172.21.15.78:0/2459560108 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff3fc0678f0 0x7ff3fc069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.079+0000 7ff422400640 1 --2- 172.21.15.78:0/2459560108 >> [v2:172.21.15.78:6824/840893414,v1:172.21.15.78:6825/840893414] conn(0x7ff3fc06fba0 0x7ff3fc072010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.079+0000 7ff422400640 1 --2- 172.21.15.78:0/2459560108 >> [v2:172.21.15.78:6824/840893414,v1:172.21.15.78:6825/840893414] conn(0x7ff3fc06fba0 0x7ff3fc072010 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:39.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.079+0000 7ff421000640 1 --2- 172.21.15.78:0/2459560108 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff3fc0678f0 0x7ff3fc069e00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff4080ad000 tx=0x7ff408008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:39.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.079+0000 7ff419600640 1 -- 172.21.15.78:0/2459560108 <== osd.1 v2:172.21.15.78:6824/840893414 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff41000be50 con 0x7ff3fc06fba0 2024-05-21T14:45:39.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.095+0000 7ff424400640 1 -- 172.21.15.78:0/2459560108 --> [v2:172.21.15.78:6824/840893414,v1:172.21.15.78:6825/840893414] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff41c0c4850 con 0x7ff3fc06fba0 2024-05-21T14:45:39.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.095+0000 7ff419600640 1 -- 172.21.15.78:0/2459560108 <== osd.1 v2:172.21.15.78:6824/840893414 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff41c0c4850 con 0x7ff3fc06fba0 2024-05-21T14:45:39.104 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-05-21T14:45:39.105 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T14:45:39.105 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-05-21T14:45:39.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.095+0000 7ff424400640 1 -- 172.21.15.78:0/2459560108 >> [v2:172.21.15.78:6824/840893414,v1:172.21.15.78:6825/840893414] conn(0x7ff3fc06fba0 msgr2=0x7ff3fc072010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.095+0000 7ff424400640 1 --2- 172.21.15.78:0/2459560108 >> [v2:172.21.15.78:6824/840893414,v1:172.21.15.78:6825/840893414] conn(0x7ff3fc06fba0 0x7ff3fc072010 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.095+0000 7ff424400640 1 -- 172.21.15.78:0/2459560108 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff3fc0678f0 msgr2=0x7ff3fc069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.095+0000 7ff424400640 1 --2- 172.21.15.78:0/2459560108 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7ff3fc0678f0 0x7ff3fc069e00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff4080ad000 tx=0x7ff408008040 comp rx=0 tx=0).stop 2024-05-21T14:45:39.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.095+0000 7ff424400640 1 -- 172.21.15.78:0/2459560108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff41c073340 msgr2=0x7ff41c14bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.095+0000 7ff424400640 1 --2- 172.21.15.78:0/2459560108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff41c073340 0x7ff41c14bb60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff410009d10 tx=0x7ff41000c490 comp rx=0 tx=0).stop 2024-05-21T14:45:39.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.095+0000 7ff422400640 1 -- 172.21.15.78:0/2459560108 reap_dead start 2024-05-21T14:45:39.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.095+0000 7ff424400640 1 -- 172.21.15.78:0/2459560108 shutdown_connections 2024-05-21T14:45:39.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.095+0000 7ff424400640 1 -- 172.21.15.78:0/2459560108 >> 172.21.15.78:0/2459560108 conn(0x7ff41c0cd1d0 msgr2=0x7ff41c145850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:39.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.095+0000 7ff424400640 1 -- 172.21.15.78:0/2459560108 shutdown_connections 2024-05-21T14:45:39.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.095+0000 7ff424400640 1 -- 172.21.15.78:0/2459560108 wait complete. 2024-05-21T14:45:39.123 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-21T14:45:39.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.259+0000 7f4610e00640 1 Processor -- start 2024-05-21T14:45:39.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.259+0000 7f4610e00640 1 -- start start 2024-05-21T14:45:39.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4610e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f460c0717e0 0x7f460c163610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4610e00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f460c0c8a60 con 0x7f460c072d40 2024-05-21T14:45:39.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4610e00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f460c0c8d40 con 0x7f460c0713d0 2024-05-21T14:45:39.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4610e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f460c157e90 con 0x7f460c0717e0 2024-05-21T14:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4609e00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f460c072d40 0x7f460c151e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53242/0 (socket says 172.21.15.78:53242) 2024-05-21T14:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4609e00640 1 -- 172.21.15.78:0/927305729 learned_addr learned my addr 172.21.15.78:0/927305729 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f460a800640 1 --2- 172.21.15.78:0/927305729 >> v2:172.21.15.84:3300/0 conn(0x7f460c0717e0 0x7f460c163610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4608a00640 1 -- 172.21.15.78:0/927305729 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3540884491 0 0) 0x7f460c0c8a60 con 0x7f460c072d40 2024-05-21T14:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4608a00640 1 -- 172.21.15.78:0/927305729 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45f0003450 con 0x7f460c072d40 2024-05-21T14:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4608a00640 1 -- 172.21.15.78:0/927305729 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3550110433 0 0) 0x7f460c0c8d40 con 0x7f460c0713d0 2024-05-21T14:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4608a00640 1 -- 172.21.15.78:0/927305729 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f460c0c8a60 con 0x7f460c0713d0 2024-05-21T14:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4608a00640 1 -- 172.21.15.78:0/927305729 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 734965944 0 0) 0x7f45f0003450 con 0x7f460c072d40 2024-05-21T14:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4608a00640 1 -- 172.21.15.78:0/927305729 >> v2:172.21.15.84:3300/0 conn(0x7f460c0717e0 msgr2=0x7f460c163610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4608a00640 1 --2- 172.21.15.78:0/927305729 >> v2:172.21.15.84:3300/0 conn(0x7f460c0717e0 0x7f460c163610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4608a00640 1 -- 172.21.15.78:0/927305729 >> v1:172.21.15.84:6789/0 conn(0x7f460c0713d0 legacy=0x7f460c06b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4608a00640 1 -- 172.21.15.78:0/927305729 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460c158170 con 0x7f460c072d40 2024-05-21T14:45:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4608a00640 1 -- 172.21.15.78:0/927305729 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2088150348 0 0) 0x7f45fc001680 con 0x7f460c072d40 2024-05-21T14:45:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4608a00640 1 -- 172.21.15.78:0/927305729 >> v1:172.21.15.78:6789/0 conn(0x7f460c072d40 legacy=0x7f460c151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4608a00640 1 --2- 172.21.15.78:0/927305729 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45f0003cb0 0x7f45f0008860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4608a00640 1 --2- 172.21.15.78:0/927305729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45f0008da0 0x7f45f000b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4608a00640 1 --2- 172.21.15.78:0/927305729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45f000b700 0x7f45f000db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4608a00640 1 -- 172.21.15.78:0/927305729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f460c157e90 con 0x7f45f000b700 2024-05-21T14:45:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4608a00640 1 -- 172.21.15.78:0/927305729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f45f000e3b0 con 0x7f45f0008da0 2024-05-21T14:45:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4608a00640 1 -- 172.21.15.78:0/927305729 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f45f000e5b0 con 0x7f45f0003cb0 2024-05-21T14:45:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f460a800640 1 --2- 172.21.15.78:0/927305729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45f000b700 0x7f45f000db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4609e00640 1 --2- 172.21.15.78:0/927305729 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45f0003cb0 0x7f45f0008860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4609400640 1 --2- 172.21.15.78:0/927305729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45f0008da0 0x7f45f000b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f460a800640 1 -- 172.21.15.78:0/927305729 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45f0003cb0 msgr2=0x7f45f0008860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f460a800640 1 --2- 172.21.15.78:0/927305729 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45f0003cb0 0x7f45f0008860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f460a800640 1 -- 172.21.15.78:0/927305729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45f0008da0 msgr2=0x7f45f000b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f460a800640 1 --2- 172.21.15.78:0/927305729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45f0008da0 0x7f45f000b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f460a800640 1 -- 172.21.15.78:0/927305729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f0003450 con 0x7f45f000b700 2024-05-21T14:45:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.263+0000 7f4609e00640 1 --2- 172.21.15.78:0/927305729 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45f0003cb0 0x7f45f0008860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:45:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.267+0000 7f460a800640 1 -- 172.21.15.78:0/927305729 reap_dead start 2024-05-21T14:45:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.267+0000 7f460a800640 1 --2- 172.21.15.78:0/927305729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45f000b700 0x7f45f000db20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4604009f90 tx=0x7f460401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4bce6c028bb164 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.267+0000 7f4608a00640 1 -- 172.21.15.78:0/927305729 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604009c10 con 0x7f45f000b700 2024-05-21T14:45:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.267+0000 7f4608a00640 1 -- 172.21.15.78:0/927305729 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4604003ba0 con 0x7f45f000b700 2024-05-21T14:45:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.267+0000 7f4608a00640 1 -- 172.21.15.78:0/927305729 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46040a5980 con 0x7f45f000b700 2024-05-21T14:45:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.267+0000 7f4610e00640 1 -- 172.21.15.78:0/927305729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45f000b700 msgr2=0x7f45f000db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.267+0000 7f4610e00640 1 --2- 172.21.15.78:0/927305729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45f000b700 0x7f45f000db20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4604009f90 tx=0x7f460401cc80 comp rx=0 tx=0).stop 2024-05-21T14:45:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.267+0000 7f4610e00640 1 -- 172.21.15.78:0/927305729 shutdown_connections 2024-05-21T14:45:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.267+0000 7f4610e00640 1 --2- 172.21.15.78:0/927305729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45f000b700 0x7f45f000db20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.267+0000 7f4610e00640 1 -- 172.21.15.78:0/927305729 >> 172.21.15.78:0/927305729 conn(0x7f460c0cd1e0 msgr2=0x7f460c0c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.267+0000 7f4610e00640 1 -- 172.21.15.78:0/927305729 shutdown_connections 2024-05-21T14:45:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.267+0000 7f4610e00640 1 -- 172.21.15.78:0/927305729 wait complete. 2024-05-21T14:45:39.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f4610e00640 1 Processor -- start 2024-05-21T14:45:39.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f4610e00640 1 -- start start 2024-05-21T14:45:39.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f4610e00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45f000b700 0x7f460c0c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f4610e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f460c1565b0 0x7f460c14c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f4610e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c14c680 0x7f460c14ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f4610e00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f460c0c8690 con 0x7f460c14c680 2024-05-21T14:45:39.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f4610e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f460c073150 con 0x7f460c1565b0 2024-05-21T14:45:39.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f4610e00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f460c0c8810 con 0x7f45f000b700 2024-05-21T14:45:39.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f460a800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c14c680 0x7f460c14ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f460a800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c14c680 0x7f460c14ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49808/0 (socket says 172.21.15.78:49808) 2024-05-21T14:45:39.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f460a800640 1 -- 172.21.15.78:0/2912671931 learned_addr learned my addr 172.21.15.78:0/2912671931 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:39.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f4609400640 1 --2- 172.21.15.78:0/2912671931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f460c1565b0 0x7f460c14c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f4609e00640 1 --2- 172.21.15.78:0/2912671931 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45f000b700 0x7f460c0c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f460a800640 1 -- 172.21.15.78:0/2912671931 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45f000b700 msgr2=0x7f460c0c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f460a800640 1 --2- 172.21.15.78:0/2912671931 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45f000b700 0x7f460c0c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f460a800640 1 -- 172.21.15.78:0/2912671931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f460c1565b0 msgr2=0x7f460c14c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f460a800640 1 --2- 172.21.15.78:0/2912671931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f460c1565b0 0x7f460c14c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f460a800640 1 -- 172.21.15.78:0/2912671931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460c155ad0 con 0x7f460c14c680 2024-05-21T14:45:39.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f460a800640 1 --2- 172.21.15.78:0/2912671931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c14c680 0x7f460c14ca90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f460401cab0 tx=0x7f4604009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:39.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f4602000640 1 -- 172.21.15.78:0/2912671931 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604004020 con 0x7f460c14c680 2024-05-21T14:45:39.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f4602000640 1 -- 172.21.15.78:0/2912671931 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46040be070 con 0x7f460c14c680 2024-05-21T14:45:39.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f4610e00640 1 -- 172.21.15.78:0/2912671931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460c1f2700 con 0x7f460c14c680 2024-05-21T14:45:39.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f4602000640 1 -- 172.21.15.78:0/2912671931 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604004420 con 0x7f460c14c680 2024-05-21T14:45:39.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.271+0000 7f4610e00640 1 -- 172.21.15.78:0/2912671931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f460c14ba10 con 0x7f460c14c680 2024-05-21T14:45:39.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.275+0000 7f4610e00640 1 -- 172.21.15.78:0/2912671931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f460c155ca0 con 0x7f460c14c680 2024-05-21T14:45:39.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.275+0000 7f4602000640 1 -- 172.21.15.78:0/2912671931 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f46040045c0 con 0x7f460c14c680 2024-05-21T14:45:39.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.275+0000 7f4602000640 1 --2- 172.21.15.78:0/2912671931 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f45ec0678f0 0x7f45ec069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.275+0000 7f4602000640 1 -- 172.21.15.78:0/2912671931 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f4604121450 con 0x7f460c14c680 2024-05-21T14:45:39.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.275+0000 7f4609e00640 1 --2- 172.21.15.78:0/2912671931 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f45ec0678f0 0x7f45ec069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.279+0000 7f4609e00640 1 --2- 172.21.15.78:0/2912671931 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f45ec0678f0 0x7f45ec069e00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f45fc001040 tx=0x7f45fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:39.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.279+0000 7f4602000640 1 -- 172.21.15.78:0/2912671931 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f4604016990 con 0x7f460c14c680 2024-05-21T14:45:39.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.435+0000 7f4610e00640 1 -- 172.21.15.78:0/2912671931 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f460c1f2a30 con 0x7f45ec0678f0 2024-05-21T14:45:39.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.435+0000 7f4602000640 1 -- 172.21.15.78:0/2912671931 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f460c1f2a30 con 0x7f45ec0678f0 2024-05-21T14:45:39.447 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 1 to deep-scrub 2024-05-21T14:45:39.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.439+0000 7f4610e00640 1 -- 172.21.15.78:0/2912671931 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f45ec0678f0 msgr2=0x7f45ec069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.439+0000 7f4610e00640 1 --2- 172.21.15.78:0/2912671931 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f45ec0678f0 0x7f45ec069e00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f45fc001040 tx=0x7f45fc009040 comp rx=0 tx=0).stop 2024-05-21T14:45:39.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.439+0000 7f4610e00640 1 -- 172.21.15.78:0/2912671931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c14c680 msgr2=0x7f460c14ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.439+0000 7f4610e00640 1 --2- 172.21.15.78:0/2912671931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c14c680 0x7f460c14ca90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f460401cab0 tx=0x7f4604009750 comp rx=0 tx=0).stop 2024-05-21T14:45:39.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.439+0000 7f4610e00640 1 -- 172.21.15.78:0/2912671931 shutdown_connections 2024-05-21T14:45:39.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.439+0000 7f4610e00640 1 --2- 172.21.15.78:0/2912671931 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f45ec0678f0 0x7f45ec069e00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.439+0000 7f4610e00640 1 --2- 172.21.15.78:0/2912671931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f460c14c680 0x7f460c14ca90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.439+0000 7f4610e00640 1 --2- 172.21.15.78:0/2912671931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f460c1565b0 0x7f460c14c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.439+0000 7f4610e00640 1 --2- 172.21.15.78:0/2912671931 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45f000b700 0x7f460c0c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.439+0000 7f4610e00640 1 -- 172.21.15.78:0/2912671931 >> 172.21.15.78:0/2912671931 conn(0x7f460c0cd1e0 msgr2=0x7f460c06ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:39.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.439+0000 7f4610e00640 1 -- 172.21.15.78:0/2912671931 shutdown_connections 2024-05-21T14:45:39.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.439+0000 7f4610e00640 1 -- 172.21.15.78:0/2912671931 wait complete. 2024-05-21T14:45:39.468 INFO:tasks.ceph:Scrubbing osd.2 2024-05-21T14:45:39.469 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-21T14:45:39.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.607+0000 7f2282200640 1 Processor -- start 2024-05-21T14:45:39.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.607+0000 7f2282200640 1 -- start start 2024-05-21T14:45:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.611+0000 7f2282200640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f227c074150 0x7f227c0c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.611+0000 7f2282200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f227c152960 0x7f227c0c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.611+0000 7f2282200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f227c073340 0x7f227c073750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.611+0000 7f2282200640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f227c0712e0 con 0x7f227c074150 2024-05-21T14:45:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.611+0000 7f2282200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f227c158f10 con 0x7f227c152960 2024-05-21T14:45:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.611+0000 7f2282200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f227c159440 con 0x7f227c073340 2024-05-21T14:45:39.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.611+0000 7f227b400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f227c074150 0x7f227c0c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.611+0000 7f227b400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f227c074150 0x7f227c0c4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49822/0 (socket says 172.21.15.78:49822) 2024-05-21T14:45:39.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.611+0000 7f227b400640 1 -- 172.21.15.78:0/217903238 learned_addr learned my addr 172.21.15.78:0/217903238 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.611+0000 7f2272a00640 1 --2- 172.21.15.78:0/217903238 >> v2:172.21.15.84:3300/0 conn(0x7f227c152960 0x7f227c0c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.611+0000 7f227be00640 1 --2- 172.21.15.78:0/217903238 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f227c073340 0x7f227c073750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.611+0000 7f227b400640 1 -- 172.21.15.78:0/217903238 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f227c073340 msgr2=0x7f227c073750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.611+0000 7f227b400640 1 --2- 172.21.15.78:0/217903238 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f227c073340 0x7f227c073750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.611+0000 7f227b400640 1 -- 172.21.15.78:0/217903238 >> v2:172.21.15.84:3300/0 conn(0x7f227c152960 msgr2=0x7f227c0c4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.611+0000 7f227b400640 1 --2- 172.21.15.78:0/217903238 >> v2:172.21.15.84:3300/0 conn(0x7f227c152960 0x7f227c0c4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.611+0000 7f227b400640 1 -- 172.21.15.78:0/217903238 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227c071530 con 0x7f227c074150 2024-05-21T14:45:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.611+0000 7f2272a00640 1 --2- 172.21.15.78:0/217903238 >> v2:172.21.15.84:3300/0 conn(0x7f227c152960 0x7f227c0c4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:45:39.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.615+0000 7f227b400640 1 --2- 172.21.15.78:0/217903238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f227c074150 0x7f227c0c4a70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f227c159090 tx=0x7f226c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf15c1817e5298d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:39.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.615+0000 7f227aa00640 1 -- 172.21.15.78:0/217903238 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c0b0070 con 0x7f227c074150 2024-05-21T14:45:39.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.615+0000 7f227aa00640 1 -- 172.21.15.78:0/217903238 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226c0ab600 con 0x7f227c074150 2024-05-21T14:45:39.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.615+0000 7f227aa00640 1 -- 172.21.15.78:0/217903238 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c0ab9d0 con 0x7f227c074150 2024-05-21T14:45:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.615+0000 7f2282200640 1 -- 172.21.15.78:0/217903238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f227c074150 msgr2=0x7f227c0c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.615+0000 7f2282200640 1 --2- 172.21.15.78:0/217903238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f227c074150 0x7f227c0c4a70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f227c159090 tx=0x7f226c01c3a0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.615+0000 7f2282200640 1 -- 172.21.15.78:0/217903238 shutdown_connections 2024-05-21T14:45:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.615+0000 7f2282200640 1 --2- 172.21.15.78:0/217903238 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f227c073340 0x7f227c073750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.615+0000 7f2282200640 1 --2- 172.21.15.78:0/217903238 >> v2:172.21.15.84:3300/0 conn(0x7f227c152960 0x7f227c0c4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.615+0000 7f2282200640 1 --2- 172.21.15.78:0/217903238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f227c074150 0x7f227c0c4a70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.615+0000 7f2282200640 1 -- 172.21.15.78:0/217903238 >> 172.21.15.78:0/217903238 conn(0x7f227c0cd1d0 msgr2=0x7f227c0c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.615+0000 7f2282200640 1 -- 172.21.15.78:0/217903238 shutdown_connections 2024-05-21T14:45:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.615+0000 7f2282200640 1 -- 172.21.15.78:0/217903238 wait complete. 2024-05-21T14:45:39.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f2282200640 1 Processor -- start 2024-05-21T14:45:39.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f2282200640 1 -- start start 2024-05-21T14:45:39.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f2282200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f227c073340 0x7f227c1f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f2282200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f227c074150 0x7f227c0ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f2282200640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f227c152960 0x7f227c14d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f2282200640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f227c0c3810 con 0x7f227c073340 2024-05-21T14:45:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f2282200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f227c0c4570 con 0x7f227c074150 2024-05-21T14:45:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f2282200640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f227c0c3990 con 0x7f227c152960 2024-05-21T14:45:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f227b400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f227c073340 0x7f227c1f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f227b400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f227c073340 0x7f227c1f5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49824/0 (socket says 172.21.15.78:49824) 2024-05-21T14:45:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f227b400640 1 -- 172.21.15.78:0/3437532240 learned_addr learned my addr 172.21.15.78:0/3437532240 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f2272a00640 1 --2- 172.21.15.78:0/3437532240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f227c074150 0x7f227c0ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f227b400640 1 -- 172.21.15.78:0/3437532240 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f227c152960 msgr2=0x7f227c14d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f227b400640 1 --2- 172.21.15.78:0/3437532240 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f227c152960 0x7f227c14d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f227b400640 1 -- 172.21.15.78:0/3437532240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f227c074150 msgr2=0x7f227c0ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f227b400640 1 --2- 172.21.15.78:0/3437532240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f227c074150 0x7f227c0ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f227b400640 1 -- 172.21.15.78:0/3437532240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227c1f5940 con 0x7f227c073340 2024-05-21T14:45:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f227b400640 1 --2- 172.21.15.78:0/3437532240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f227c073340 0x7f227c1f5400 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f226c01aa50 tx=0x7f226c019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:39.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f2273e00640 1 -- 172.21.15.78:0/3437532240 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c0b9070 con 0x7f227c073340 2024-05-21T14:45:39.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f2273e00640 1 -- 172.21.15.78:0/3437532240 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226c0b4400 con 0x7f227c073340 2024-05-21T14:45:39.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f2273e00640 1 -- 172.21.15.78:0/3437532240 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c0b0040 con 0x7f227c073340 2024-05-21T14:45:39.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f2282200640 1 -- 172.21.15.78:0/3437532240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227c1f88f0 con 0x7f227c073340 2024-05-21T14:45:39.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.619+0000 7f2282200640 1 -- 172.21.15.78:0/3437532240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f227c1f8eb0 con 0x7f227c073340 2024-05-21T14:45:39.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.623+0000 7f2282200640 1 -- 172.21.15.78:0/3437532240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f227c04f730 con 0x7f227c073340 2024-05-21T14:45:39.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.623+0000 7f2273e00640 1 -- 172.21.15.78:0/3437532240 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f226c0b33a0 con 0x7f227c073340 2024-05-21T14:45:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.623+0000 7f2273e00640 1 --2- 172.21.15.78:0/3437532240 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f22580678c0 0x7f2258069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.623+0000 7f2273e00640 1 -- 172.21.15.78:0/3437532240 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f226c11eec0 con 0x7f227c073340 2024-05-21T14:45:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.623+0000 7f2273e00640 1 --2- 172.21.15.78:0/3437532240 >> [v2:172.21.15.78:6808/68473545,v1:172.21.15.78:6810/68473545] conn(0x7f225806fb10 0x7f2258071f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.623+0000 7f2273e00640 1 -- 172.21.15.78:0/3437532240 --> [v2:172.21.15.78:6808/68473545,v1:172.21.15.78:6810/68473545] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f226c0ab600 con 0x7f225806fb10 2024-05-21T14:45:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.623+0000 7f2273e00640 1 -- 172.21.15.78:0/3437532240 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f226c121480 con 0x7f227c073340 2024-05-21T14:45:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.623+0000 7f2272a00640 1 --2- 172.21.15.78:0/3437532240 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f22580678c0 0x7f2258069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.623+0000 7f227be00640 1 --2- 172.21.15.78:0/3437532240 >> [v2:172.21.15.78:6808/68473545,v1:172.21.15.78:6810/68473545] conn(0x7f225806fb10 0x7f2258071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.623+0000 7f227be00640 1 --2- 172.21.15.78:0/3437532240 >> [v2:172.21.15.78:6808/68473545,v1:172.21.15.78:6810/68473545] conn(0x7f225806fb10 0x7f2258071f80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:39.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.623+0000 7f2272a00640 1 --2- 172.21.15.78:0/3437532240 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f22580678c0 0x7f2258069dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f227c15b960 tx=0x7f2264008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:39.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.627+0000 7f2273e00640 1 -- 172.21.15.78:0/3437532240 <== osd.2 v2:172.21.15.78:6808/68473545 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f226c0ab600 con 0x7f225806fb10 2024-05-21T14:45:39.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.639+0000 7f2282200640 1 -- 172.21.15.78:0/3437532240 --> [v2:172.21.15.78:6808/68473545,v1:172.21.15.78:6810/68473545] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f227c0c4850 con 0x7f225806fb10 2024-05-21T14:45:39.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.639+0000 7f2273e00640 1 -- 172.21.15.78:0/3437532240 <== osd.2 v2:172.21.15.78:6808/68473545 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f227c0c4850 con 0x7f225806fb10 2024-05-21T14:45:39.648 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-05-21T14:45:39.648 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T14:45:39.648 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-05-21T14:45:39.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.639+0000 7f2282200640 1 -- 172.21.15.78:0/3437532240 >> [v2:172.21.15.78:6808/68473545,v1:172.21.15.78:6810/68473545] conn(0x7f225806fb10 msgr2=0x7f2258071f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.639+0000 7f2282200640 1 --2- 172.21.15.78:0/3437532240 >> [v2:172.21.15.78:6808/68473545,v1:172.21.15.78:6810/68473545] conn(0x7f225806fb10 0x7f2258071f80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.639+0000 7f2282200640 1 -- 172.21.15.78:0/3437532240 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f22580678c0 msgr2=0x7f2258069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.639+0000 7f2282200640 1 --2- 172.21.15.78:0/3437532240 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f22580678c0 0x7f2258069dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f227c15b960 tx=0x7f2264008040 comp rx=0 tx=0).stop 2024-05-21T14:45:39.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.639+0000 7f2282200640 1 -- 172.21.15.78:0/3437532240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f227c073340 msgr2=0x7f227c1f5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.639+0000 7f2282200640 1 --2- 172.21.15.78:0/3437532240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f227c073340 0x7f227c1f5400 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f226c01aa50 tx=0x7f226c019140 comp rx=0 tx=0).stop 2024-05-21T14:45:39.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.639+0000 7f227be00640 1 -- 172.21.15.78:0/3437532240 reap_dead start 2024-05-21T14:45:39.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.639+0000 7f2282200640 1 -- 172.21.15.78:0/3437532240 shutdown_connections 2024-05-21T14:45:39.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.639+0000 7f2282200640 1 -- 172.21.15.78:0/3437532240 >> 172.21.15.78:0/3437532240 conn(0x7f227c0cd1d0 msgr2=0x7f227c146480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:39.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.639+0000 7f2282200640 1 -- 172.21.15.78:0/3437532240 shutdown_connections 2024-05-21T14:45:39.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.639+0000 7f2282200640 1 -- 172.21.15.78:0/3437532240 wait complete. 2024-05-21T14:45:39.669 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-21T14:45:39.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.807+0000 7f0c32800640 1 Processor -- start 2024-05-21T14:45:39.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.807+0000 7f0c32800640 1 -- start start 2024-05-21T14:45:39.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.811+0000 7f0c32800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0c2c0733d0 0x7f0c2c071910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.811+0000 7f0c32800640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0c2c160e20 0x7f0c2c163240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.811+0000 7f0c32800640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c2c071e50 con 0x7f0c2c1527a0 2024-05-21T14:45:39.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.811+0000 7f0c32800640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2c072980 con 0x7f0c2c160e20 2024-05-21T14:45:39.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.811+0000 7f0c32800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2c072f40 con 0x7f0c2c0733d0 2024-05-21T14:45:39.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.811+0000 7f0c2be00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0c2c160e20 0x7f0c2c163240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.811+0000 7f0c2be00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0c2c160e20 0x7f0c2c163240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49832/0 (socket says 172.21.15.78:49832) 2024-05-21T14:45:39.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.811+0000 7f0c22a00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0c2c1527a0 0x7f0c2c0c5440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53258/0 (socket says 172.21.15.78:53258) 2024-05-21T14:45:39.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.811+0000 7f0c2be00640 1 -- 172.21.15.78:0/3854944741 learned_addr learned my addr 172.21.15.78:0/3854944741 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:39.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.811+0000 7f0c2b400640 1 --2- 172.21.15.78:0/3854944741 >> v2:172.21.15.84:3300/0 conn(0x7f0c2c0733d0 0x7f0c2c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.811+0000 7f0c2be00640 1 -- 172.21.15.78:0/3854944741 >> v2:172.21.15.84:3300/0 conn(0x7f0c2c0733d0 msgr2=0x7f0c2c071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:39.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.811+0000 7f0c2be00640 1 --2- 172.21.15.78:0/3854944741 >> v2:172.21.15.84:3300/0 conn(0x7f0c2c0733d0 0x7f0c2c071910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.811+0000 7f0c2be00640 1 -- 172.21.15.78:0/3854944741 >> v1:172.21.15.78:6789/0 conn(0x7f0c2c1527a0 legacy=0x7f0c2c0c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.811+0000 7f0c2aa00640 1 -- 172.21.15.78:0/3854944741 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3316488978 0 0) 0x7f0c2c071e50 con 0x7f0c2c1527a0 2024-05-21T14:45:39.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.811+0000 7f0c2be00640 1 -- 172.21.15.78:0/3854944741 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c0737e0 con 0x7f0c2c160e20 2024-05-21T14:45:39.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.815+0000 7f0c2be00640 1 --2- 172.21.15.78:0/3854944741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c2c160e20 0x7f0c2c163240 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c072b00 tx=0x7f0c2401f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afba3bac986146ce server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:39.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.815+0000 7f0c2aa00640 1 -- 172.21.15.78:0/3854944741 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c240b4070 con 0x7f0c2c160e20 2024-05-21T14:45:39.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.815+0000 7f0c2aa00640 1 -- 172.21.15.78:0/3854944741 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c240af400 con 0x7f0c2c160e20 2024-05-21T14:45:39.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.815+0000 7f0c2aa00640 1 -- 172.21.15.78:0/3854944741 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c240af7d0 con 0x7f0c2c160e20 2024-05-21T14:45:39.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.815+0000 7f0c32800640 1 -- 172.21.15.78:0/3854944741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c2c160e20 msgr2=0x7f0c2c163240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.815+0000 7f0c32800640 1 --2- 172.21.15.78:0/3854944741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c2c160e20 0x7f0c2c163240 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c072b00 tx=0x7f0c2401f1d0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.815+0000 7f0c32800640 1 -- 172.21.15.78:0/3854944741 shutdown_connections 2024-05-21T14:45:39.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.815+0000 7f0c32800640 1 --2- 172.21.15.78:0/3854944741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c2c160e20 0x7f0c2c163240 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.815+0000 7f0c32800640 1 --2- 172.21.15.78:0/3854944741 >> v2:172.21.15.84:3300/0 conn(0x7f0c2c0733d0 0x7f0c2c071910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.815+0000 7f0c32800640 1 -- 172.21.15.78:0/3854944741 >> 172.21.15.78:0/3854944741 conn(0x7f0c2c0cd1e0 msgr2=0x7f0c2c0c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:39.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.815+0000 7f0c32800640 1 -- 172.21.15.78:0/3854944741 shutdown_connections 2024-05-21T14:45:39.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.815+0000 7f0c32800640 1 -- 172.21.15.78:0/3854944741 wait complete. 2024-05-21T14:45:39.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.815+0000 7f0c32800640 1 Processor -- start 2024-05-21T14:45:39.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.815+0000 7f0c32800640 1 -- start start 2024-05-21T14:45:39.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c32800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c2c0733d0 0x7f0c2c1f5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c32800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c2c1527a0 0x7f0c2c1423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c32800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c2c160e20 0x7f0c2c14af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c32800640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c074060 con 0x7f0c2c0733d0 2024-05-21T14:45:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c32800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c073d80 con 0x7f0c2c160e20 2024-05-21T14:45:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c32800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2c072bd0 con 0x7f0c2c1527a0 2024-05-21T14:45:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c2b400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c2c0733d0 0x7f0c2c1f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c2b400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c2c0733d0 0x7f0c2c1f5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49846/0 (socket says 172.21.15.78:49846) 2024-05-21T14:45:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c2b400640 1 -- 172.21.15.78:0/2243975735 learned_addr learned my addr 172.21.15.78:0/2243975735 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c22a00640 1 --2- 172.21.15.78:0/2243975735 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c2c1527a0 0x7f0c2c1423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c2be00640 1 --2- 172.21.15.78:0/2243975735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c2c160e20 0x7f0c2c14af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c2b400640 1 -- 172.21.15.78:0/2243975735 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c2c1527a0 msgr2=0x7f0c2c1423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c2b400640 1 --2- 172.21.15.78:0/2243975735 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c2c1527a0 0x7f0c2c1423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c2b400640 1 -- 172.21.15.78:0/2243975735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c2c160e20 msgr2=0x7f0c2c14af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c2b400640 1 --2- 172.21.15.78:0/2243975735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c2c160e20 0x7f0c2c14af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c2b400640 1 -- 172.21.15.78:0/2243975735 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c1f5b50 con 0x7f0c2c0733d0 2024-05-21T14:45:39.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c2be00640 1 --2- 172.21.15.78:0/2243975735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c2c160e20 0x7f0c2c14af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:45:39.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c22a00640 1 --2- 172.21.15.78:0/2243975735 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c2c1527a0 0x7f0c2c1423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:45:39.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c2b400640 1 --2- 172.21.15.78:0/2243975735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c2c0733d0 0x7f0c2c1f5610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00e870 tx=0x7f0c1c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:39.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c23e00640 1 -- 172.21.15.78:0/2243975735 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c017070 con 0x7f0c2c0733d0 2024-05-21T14:45:39.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c23e00640 1 -- 172.21.15.78:0/2243975735 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c004020 con 0x7f0c2c0733d0 2024-05-21T14:45:39.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c23e00640 1 -- 172.21.15.78:0/2243975735 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0043f0 con 0x7f0c2c0733d0 2024-05-21T14:45:39.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c32800640 1 -- 172.21.15.78:0/2243975735 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2c1f5110 con 0x7f0c2c0733d0 2024-05-21T14:45:39.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c32800640 1 -- 172.21.15.78:0/2243975735 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2c157cb0 con 0x7f0c2c0733d0 2024-05-21T14:45:39.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.819+0000 7f0c32800640 1 -- 172.21.15.78:0/2243975735 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c2c0c8a20 con 0x7f0c2c0733d0 2024-05-21T14:45:39.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.823+0000 7f0c23e00640 1 -- 172.21.15.78:0/2243975735 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0c1c00c8e0 con 0x7f0c2c0733d0 2024-05-21T14:45:39.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.823+0000 7f0c23e00640 1 --2- 172.21.15.78:0/2243975735 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0c080678f0 0x7f0c08069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:39.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.823+0000 7f0c23e00640 1 -- 172.21.15.78:0/2243975735 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f0c1c0859a0 con 0x7f0c2c0733d0 2024-05-21T14:45:39.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.823+0000 7f0c22a00640 1 --2- 172.21.15.78:0/2243975735 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0c080678f0 0x7f0c08069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:39.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.823+0000 7f0c22a00640 1 --2- 172.21.15.78:0/2243975735 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0c080678f0 0x7f0c08069e00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0c14007fd0 tx=0x7f0c14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:39.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.827+0000 7f0c23e00640 1 -- 172.21.15.78:0/2243975735 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f0c1c056530 con 0x7f0c2c0733d0 2024-05-21T14:45:39.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.983+0000 7f0c32800640 1 -- 172.21.15.78:0/2243975735 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f0c2c14c2e0 con 0x7f0c080678f0 2024-05-21T14:45:39.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.983+0000 7f0c23e00640 1 -- 172.21.15.78:0/2243975735 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0c2c14c2e0 con 0x7f0c080678f0 2024-05-21T14:45:39.994 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 2 to deep-scrub 2024-05-21T14:45:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.987+0000 7f0c32800640 1 -- 172.21.15.78:0/2243975735 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0c080678f0 msgr2=0x7f0c08069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.987+0000 7f0c32800640 1 --2- 172.21.15.78:0/2243975735 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0c080678f0 0x7f0c08069e00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0c14007fd0 tx=0x7f0c14009040 comp rx=0 tx=0).stop 2024-05-21T14:45:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.987+0000 7f0c32800640 1 -- 172.21.15.78:0/2243975735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c2c0733d0 msgr2=0x7f0c2c1f5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.987+0000 7f0c32800640 1 --2- 172.21.15.78:0/2243975735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c2c0733d0 0x7f0c2c1f5610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00e870 tx=0x7f0c1c00ed30 comp rx=0 tx=0).stop 2024-05-21T14:45:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.987+0000 7f0c32800640 1 -- 172.21.15.78:0/2243975735 shutdown_connections 2024-05-21T14:45:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.987+0000 7f0c32800640 1 --2- 172.21.15.78:0/2243975735 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0c080678f0 0x7f0c08069e00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.987+0000 7f0c32800640 1 --2- 172.21.15.78:0/2243975735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c2c160e20 0x7f0c2c14af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.987+0000 7f0c32800640 1 --2- 172.21.15.78:0/2243975735 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c2c1527a0 0x7f0c2c1423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.987+0000 7f0c32800640 1 --2- 172.21.15.78:0/2243975735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c2c0733d0 0x7f0c2c1f5610 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.987+0000 7f0c32800640 1 -- 172.21.15.78:0/2243975735 >> 172.21.15.78:0/2243975735 conn(0x7f0c2c0cd1e0 msgr2=0x7f0c2c06c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.987+0000 7f0c32800640 1 -- 172.21.15.78:0/2243975735 shutdown_connections 2024-05-21T14:45:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:39.987+0000 7f0c32800640 1 -- 172.21.15.78:0/2243975735 wait complete. 2024-05-21T14:45:40.016 INFO:tasks.ceph:Scrubbing osd.3 2024-05-21T14:45:40.016 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-21T14:45:40.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.155+0000 7f221c600640 1 Processor -- start 2024-05-21T14:45:40.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.155+0000 7f221c600640 1 -- start start 2024-05-21T14:45:40.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.159+0000 7f221c600640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f221415ca60 0x7f2214153520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.159+0000 7f221c600640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2214074220 0x7f2214163df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.159+0000 7f221c600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f221415ce70 con 0x7f2214073e10 2024-05-21T14:45:40.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.159+0000 7f221c600640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f2214072140 con 0x7f221415ca60 2024-05-21T14:45:40.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.159+0000 7f221c600640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f2214072400 con 0x7f2214074220 2024-05-21T14:45:40.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.159+0000 7f2219c00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f221415ca60 0x7f2214153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.159+0000 7f2219c00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f221415ca60 0x7f2214153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49848/0 (socket says 172.21.15.78:49848) 2024-05-21T14:45:40.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.159+0000 7f2219c00640 1 -- 172.21.15.78:0/1107035936 learned_addr learned my addr 172.21.15.78:0/1107035936 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:40.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.159+0000 7f221a600640 1 --2- 172.21.15.78:0/1107035936 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2214074220 0x7f2214163df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.159+0000 7f2219c00640 1 -- 172.21.15.78:0/1107035936 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2214074220 msgr2=0x7f2214163df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:40.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.159+0000 7f2219c00640 1 --2- 172.21.15.78:0/1107035936 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2214074220 0x7f2214163df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.159+0000 7f2219c00640 1 -- 172.21.15.78:0/1107035936 >> v1:172.21.15.84:6789/0 conn(0x7f2214073e10 legacy=0x7f22140c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.159+0000 7f2219c00640 1 -- 172.21.15.78:0/1107035936 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22140726e0 con 0x7f221415ca60 2024-05-21T14:45:40.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.159+0000 7f221a600640 1 --2- 172.21.15.78:0/1107035936 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2214074220 0x7f2214163df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:45:40.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.163+0000 7f2219c00640 1 --2- 172.21.15.78:0/1107035936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f221415ca60 0x7f2214153520 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2208009e50 tx=0x7f220801f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9716dad9de9b378a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:40.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.163+0000 7f2213e00640 1 -- 172.21.15.78:0/1107035936 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22080b4070 con 0x7f221415ca60 2024-05-21T14:45:40.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.163+0000 7f2213e00640 1 -- 172.21.15.78:0/1107035936 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22080af400 con 0x7f221415ca60 2024-05-21T14:45:40.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.163+0000 7f2213e00640 1 -- 172.21.15.78:0/1107035936 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22080af7d0 con 0x7f221415ca60 2024-05-21T14:45:40.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.163+0000 7f221c600640 1 -- 172.21.15.78:0/1107035936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f221415ca60 msgr2=0x7f2214153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.163+0000 7f221c600640 1 --2- 172.21.15.78:0/1107035936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f221415ca60 0x7f2214153520 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2208009e50 tx=0x7f220801f210 comp rx=0 tx=0).stop 2024-05-21T14:45:40.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.163+0000 7f221c600640 1 -- 172.21.15.78:0/1107035936 shutdown_connections 2024-05-21T14:45:40.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.163+0000 7f221c600640 1 --2- 172.21.15.78:0/1107035936 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2214074220 0x7f2214163df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.163+0000 7f221c600640 1 --2- 172.21.15.78:0/1107035936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f221415ca60 0x7f2214153520 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.163+0000 7f221c600640 1 -- 172.21.15.78:0/1107035936 >> 172.21.15.78:0/1107035936 conn(0x7f22140cd1d0 msgr2=0x7f22140c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:40.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.163+0000 7f221c600640 1 -- 172.21.15.78:0/1107035936 shutdown_connections 2024-05-21T14:45:40.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.163+0000 7f221c600640 1 -- 172.21.15.78:0/1107035936 wait complete. 2024-05-21T14:45:40.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.163+0000 7f221c600640 1 Processor -- start 2024-05-21T14:45:40.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f221c600640 1 -- start start 2024-05-21T14:45:40.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f221c600640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2214073e10 0x7f2214146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f221c600640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2214074220 0x7f2214145980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f221c600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f221415ca60 0x7f2214143b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f221c600640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2214073830 con 0x7f2214074220 2024-05-21T14:45:40.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f221c600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2214159aa0 con 0x7f221415ca60 2024-05-21T14:45:40.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f221c600640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f2214159470 con 0x7f2214073e10 2024-05-21T14:45:40.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f2219200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2214074220 0x7f2214145980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f2219200640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2214074220 0x7f2214145980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49858/0 (socket says 172.21.15.78:49858) 2024-05-21T14:45:40.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f2219200640 1 -- 172.21.15.78:0/1795176542 learned_addr learned my addr 172.21.15.78:0/1795176542 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:40.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f2219c00640 1 --2- 172.21.15.78:0/1795176542 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2214073e10 0x7f2214146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f221a600640 1 --2- 172.21.15.78:0/1795176542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f221415ca60 0x7f2214143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f2219200640 1 -- 172.21.15.78:0/1795176542 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2214073e10 msgr2=0x7f2214146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f2219200640 1 --2- 172.21.15.78:0/1795176542 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2214073e10 0x7f2214146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f2219200640 1 -- 172.21.15.78:0/1795176542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f221415ca60 msgr2=0x7f2214143b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f2219200640 1 --2- 172.21.15.78:0/1795176542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f221415ca60 0x7f2214143b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f2219200640 1 -- 172.21.15.78:0/1795176542 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2214147070 con 0x7f2214074220 2024-05-21T14:45:40.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f2219200640 1 --2- 172.21.15.78:0/1795176542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2214074220 0x7f2214145980 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f220000c370 tx=0x7f220000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:40.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f2211600640 1 -- 172.21.15.78:0/1795176542 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22000052d0 con 0x7f2214074220 2024-05-21T14:45:40.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f2211600640 1 -- 172.21.15.78:0/1795176542 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2200005470 con 0x7f2214074220 2024-05-21T14:45:40.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f221c600640 1 -- 172.21.15.78:0/1795176542 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22141f0140 con 0x7f2214074220 2024-05-21T14:45:40.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f2211600640 1 -- 172.21.15.78:0/1795176542 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2200007260 con 0x7f2214074220 2024-05-21T14:45:40.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f221c600640 1 -- 172.21.15.78:0/1795176542 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22141f03e0 con 0x7f2214074220 2024-05-21T14:45:40.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.167+0000 7f221c600640 1 -- 172.21.15.78:0/1795176542 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f221404f730 con 0x7f2214074220 2024-05-21T14:45:40.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.171+0000 7f2211600640 1 -- 172.21.15.78:0/1795176542 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2200007400 con 0x7f2214074220 2024-05-21T14:45:40.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.171+0000 7f2211600640 1 --2- 172.21.15.78:0/1795176542 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f21f40678c0 0x7f21f4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.171+0000 7f2211600640 1 -- 172.21.15.78:0/1795176542 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f2200085cb0 con 0x7f2214074220 2024-05-21T14:45:40.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.171+0000 7f2211600640 1 --2- 172.21.15.78:0/1795176542 >> [v2:172.21.15.78:6809/3531240521,v1:172.21.15.78:6811/3531240521] conn(0x7f21f406fb10 0x7f21f4071f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.171+0000 7f2211600640 1 -- 172.21.15.78:0/1795176542 --> [v2:172.21.15.78:6809/3531240521,v1:172.21.15.78:6811/3531240521] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21f4072650 con 0x7f21f406fb10 2024-05-21T14:45:40.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.171+0000 7f2211600640 1 -- 172.21.15.78:0/1795176542 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2200086060 con 0x7f2214074220 2024-05-21T14:45:40.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.171+0000 7f2219c00640 1 --2- 172.21.15.78:0/1795176542 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f21f40678c0 0x7f21f4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.171+0000 7f221a600640 1 --2- 172.21.15.78:0/1795176542 >> [v2:172.21.15.78:6809/3531240521,v1:172.21.15.78:6811/3531240521] conn(0x7f21f406fb10 0x7f21f4071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.171+0000 7f221a600640 1 --2- 172.21.15.78:0/1795176542 >> [v2:172.21.15.78:6809/3531240521,v1:172.21.15.78:6811/3531240521] conn(0x7f21f406fb10 0x7f21f4071f80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:40.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.171+0000 7f2219c00640 1 --2- 172.21.15.78:0/1795176542 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f21f40678c0 0x7f21f4069dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f22080b1000 tx=0x7f22080aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:40.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.171+0000 7f2211600640 1 -- 172.21.15.78:0/1795176542 <== osd.3 v2:172.21.15.78:6809/3531240521 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f21f4072650 con 0x7f21f406fb10 2024-05-21T14:45:40.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.187+0000 7f221c600640 1 -- 172.21.15.78:0/1795176542 --> [v2:172.21.15.78:6809/3531240521,v1:172.21.15.78:6811/3531240521] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f22140c7d20 con 0x7f21f406fb10 2024-05-21T14:45:40.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.187+0000 7f2211600640 1 -- 172.21.15.78:0/1795176542 <== osd.3 v2:172.21.15.78:6809/3531240521 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f22140c7d20 con 0x7f21f406fb10 2024-05-21T14:45:40.196 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-05-21T14:45:40.196 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T14:45:40.196 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-05-21T14:45:40.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.187+0000 7f221c600640 1 -- 172.21.15.78:0/1795176542 >> [v2:172.21.15.78:6809/3531240521,v1:172.21.15.78:6811/3531240521] conn(0x7f21f406fb10 msgr2=0x7f21f4071f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.187+0000 7f221c600640 1 --2- 172.21.15.78:0/1795176542 >> [v2:172.21.15.78:6809/3531240521,v1:172.21.15.78:6811/3531240521] conn(0x7f21f406fb10 0x7f21f4071f80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.187+0000 7f221c600640 1 -- 172.21.15.78:0/1795176542 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f21f40678c0 msgr2=0x7f21f4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.187+0000 7f221c600640 1 --2- 172.21.15.78:0/1795176542 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f21f40678c0 0x7f21f4069dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f22080b1000 tx=0x7f22080aa000 comp rx=0 tx=0).stop 2024-05-21T14:45:40.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.187+0000 7f221c600640 1 -- 172.21.15.78:0/1795176542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2214074220 msgr2=0x7f2214145980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.187+0000 7f221c600640 1 --2- 172.21.15.78:0/1795176542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2214074220 0x7f2214145980 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f220000c370 tx=0x7f220000c830 comp rx=0 tx=0).stop 2024-05-21T14:45:40.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.187+0000 7f221a600640 1 -- 172.21.15.78:0/1795176542 reap_dead start 2024-05-21T14:45:40.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.187+0000 7f221c600640 1 -- 172.21.15.78:0/1795176542 shutdown_connections 2024-05-21T14:45:40.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.187+0000 7f221c600640 1 -- 172.21.15.78:0/1795176542 >> 172.21.15.78:0/1795176542 conn(0x7f22140cd1d0 msgr2=0x7f2214149770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:40.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.187+0000 7f221c600640 1 -- 172.21.15.78:0/1795176542 shutdown_connections 2024-05-21T14:45:40.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.187+0000 7f221c600640 1 -- 172.21.15.78:0/1795176542 wait complete. 2024-05-21T14:45:40.215 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-21T14:45:40.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.351+0000 7f67caa00640 1 Processor -- start 2024-05-21T14:45:40.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.351+0000 7f67caa00640 1 -- start start 2024-05-21T14:45:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.355+0000 7f67caa00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f67c40c7f90 0x7f67c41538d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.355+0000 7f67caa00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f67c40c6540 0x7f67c40735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.355+0000 7f67caa00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67c40c7240 con 0x7f67c40c5c30 2024-05-21T14:45:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.355+0000 7f67caa00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f67c4153e10 con 0x7f67c40c7f90 2024-05-21T14:45:40.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.355+0000 7f67caa00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f67c40c4370 con 0x7f67c40c6540 2024-05-21T14:45:40.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.355+0000 7f67c3e00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f67c40c5c30 0x7f67c415cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53266/0 (socket says 172.21.15.78:53266) 2024-05-21T14:45:40.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.355+0000 7f67bb400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f67c40c7f90 0x7f67c41538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.355+0000 7f67c3e00640 1 -- 172.21.15.78:0/4214442175 learned_addr learned my addr 172.21.15.78:0/4214442175 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:45:40.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.355+0000 7f67c8a00640 1 --2- 172.21.15.78:0/4214442175 >> v2:172.21.15.84:3300/0 conn(0x7f67c40c6540 0x7f67c40735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.355+0000 7f67bb400640 1 -- 172.21.15.78:0/4214442175 >> v2:172.21.15.84:3300/0 conn(0x7f67c40c6540 msgr2=0x7f67c40735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:40.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.355+0000 7f67bb400640 1 --2- 172.21.15.78:0/4214442175 >> v2:172.21.15.84:3300/0 conn(0x7f67c40c6540 0x7f67c40735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.355+0000 7f67bb400640 1 -- 172.21.15.78:0/4214442175 >> v1:172.21.15.78:6789/0 conn(0x7f67c40c5c30 legacy=0x7f67c415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.355+0000 7f67bb400640 1 -- 172.21.15.78:0/4214442175 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c40c74e0 con 0x7f67c40c7f90 2024-05-21T14:45:40.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.355+0000 7f67c3400640 1 -- 172.21.15.78:0/4214442175 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3151366979 0 0) 0x7f67c40c7240 con 0x7f67c40c5c30 2024-05-21T14:45:40.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.359+0000 7f67bb400640 1 --2- 172.21.15.78:0/4214442175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67c40c7f90 0x7f67c41538d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f67c40c44f0 tx=0x7f67ac01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97622987fda30023 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:40.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.359+0000 7f67c3400640 1 -- 172.21.15.78:0/4214442175 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac0b0070 con 0x7f67c40c7f90 2024-05-21T14:45:40.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.359+0000 7f67c3400640 1 -- 172.21.15.78:0/4214442175 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ac0ab600 con 0x7f67c40c7f90 2024-05-21T14:45:40.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.359+0000 7f67c3400640 1 -- 172.21.15.78:0/4214442175 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac0ab9d0 con 0x7f67c40c7f90 2024-05-21T14:45:40.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.359+0000 7f67caa00640 1 -- 172.21.15.78:0/4214442175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67c40c7f90 msgr2=0x7f67c41538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.359+0000 7f67caa00640 1 --2- 172.21.15.78:0/4214442175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67c40c7f90 0x7f67c41538d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f67c40c44f0 tx=0x7f67ac01c460 comp rx=0 tx=0).stop 2024-05-21T14:45:40.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.359+0000 7f67caa00640 1 -- 172.21.15.78:0/4214442175 shutdown_connections 2024-05-21T14:45:40.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.359+0000 7f67caa00640 1 --2- 172.21.15.78:0/4214442175 >> v2:172.21.15.84:3300/0 conn(0x7f67c40c6540 0x7f67c40735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.359+0000 7f67caa00640 1 --2- 172.21.15.78:0/4214442175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67c40c7f90 0x7f67c41538d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.359+0000 7f67caa00640 1 -- 172.21.15.78:0/4214442175 >> 172.21.15.78:0/4214442175 conn(0x7f67c40cd1e0 msgr2=0x7f67c40c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:40.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.359+0000 7f67caa00640 1 -- 172.21.15.78:0/4214442175 shutdown_connections 2024-05-21T14:45:40.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.359+0000 7f67caa00640 1 -- 172.21.15.78:0/4214442175 wait complete. 2024-05-21T14:45:40.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67caa00640 1 Processor -- start 2024-05-21T14:45:40.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67caa00640 1 -- start start 2024-05-21T14:45:40.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67caa00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f67c40c5c30 0x7f67c41f96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67caa00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67c40c6540 0x7f67c40cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67caa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67c40c7f90 0x7f67c40729c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67caa00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f67c41669c0 con 0x7f67c40c6540 2024-05-21T14:45:40.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67caa00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f67c4166840 con 0x7f67c40c7f90 2024-05-21T14:45:40.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67caa00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f67c4166b40 con 0x7f67c40c5c30 2024-05-21T14:45:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67bb400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67c40c6540 0x7f67c40cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67bb400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67c40c6540 0x7f67c40cb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49870/0 (socket says 172.21.15.78:49870) 2024-05-21T14:45:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67bb400640 1 -- 172.21.15.78:0/3153298496 learned_addr learned my addr 172.21.15.78:0/3153298496 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67c3e00640 1 --2- 172.21.15.78:0/3153298496 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f67c40c5c30 0x7f67c41f96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67c8a00640 1 --2- 172.21.15.78:0/3153298496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67c40c7f90 0x7f67c40729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67bb400640 1 -- 172.21.15.78:0/3153298496 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f67c40c5c30 msgr2=0x7f67c41f96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67bb400640 1 --2- 172.21.15.78:0/3153298496 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f67c40c5c30 0x7f67c41f96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67bb400640 1 -- 172.21.15.78:0/3153298496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67c40c7f90 msgr2=0x7f67c40729c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67bb400640 1 --2- 172.21.15.78:0/3153298496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67c40c7f90 0x7f67c40729c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67bb400640 1 -- 172.21.15.78:0/3153298496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c41f9bf0 con 0x7f67c40c6540 2024-05-21T14:45:40.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67bb400640 1 --2- 172.21.15.78:0/3153298496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67c40c6540 0x7f67c40cb950 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0ae040 tx=0x7f67ac01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:40.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67c0c00640 1 -- 172.21.15.78:0/3153298496 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac0bd070 con 0x7f67c40c6540 2024-05-21T14:45:40.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67c0c00640 1 -- 172.21.15.78:0/3153298496 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ac004030 con 0x7f67c40c6540 2024-05-21T14:45:40.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67c0c00640 1 -- 172.21.15.78:0/3153298496 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac0b0040 con 0x7f67c40c6540 2024-05-21T14:45:40.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67caa00640 1 -- 172.21.15.78:0/3153298496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c41630f0 con 0x7f67c40c6540 2024-05-21T14:45:40.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.363+0000 7f67caa00640 1 -- 172.21.15.78:0/3153298496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c41f8eb0 con 0x7f67c40c6540 2024-05-21T14:45:40.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.367+0000 7f67caa00640 1 -- 172.21.15.78:0/3153298496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c4162e60 con 0x7f67c40c6540 2024-05-21T14:45:40.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.367+0000 7f67c0c00640 1 -- 172.21.15.78:0/3153298496 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f67ac003620 con 0x7f67c40c6540 2024-05-21T14:45:40.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.367+0000 7f67c0c00640 1 --2- 172.21.15.78:0/3153298496 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f67a00678f0 0x7f67a0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.367+0000 7f67c0c00640 1 -- 172.21.15.78:0/3153298496 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f67ac11f980 con 0x7f67c40c6540 2024-05-21T14:45:40.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.367+0000 7f67c3e00640 1 --2- 172.21.15.78:0/3153298496 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f67a00678f0 0x7f67a0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.367+0000 7f67c3e00640 1 --2- 172.21.15.78:0/3153298496 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f67a00678f0 0x7f67a0069e00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f67b40012f0 tx=0x7f67b4005ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:40.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.371+0000 7f67c0c00640 1 -- 172.21.15.78:0/3153298496 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f67ac016050 con 0x7f67c40c6540 2024-05-21T14:45:40.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.527+0000 7f67caa00640 1 -- 172.21.15.78:0/3153298496 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f67c41f8cc0 con 0x7f67a00678f0 2024-05-21T14:45:40.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.531+0000 7f67c0c00640 1 -- 172.21.15.78:0/3153298496 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f67c41f8cc0 con 0x7f67a00678f0 2024-05-21T14:45:40.539 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 3 to deep-scrub 2024-05-21T14:45:40.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.531+0000 7f67caa00640 1 -- 172.21.15.78:0/3153298496 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f67a00678f0 msgr2=0x7f67a0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.531+0000 7f67caa00640 1 --2- 172.21.15.78:0/3153298496 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f67a00678f0 0x7f67a0069e00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f67b40012f0 tx=0x7f67b4005ec0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.531+0000 7f67caa00640 1 -- 172.21.15.78:0/3153298496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67c40c6540 msgr2=0x7f67c40cb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.531+0000 7f67caa00640 1 --2- 172.21.15.78:0/3153298496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67c40c6540 0x7f67c40cb950 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0ae040 tx=0x7f67ac01aca0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.531+0000 7f67caa00640 1 -- 172.21.15.78:0/3153298496 shutdown_connections 2024-05-21T14:45:40.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.531+0000 7f67caa00640 1 --2- 172.21.15.78:0/3153298496 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f67a00678f0 0x7f67a0069e00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.531+0000 7f67caa00640 1 --2- 172.21.15.78:0/3153298496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67c40c7f90 0x7f67c40729c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.531+0000 7f67caa00640 1 --2- 172.21.15.78:0/3153298496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67c40c6540 0x7f67c40cb950 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.531+0000 7f67caa00640 1 --2- 172.21.15.78:0/3153298496 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f67c40c5c30 0x7f67c41f96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.531+0000 7f67caa00640 1 -- 172.21.15.78:0/3153298496 >> 172.21.15.78:0/3153298496 conn(0x7f67c40cd1e0 msgr2=0x7f67c414ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:40.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.531+0000 7f67caa00640 1 -- 172.21.15.78:0/3153298496 shutdown_connections 2024-05-21T14:45:40.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.531+0000 7f67caa00640 1 -- 172.21.15.78:0/3153298496 wait complete. 2024-05-21T14:45:40.561 INFO:tasks.ceph:Scrubbing osd.4 2024-05-21T14:45:40.561 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-21T14:45:40.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.707+0000 7f29b8e00640 1 Processor -- start 2024-05-21T14:45:40.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.707+0000 7f29b8e00640 1 -- start start 2024-05-21T14:45:40.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.707+0000 7f29b8e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f29b40739a0 0x7f29b4073db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.707+0000 7f29b8e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29b415b8c0 0x7f29b415bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.707+0000 7f29b8e00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b40c9280 con 0x7f29b415c210 2024-05-21T14:45:40.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.707+0000 7f29b8e00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f29b40721b0 con 0x7f29b40739a0 2024-05-21T14:45:40.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.707+0000 7f29b8e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f29b40c9520 con 0x7f29b415b8c0 2024-05-21T14:45:40.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.707+0000 7f29b3400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f29b40739a0 0x7f29b4073db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.707+0000 7f29b3400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f29b40739a0 0x7f29b4073db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49882/0 (socket says 172.21.15.78:49882) 2024-05-21T14:45:40.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.707+0000 7f29b3400640 1 -- 172.21.15.78:0/534363625 learned_addr learned my addr 172.21.15.78:0/534363625 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:40.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.707+0000 7f29b2a00640 1 --2- 172.21.15.78:0/534363625 >> v2:172.21.15.84:3300/0 conn(0x7f29b415b8c0 0x7f29b415bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.707+0000 7f29b3400640 1 -- 172.21.15.78:0/534363625 >> v2:172.21.15.84:3300/0 conn(0x7f29b415b8c0 msgr2=0x7f29b415bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:40.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.707+0000 7f29b3400640 1 --2- 172.21.15.78:0/534363625 >> v2:172.21.15.84:3300/0 conn(0x7f29b415b8c0 0x7f29b415bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.707+0000 7f29b3400640 1 -- 172.21.15.78:0/534363625 >> v1:172.21.15.84:6789/0 conn(0x7f29b415c210 legacy=0x7f29b41582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.707+0000 7f29b3400640 1 -- 172.21.15.78:0/534363625 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b4072470 con 0x7f29b40739a0 2024-05-21T14:45:40.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.711+0000 7f29b3400640 1 --2- 172.21.15.78:0/534363625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b40739a0 0x7f29b4073db0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f29b40c8110 tx=0x7f29a401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1849f502ddc1b66f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:40.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.711+0000 7f29b2000640 1 -- 172.21.15.78:0/534363625 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a40b0070 con 0x7f29b40739a0 2024-05-21T14:45:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.711+0000 7f29b2000640 1 -- 172.21.15.78:0/534363625 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a40ab600 con 0x7f29b40739a0 2024-05-21T14:45:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.711+0000 7f29b2000640 1 -- 172.21.15.78:0/534363625 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a40ab9d0 con 0x7f29b40739a0 2024-05-21T14:45:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.711+0000 7f29b8e00640 1 -- 172.21.15.78:0/534363625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b40739a0 msgr2=0x7f29b4073db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.711+0000 7f29b8e00640 1 --2- 172.21.15.78:0/534363625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b40739a0 0x7f29b4073db0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f29b40c8110 tx=0x7f29a401c520 comp rx=0 tx=0).stop 2024-05-21T14:45:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.711+0000 7f29b8e00640 1 -- 172.21.15.78:0/534363625 shutdown_connections 2024-05-21T14:45:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.711+0000 7f29b8e00640 1 --2- 172.21.15.78:0/534363625 >> v2:172.21.15.84:3300/0 conn(0x7f29b415b8c0 0x7f29b415bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.711+0000 7f29b8e00640 1 --2- 172.21.15.78:0/534363625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b40739a0 0x7f29b4073db0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.711+0000 7f29b8e00640 1 -- 172.21.15.78:0/534363625 >> 172.21.15.78:0/534363625 conn(0x7f29b40ca5c0 msgr2=0x7f29b40ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.711+0000 7f29b8e00640 1 -- 172.21.15.78:0/534363625 shutdown_connections 2024-05-21T14:45:40.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.711+0000 7f29b8e00640 1 -- 172.21.15.78:0/534363625 wait complete. 2024-05-21T14:45:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.715+0000 7f29b8e00640 1 Processor -- start 2024-05-21T14:45:40.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.715+0000 7f29b8e00640 1 -- start start 2024-05-21T14:45:40.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.715+0000 7f29b8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b40739a0 0x7f29b4153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.715+0000 7f29b8e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b415b8c0 0x7f29b414bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.715+0000 7f29b8e00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f29b415c210 0x7f29b415ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.715+0000 7f29b8e00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f29b40c48a0 con 0x7f29b415b8c0 2024-05-21T14:45:40.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.715+0000 7f29b8e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f29b40c4720 con 0x7f29b40739a0 2024-05-21T14:45:40.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.715+0000 7f29b8e00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f29b40c9e40 con 0x7f29b415c210 2024-05-21T14:45:40.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.715+0000 7f29b2a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b415b8c0 0x7f29b414bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.715+0000 7f29b2a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b415b8c0 0x7f29b414bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49898/0 (socket says 172.21.15.78:49898) 2024-05-21T14:45:40.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.715+0000 7f29b2a00640 1 -- 172.21.15.78:0/1290565048 learned_addr learned my addr 172.21.15.78:0/1290565048 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:40.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.715+0000 7f29b3400640 1 --2- 172.21.15.78:0/1290565048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b40739a0 0x7f29b4153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.715+0000 7f29b3e00640 1 --2- 172.21.15.78:0/1290565048 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f29b415c210 0x7f29b415ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.719+0000 7f29b2a00640 1 -- 172.21.15.78:0/1290565048 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f29b415c210 msgr2=0x7f29b415ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.719+0000 7f29b2a00640 1 --2- 172.21.15.78:0/1290565048 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f29b415c210 0x7f29b415ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.719+0000 7f29b2a00640 1 -- 172.21.15.78:0/1290565048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b40739a0 msgr2=0x7f29b4153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.719+0000 7f29b2a00640 1 --2- 172.21.15.78:0/1290565048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b40739a0 0x7f29b4153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.719+0000 7f29b2a00640 1 -- 172.21.15.78:0/1290565048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b41554b0 con 0x7f29b415b8c0 2024-05-21T14:45:40.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.719+0000 7f29b2a00640 1 --2- 172.21.15.78:0/1290565048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b415b8c0 0x7f29b414bd40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f29a000d620 tx=0x7f29a000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.719+0000 7f29ab400640 1 -- 172.21.15.78:0/1290565048 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a000b620 con 0x7f29b415b8c0 2024-05-21T14:45:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.719+0000 7f29ab400640 1 -- 172.21.15.78:0/1290565048 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a0019070 con 0x7f29b415b8c0 2024-05-21T14:45:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.719+0000 7f29ab400640 1 -- 172.21.15.78:0/1290565048 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a000ba20 con 0x7f29b415b8c0 2024-05-21T14:45:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.719+0000 7f29b8e00640 1 -- 172.21.15.78:0/1290565048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b4153c80 con 0x7f29b415b8c0 2024-05-21T14:45:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.719+0000 7f29b8e00640 1 -- 172.21.15.78:0/1290565048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b41f4ee0 con 0x7f29b415b8c0 2024-05-21T14:45:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.719+0000 7f29b8e00640 1 -- 172.21.15.78:0/1290565048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29b4069f30 con 0x7f29b415b8c0 2024-05-21T14:45:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.719+0000 7f29ab400640 1 -- 172.21.15.78:0/1290565048 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f29a000bbc0 con 0x7f29b415b8c0 2024-05-21T14:45:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.723+0000 7f29ab400640 1 --2- 172.21.15.78:0/1290565048 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f29940678c0 0x7f2994069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.723+0000 7f29ab400640 1 -- 172.21.15.78:0/1290565048 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f29a0086170 con 0x7f29b415b8c0 2024-05-21T14:45:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.723+0000 7f29ab400640 1 --2- 172.21.15.78:0/1290565048 >> [v2:172.21.15.84:6802/1494211791,v1:172.21.15.84:6804/1494211791] conn(0x7f299406fb10 0x7f2994071f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.723+0000 7f29ab400640 1 -- 172.21.15.78:0/1290565048 --> [v2:172.21.15.84:6802/1494211791,v1:172.21.15.84:6804/1494211791] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29a0001d40 con 0x7f299406fb10 2024-05-21T14:45:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.723+0000 7f29ab400640 1 -- 172.21.15.78:0/1290565048 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f29a008d050 con 0x7f29b415b8c0 2024-05-21T14:45:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.723+0000 7f29b3400640 1 --2- 172.21.15.78:0/1290565048 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f29940678c0 0x7f2994069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.723+0000 7f29b3e00640 1 --2- 172.21.15.78:0/1290565048 >> [v2:172.21.15.84:6802/1494211791,v1:172.21.15.84:6804/1494211791] conn(0x7f299406fb10 0x7f2994071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.723+0000 7f29b3400640 1 --2- 172.21.15.78:0/1290565048 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f29940678c0 0x7f2994069dd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f29a40ad000 tx=0x7f29a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:40.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.723+0000 7f29b3e00640 1 --2- 172.21.15.78:0/1290565048 >> [v2:172.21.15.84:6802/1494211791,v1:172.21.15.84:6804/1494211791] conn(0x7f299406fb10 0x7f2994071f80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:40.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.723+0000 7f29ab400640 1 -- 172.21.15.78:0/1290565048 <== osd.4 v2:172.21.15.84:6802/1494211791 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29a0001d40 con 0x7f299406fb10 2024-05-21T14:45:40.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.739+0000 7f29b8e00640 1 -- 172.21.15.78:0/1290565048 --> [v2:172.21.15.84:6802/1494211791,v1:172.21.15.84:6804/1494211791] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f29b4158720 con 0x7f299406fb10 2024-05-21T14:45:40.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.739+0000 7f29ab400640 1 -- 172.21.15.78:0/1290565048 <== osd.4 v2:172.21.15.84:6802/1494211791 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f29b4158720 con 0x7f299406fb10 2024-05-21T14:45:40.748 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-05-21T14:45:40.748 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T14:45:40.748 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-05-21T14:45:40.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.739+0000 7f29b8e00640 1 -- 172.21.15.78:0/1290565048 >> [v2:172.21.15.84:6802/1494211791,v1:172.21.15.84:6804/1494211791] conn(0x7f299406fb10 msgr2=0x7f2994071f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.739+0000 7f29b8e00640 1 --2- 172.21.15.78:0/1290565048 >> [v2:172.21.15.84:6802/1494211791,v1:172.21.15.84:6804/1494211791] conn(0x7f299406fb10 0x7f2994071f80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.739+0000 7f29b8e00640 1 -- 172.21.15.78:0/1290565048 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f29940678c0 msgr2=0x7f2994069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.739+0000 7f29b8e00640 1 --2- 172.21.15.78:0/1290565048 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f29940678c0 0x7f2994069dd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f29a40ad000 tx=0x7f29a4008040 comp rx=0 tx=0).stop 2024-05-21T14:45:40.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.739+0000 7f29b8e00640 1 -- 172.21.15.78:0/1290565048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b415b8c0 msgr2=0x7f29b414bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.739+0000 7f29b8e00640 1 --2- 172.21.15.78:0/1290565048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b415b8c0 0x7f29b414bd40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f29a000d620 tx=0x7f29a000dae0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.739+0000 7f29b3e00640 1 -- 172.21.15.78:0/1290565048 reap_dead start 2024-05-21T14:45:40.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.739+0000 7f29b8e00640 1 -- 172.21.15.78:0/1290565048 shutdown_connections 2024-05-21T14:45:40.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.739+0000 7f29b8e00640 1 -- 172.21.15.78:0/1290565048 >> 172.21.15.78:0/1290565048 conn(0x7f29b40ca5c0 msgr2=0x7f29b40cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:40.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.739+0000 7f29b8e00640 1 -- 172.21.15.78:0/1290565048 shutdown_connections 2024-05-21T14:45:40.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.739+0000 7f29b8e00640 1 -- 172.21.15.78:0/1290565048 wait complete. 2024-05-21T14:45:40.768 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-21T14:45:40.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.907+0000 7f0b65c00640 1 Processor -- start 2024-05-21T14:45:40.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.907+0000 7f0b65c00640 1 -- start start 2024-05-21T14:45:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.907+0000 7f0b65c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0b600c5c30 0x7f0b601538d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.907+0000 7f0b65c00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0b600c7f90 0x7f0b6015cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.907+0000 7f0b65c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0b600c6540 0x7f0b600735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.907+0000 7f0b65c00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f0b60153e10 con 0x7f0b600c7f90 2024-05-21T14:45:40.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.907+0000 7f0b65c00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f0b600c4370 con 0x7f0b600c5c30 2024-05-21T14:45:40.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.907+0000 7f0b65c00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0b600c7240 con 0x7f0b600c6540 2024-05-21T14:45:40.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.907+0000 7f0b5e000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0b600c7f90 0x7f0b6015cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.907+0000 7f0b5e000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0b600c7f90 0x7f0b6015cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49906/0 (socket says 172.21.15.78:49906) 2024-05-21T14:45:40.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.907+0000 7f0b5e000640 1 -- 172.21.15.78:0/794886044 learned_addr learned my addr 172.21.15.78:0/794886044 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:40.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.907+0000 7f0b5ea00640 1 --2- 172.21.15.78:0/794886044 >> v2:172.21.15.84:3300/0 conn(0x7f0b600c5c30 0x7f0b601538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.907+0000 7f0b5f400640 1 --2- 172.21.15.78:0/794886044 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0b600c6540 0x7f0b600735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.911+0000 7f0b5e000640 1 -- 172.21.15.78:0/794886044 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0b600c6540 msgr2=0x7f0b600735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:40.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.911+0000 7f0b5e000640 1 --2- 172.21.15.78:0/794886044 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0b600c6540 0x7f0b600735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.911+0000 7f0b5e000640 1 -- 172.21.15.78:0/794886044 >> v2:172.21.15.84:3300/0 conn(0x7f0b600c5c30 msgr2=0x7f0b601538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:40.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.911+0000 7f0b5e000640 1 --2- 172.21.15.78:0/794886044 >> v2:172.21.15.84:3300/0 conn(0x7f0b600c5c30 0x7f0b601538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.911+0000 7f0b5e000640 1 -- 172.21.15.78:0/794886044 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b600c74e0 con 0x7f0b600c7f90 2024-05-21T14:45:40.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.911+0000 7f0b5e000640 1 --2- 172.21.15.78:0/794886044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b600c7f90 0x7f0b6015cc90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0b600cd870 tx=0x7f0b4c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4924c3ea74e2f2e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:40.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.911+0000 7f0b5d600640 1 -- 172.21.15.78:0/794886044 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0b0070 con 0x7f0b600c7f90 2024-05-21T14:45:40.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.911+0000 7f0b5d600640 1 -- 172.21.15.78:0/794886044 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b4c0ab600 con 0x7f0b600c7f90 2024-05-21T14:45:40.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.911+0000 7f0b5d600640 1 -- 172.21.15.78:0/794886044 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0ab9d0 con 0x7f0b600c7f90 2024-05-21T14:45:40.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.911+0000 7f0b65c00640 1 -- 172.21.15.78:0/794886044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b600c7f90 msgr2=0x7f0b6015cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.911+0000 7f0b65c00640 1 --2- 172.21.15.78:0/794886044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b600c7f90 0x7f0b6015cc90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0b600cd870 tx=0x7f0b4c01c520 comp rx=0 tx=0).stop 2024-05-21T14:45:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.915+0000 7f0b65c00640 1 -- 172.21.15.78:0/794886044 shutdown_connections 2024-05-21T14:45:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.915+0000 7f0b65c00640 1 --2- 172.21.15.78:0/794886044 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0b600c6540 0x7f0b600735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.915+0000 7f0b65c00640 1 --2- 172.21.15.78:0/794886044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b600c7f90 0x7f0b6015cc90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.915+0000 7f0b65c00640 1 --2- 172.21.15.78:0/794886044 >> v2:172.21.15.84:3300/0 conn(0x7f0b600c5c30 0x7f0b601538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.915+0000 7f0b65c00640 1 -- 172.21.15.78:0/794886044 >> 172.21.15.78:0/794886044 conn(0x7f0b600cd1e0 msgr2=0x7f0b600c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.915+0000 7f0b65c00640 1 -- 172.21.15.78:0/794886044 shutdown_connections 2024-05-21T14:45:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.915+0000 7f0b65c00640 1 -- 172.21.15.78:0/794886044 wait complete. 2024-05-21T14:45:40.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.915+0000 7f0b65c00640 1 Processor -- start 2024-05-21T14:45:40.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.915+0000 7f0b65c00640 1 -- start start 2024-05-21T14:45:40.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.915+0000 7f0b65c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0b600c5c30 0x7f0b60145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.915+0000 7f0b65c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b600c6540 0x7f0b600cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.915+0000 7f0b65c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b600c7f90 0x7f0b60143250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.915+0000 7f0b65c00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6006be30 con 0x7f0b600c6540 2024-05-21T14:45:40.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.915+0000 7f0b65c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6015d1d0 con 0x7f0b600c7f90 2024-05-21T14:45:40.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.915+0000 7f0b65c00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0b6006bfb0 con 0x7f0b600c5c30 2024-05-21T14:45:40.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b5e000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b600c6540 0x7f0b600cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b5e000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b600c6540 0x7f0b600cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49914/0 (socket says 172.21.15.78:49914) 2024-05-21T14:45:40.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b5e000640 1 -- 172.21.15.78:0/4023836147 learned_addr learned my addr 172.21.15.78:0/4023836147 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:40.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b5f400640 1 --2- 172.21.15.78:0/4023836147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b600c7f90 0x7f0b60143250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b5ea00640 1 --2- 172.21.15.78:0/4023836147 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0b600c5c30 0x7f0b60145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b5e000640 1 -- 172.21.15.78:0/4023836147 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0b600c5c30 msgr2=0x7f0b60145ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b5e000640 1 --2- 172.21.15.78:0/4023836147 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0b600c5c30 0x7f0b60145ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b5e000640 1 -- 172.21.15.78:0/4023836147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b600c7f90 msgr2=0x7f0b60143250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:40.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b5e000640 1 --2- 172.21.15.78:0/4023836147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b600c7f90 0x7f0b60143250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:40.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b5e000640 1 -- 172.21.15.78:0/4023836147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b600cba60 con 0x7f0b600c6540 2024-05-21T14:45:40.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b5f400640 1 --2- 172.21.15.78:0/4023836147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b600c7f90 0x7f0b60143250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:45:40.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b5e000640 1 --2- 172.21.15.78:0/4023836147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b600c6540 0x7f0b600cb520 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0ae040 tx=0x7f0b4c0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:40.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b56a00640 1 -- 172.21.15.78:0/4023836147 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0ba070 con 0x7f0b600c6540 2024-05-21T14:45:40.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b56a00640 1 -- 172.21.15.78:0/4023836147 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b4c0b4620 con 0x7f0b600c6540 2024-05-21T14:45:40.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b65c00640 1 -- 172.21.15.78:0/4023836147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b601f5a00 con 0x7f0b600c6540 2024-05-21T14:45:40.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b56a00640 1 -- 172.21.15.78:0/4023836147 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0b0040 con 0x7f0b600c6540 2024-05-21T14:45:40.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b65c00640 1 -- 172.21.15.78:0/4023836147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b601f5cc0 con 0x7f0b600c6540 2024-05-21T14:45:40.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b65c00640 1 -- 172.21.15.78:0/4023836147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b600c7b40 con 0x7f0b600c6540 2024-05-21T14:45:40.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.919+0000 7f0b56a00640 1 -- 172.21.15.78:0/4023836147 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0b4c0bd070 con 0x7f0b600c6540 2024-05-21T14:45:40.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.923+0000 7f0b56a00640 1 --2- 172.21.15.78:0/4023836147 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0b400678f0 0x7f0b40069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:40.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.923+0000 7f0b56a00640 1 -- 172.21.15.78:0/4023836147 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f0b4c11ee70 con 0x7f0b600c6540 2024-05-21T14:45:40.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.923+0000 7f0b5ea00640 1 --2- 172.21.15.78:0/4023836147 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0b400678f0 0x7f0b40069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:40.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.923+0000 7f0b5ea00640 1 --2- 172.21.15.78:0/4023836147 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0b400678f0 0x7f0b40069e00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b50004470 tx=0x7f0b50003a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:40.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:40.927+0000 7f0b56a00640 1 -- 172.21.15.78:0/4023836147 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f0b4c016110 con 0x7f0b600c6540 2024-05-21T14:45:41.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.083+0000 7f0b65c00640 1 -- 172.21.15.78:0/4023836147 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f0b6015d6e0 con 0x7f0b400678f0 2024-05-21T14:45:41.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.083+0000 7f0b56a00640 1 -- 172.21.15.78:0/4023836147 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0b6015d6e0 con 0x7f0b400678f0 2024-05-21T14:45:41.092 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 4 to deep-scrub 2024-05-21T14:45:41.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.083+0000 7f0b65c00640 1 -- 172.21.15.78:0/4023836147 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0b400678f0 msgr2=0x7f0b40069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.083+0000 7f0b65c00640 1 --2- 172.21.15.78:0/4023836147 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0b400678f0 0x7f0b40069e00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b50004470 tx=0x7f0b50003a40 comp rx=0 tx=0).stop 2024-05-21T14:45:41.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.083+0000 7f0b65c00640 1 -- 172.21.15.78:0/4023836147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b600c6540 msgr2=0x7f0b600cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.083+0000 7f0b65c00640 1 --2- 172.21.15.78:0/4023836147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b600c6540 0x7f0b600cb520 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0ae040 tx=0x7f0b4c0192c0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.083+0000 7f0b65c00640 1 -- 172.21.15.78:0/4023836147 shutdown_connections 2024-05-21T14:45:41.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.083+0000 7f0b65c00640 1 --2- 172.21.15.78:0/4023836147 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0b400678f0 0x7f0b40069e00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.083+0000 7f0b65c00640 1 --2- 172.21.15.78:0/4023836147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b600c7f90 0x7f0b60143250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.083+0000 7f0b65c00640 1 --2- 172.21.15.78:0/4023836147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b600c6540 0x7f0b600cb520 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.083+0000 7f0b65c00640 1 --2- 172.21.15.78:0/4023836147 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0b600c5c30 0x7f0b60145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.083+0000 7f0b65c00640 1 -- 172.21.15.78:0/4023836147 >> 172.21.15.78:0/4023836147 conn(0x7f0b600cd1e0 msgr2=0x7f0b601522a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:41.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.083+0000 7f0b65c00640 1 -- 172.21.15.78:0/4023836147 shutdown_connections 2024-05-21T14:45:41.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.083+0000 7f0b65c00640 1 -- 172.21.15.78:0/4023836147 wait complete. 2024-05-21T14:45:41.115 INFO:tasks.ceph:Scrubbing osd.5 2024-05-21T14:45:41.115 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-21T14:45:41.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.255+0000 7f561f400640 1 Processor -- start 2024-05-21T14:45:41.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.255+0000 7f561f400640 1 -- start start 2024-05-21T14:45:41.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.259+0000 7f561f400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f561815ca60 0x7f5618153520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.259+0000 7f561f400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5618074220 0x7f5618163df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.259+0000 7f561f400640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f561815ce70 con 0x7f5618073e10 2024-05-21T14:45:41.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.259+0000 7f561f400640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f5618072140 con 0x7f5618074220 2024-05-21T14:45:41.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.259+0000 7f561f400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f5618072400 con 0x7f561815ca60 2024-05-21T14:45:41.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.259+0000 7f561d400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5618074220 0x7f5618163df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.259+0000 7f560fe00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5618073e10 0x7f56180c5f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53276/0 (socket says 172.21.15.78:53276) 2024-05-21T14:45:41.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.259+0000 7f560fe00640 1 -- 172.21.15.78:0/2720392565 learned_addr learned my addr 172.21.15.78:0/2720392565 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:45:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.259+0000 7f561ca00640 1 --2- 172.21.15.78:0/2720392565 >> v2:172.21.15.84:3300/0 conn(0x7f561815ca60 0x7f5618153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.259+0000 7f5617e00640 1 -- 172.21.15.78:0/2720392565 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3598213428 0 0) 0x7f5600001120 con 0x7f5618073e10 2024-05-21T14:45:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.259+0000 7f5617e00640 1 -- 172.21.15.78:0/2720392565 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55fc003530 con 0x7f5618073e10 2024-05-21T14:45:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.259+0000 7f561d400640 1 -- 172.21.15.78:0/2720392565 >> v2:172.21.15.84:3300/0 conn(0x7f561815ca60 msgr2=0x7f5618153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.259+0000 7f561d400640 1 --2- 172.21.15.78:0/2720392565 >> v2:172.21.15.84:3300/0 conn(0x7f561815ca60 0x7f5618153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.259+0000 7f561d400640 1 -- 172.21.15.78:0/2720392565 >> v1:172.21.15.78:6789/0 conn(0x7f5618073e10 legacy=0x7f56180c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.259+0000 7f561d400640 1 -- 172.21.15.78:0/2720392565 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56180726e0 con 0x7f5618074220 2024-05-21T14:45:41.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.263+0000 7f561d400640 1 --2- 172.21.15.78:0/2720392565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5618074220 0x7f5618163df0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f561806c6e0 tx=0x7f561001f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28184a9405587bb server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:41.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.263+0000 7f5617e00640 1 -- 172.21.15.78:0/2720392565 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56100b4070 con 0x7f5618074220 2024-05-21T14:45:41.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.263+0000 7f5617e00640 1 -- 172.21.15.78:0/2720392565 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56100af600 con 0x7f5618074220 2024-05-21T14:45:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.263+0000 7f5617e00640 1 -- 172.21.15.78:0/2720392565 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56100af9d0 con 0x7f5618074220 2024-05-21T14:45:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.263+0000 7f561f400640 1 -- 172.21.15.78:0/2720392565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5618074220 msgr2=0x7f5618163df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.263+0000 7f561f400640 1 --2- 172.21.15.78:0/2720392565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5618074220 0x7f5618163df0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f561806c6e0 tx=0x7f561001f110 comp rx=0 tx=0).stop 2024-05-21T14:45:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.263+0000 7f561f400640 1 -- 172.21.15.78:0/2720392565 shutdown_connections 2024-05-21T14:45:41.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.263+0000 7f561f400640 1 --2- 172.21.15.78:0/2720392565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5618074220 0x7f5618163df0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.263+0000 7f561f400640 1 --2- 172.21.15.78:0/2720392565 >> v2:172.21.15.84:3300/0 conn(0x7f561815ca60 0x7f5618153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.263+0000 7f561f400640 1 -- 172.21.15.78:0/2720392565 >> 172.21.15.78:0/2720392565 conn(0x7f56180cd1d0 msgr2=0x7f56180c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:41.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.263+0000 7f561f400640 1 -- 172.21.15.78:0/2720392565 shutdown_connections 2024-05-21T14:45:41.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.263+0000 7f561f400640 1 -- 172.21.15.78:0/2720392565 wait complete. 2024-05-21T14:45:41.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561f400640 1 Processor -- start 2024-05-21T14:45:41.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561f400640 1 -- start start 2024-05-21T14:45:41.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561f400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5618073e10 0x7f56180cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561f400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5618074220 0x7f5618158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f561815ca60 0x7f561815beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561f400640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5618073830 con 0x7f5618073e10 2024-05-21T14:45:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561f400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5618159aa0 con 0x7f561815ca60 2024-05-21T14:45:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561f400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f5618159470 con 0x7f5618074220 2024-05-21T14:45:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561ca00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5618073e10 0x7f56180cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561ca00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5618073e10 0x7f56180cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49940/0 (socket says 172.21.15.78:49940) 2024-05-21T14:45:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561ca00640 1 -- 172.21.15.78:0/2710423568 learned_addr learned my addr 172.21.15.78:0/2710423568 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f560fe00640 1 --2- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5618074220 0x7f5618158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561ca00640 1 -- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5618074220 msgr2=0x7f5618158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561d400640 1 --2- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f561815ca60 0x7f561815beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561ca00640 1 --2- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5618074220 0x7f5618158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561ca00640 1 -- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f561815ca60 msgr2=0x7f561815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561ca00640 1 --2- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f561815ca60 0x7f561815beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561ca00640 1 -- 172.21.15.78:0/2710423568 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56180cb980 con 0x7f5618073e10 2024-05-21T14:45:41.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f560fe00640 1 --2- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5618074220 0x7f5618158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:45:41.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561d400640 1 --2- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f561815ca60 0x7f561815beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T14:45:41.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561ca00640 1 --2- 172.21.15.78:0/2710423568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5618073e10 0x7f56180cb440 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f560800e8a0 tx=0x7f560800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:41.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f5615600640 1 -- 172.21.15.78:0/2710423568 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608017070 con 0x7f5618073e10 2024-05-21T14:45:41.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f5615600640 1 -- 172.21.15.78:0/2710423568 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560800c940 con 0x7f5618073e10 2024-05-21T14:45:41.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561f400640 1 -- 172.21.15.78:0/2710423568 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56181f1190 con 0x7f5618073e10 2024-05-21T14:45:41.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f5615600640 1 -- 172.21.15.78:0/2710423568 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560800ccf0 con 0x7f5618073e10 2024-05-21T14:45:41.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.267+0000 7f561f400640 1 -- 172.21.15.78:0/2710423568 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56180ca960 con 0x7f5618073e10 2024-05-21T14:45:41.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.271+0000 7f561f400640 1 -- 172.21.15.78:0/2710423568 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f561804f730 con 0x7f5618073e10 2024-05-21T14:45:41.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.271+0000 7f5615600640 1 -- 172.21.15.78:0/2710423568 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f560801a070 con 0x7f5618073e10 2024-05-21T14:45:41.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.271+0000 7f5615600640 1 --2- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f55f40678c0 0x7f55f4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.271+0000 7f5615600640 1 -- 172.21.15.78:0/2710423568 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f56080860c0 con 0x7f5618073e10 2024-05-21T14:45:41.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.271+0000 7f5615600640 1 --2- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:6824/3186857851,v1:172.21.15.84:6825/3186857851] conn(0x7f55f406fb70 0x7f55f4071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.271+0000 7f5615600640 1 -- 172.21.15.78:0/2710423568 --> [v2:172.21.15.84:6824/3186857851,v1:172.21.15.84:6825/3186857851] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5608014e50 con 0x7f55f406fb70 2024-05-21T14:45:41.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.271+0000 7f5615600640 1 -- 172.21.15.78:0/2710423568 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5608086470 con 0x7f5618073e10 2024-05-21T14:45:41.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.271+0000 7f560fe00640 1 --2- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f55f40678c0 0x7f55f4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.271+0000 7f561d400640 1 --2- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:6824/3186857851,v1:172.21.15.84:6825/3186857851] conn(0x7f55f406fb70 0x7f55f4071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.271+0000 7f560fe00640 1 --2- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f55f40678c0 0x7f55f4069dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5600007fd0 tx=0x7f5600009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:41.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.275+0000 7f561d400640 1 --2- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:6824/3186857851,v1:172.21.15.84:6825/3186857851] conn(0x7f55f406fb70 0x7f55f4071fe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:41.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.275+0000 7f5615600640 1 -- 172.21.15.78:0/2710423568 <== osd.5 v2:172.21.15.84:6824/3186857851 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5608014e50 con 0x7f55f406fb70 2024-05-21T14:45:41.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.287+0000 7f561f400640 1 -- 172.21.15.78:0/2710423568 --> [v2:172.21.15.84:6824/3186857851,v1:172.21.15.84:6825/3186857851] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f561815d8a0 con 0x7f55f406fb70 2024-05-21T14:45:41.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.287+0000 7f5615600640 1 -- 172.21.15.78:0/2710423568 <== osd.5 v2:172.21.15.84:6824/3186857851 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f561815d8a0 con 0x7f55f406fb70 2024-05-21T14:45:41.299 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-05-21T14:45:41.299 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T14:45:41.299 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-05-21T14:45:41.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.291+0000 7f561f400640 1 -- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:6824/3186857851,v1:172.21.15.84:6825/3186857851] conn(0x7f55f406fb70 msgr2=0x7f55f4071fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.291+0000 7f561f400640 1 --2- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:6824/3186857851,v1:172.21.15.84:6825/3186857851] conn(0x7f55f406fb70 0x7f55f4071fe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.291+0000 7f561f400640 1 -- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f55f40678c0 msgr2=0x7f55f4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.291+0000 7f561f400640 1 --2- 172.21.15.78:0/2710423568 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f55f40678c0 0x7f55f4069dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5600007fd0 tx=0x7f5600009040 comp rx=0 tx=0).stop 2024-05-21T14:45:41.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.291+0000 7f561f400640 1 -- 172.21.15.78:0/2710423568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5618073e10 msgr2=0x7f56180cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.291+0000 7f561f400640 1 --2- 172.21.15.78:0/2710423568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5618073e10 0x7f56180cb440 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f560800e8a0 tx=0x7f560800eca0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.291+0000 7f561d400640 1 -- 172.21.15.78:0/2710423568 reap_dead start 2024-05-21T14:45:41.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.291+0000 7f561f400640 1 -- 172.21.15.78:0/2710423568 shutdown_connections 2024-05-21T14:45:41.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.291+0000 7f561f400640 1 -- 172.21.15.78:0/2710423568 >> 172.21.15.78:0/2710423568 conn(0x7f56180cd1d0 msgr2=0x7f5618149320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:41.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.291+0000 7f561f400640 1 -- 172.21.15.78:0/2710423568 shutdown_connections 2024-05-21T14:45:41.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.291+0000 7f561f400640 1 -- 172.21.15.78:0/2710423568 wait complete. 2024-05-21T14:45:41.318 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-21T14:45:41.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.455+0000 7fba6da00640 1 Processor -- start 2024-05-21T14:45:41.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.455+0000 7fba6da00640 1 -- start start 2024-05-21T14:45:41.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.459+0000 7fba6da00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fba68072d40 0x7fba68151e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.459+0000 7fba6da00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fba680717e0 0x7fba68162600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.459+0000 7fba6da00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba680c8a60 con 0x7fba680713d0 2024-05-21T14:45:41.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.459+0000 7fba6da00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fba680c8d40 con 0x7fba68072d40 2024-05-21T14:45:41.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.459+0000 7fba6da00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fba68157e90 con 0x7fba680717e0 2024-05-21T14:45:41.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.459+0000 7fba66a00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fba68072d40 0x7fba68151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.459+0000 7fba5e000640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fba680713d0 0x7fba6806b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53288/0 (socket says 172.21.15.78:53288) 2024-05-21T14:45:41.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.459+0000 7fba5e000640 1 -- 172.21.15.78:0/4004069876 learned_addr learned my addr 172.21.15.78:0/4004069876 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:45:41.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.459+0000 7fba67400640 1 --2- 172.21.15.78:0/4004069876 >> v2:172.21.15.84:3300/0 conn(0x7fba680717e0 0x7fba68162600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.459+0000 7fba66a00640 1 -- 172.21.15.78:0/4004069876 >> v2:172.21.15.84:3300/0 conn(0x7fba680717e0 msgr2=0x7fba68162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:41.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.459+0000 7fba66a00640 1 --2- 172.21.15.78:0/4004069876 >> v2:172.21.15.84:3300/0 conn(0x7fba680717e0 0x7fba68162600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.459+0000 7fba66a00640 1 -- 172.21.15.78:0/4004069876 >> v1:172.21.15.78:6789/0 conn(0x7fba680713d0 legacy=0x7fba6806b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.459+0000 7fba66a00640 1 -- 172.21.15.78:0/4004069876 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba68158170 con 0x7fba68072d40 2024-05-21T14:45:41.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.459+0000 7fba67400640 1 --2- 172.21.15.78:0/4004069876 >> v2:172.21.15.84:3300/0 conn(0x7fba680717e0 0x7fba68162600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:45:41.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.463+0000 7fba66a00640 1 --2- 172.21.15.78:0/4004069876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba68072d40 0x7fba68151e00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fba6806ca70 tx=0x7fba5801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b05a188f185045 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:41.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.463+0000 7fba66000640 1 -- 172.21.15.78:0/4004069876 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba580b0070 con 0x7fba68072d40 2024-05-21T14:45:41.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.463+0000 7fba66000640 1 -- 172.21.15.78:0/4004069876 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba580ab600 con 0x7fba68072d40 2024-05-21T14:45:41.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.463+0000 7fba66000640 1 -- 172.21.15.78:0/4004069876 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba580ab9d0 con 0x7fba68072d40 2024-05-21T14:45:41.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.463+0000 7fba6da00640 1 -- 172.21.15.78:0/4004069876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba68072d40 msgr2=0x7fba68151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.463+0000 7fba6da00640 1 --2- 172.21.15.78:0/4004069876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba68072d40 0x7fba68151e00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fba6806ca70 tx=0x7fba5801c480 comp rx=0 tx=0).stop 2024-05-21T14:45:41.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.463+0000 7fba6da00640 1 -- 172.21.15.78:0/4004069876 shutdown_connections 2024-05-21T14:45:41.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.463+0000 7fba6da00640 1 --2- 172.21.15.78:0/4004069876 >> v2:172.21.15.84:3300/0 conn(0x7fba680717e0 0x7fba68162600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.463+0000 7fba6da00640 1 --2- 172.21.15.78:0/4004069876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba68072d40 0x7fba68151e00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.463+0000 7fba6da00640 1 -- 172.21.15.78:0/4004069876 >> 172.21.15.78:0/4004069876 conn(0x7fba680cd1e0 msgr2=0x7fba680c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:41.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.463+0000 7fba6da00640 1 -- 172.21.15.78:0/4004069876 shutdown_connections 2024-05-21T14:45:41.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.463+0000 7fba6da00640 1 -- 172.21.15.78:0/4004069876 wait complete. 2024-05-21T14:45:41.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.463+0000 7fba6da00640 1 Processor -- start 2024-05-21T14:45:41.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.463+0000 7fba6da00640 1 -- start start 2024-05-21T14:45:41.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba6da00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba680713d0 0x7fba68159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba6da00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fba680717e0 0x7fba6815a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba6da00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba68072d40 0x7fba681f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba6da00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fba680c8810 con 0x7fba68072d40 2024-05-21T14:45:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba6da00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fba680c8690 con 0x7fba680713d0 2024-05-21T14:45:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba6da00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fba6806bd30 con 0x7fba680717e0 2024-05-21T14:45:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba67400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba68072d40 0x7fba681f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba67400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba68072d40 0x7fba681f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49960/0 (socket says 172.21.15.78:49960) 2024-05-21T14:45:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba67400640 1 -- 172.21.15.78:0/3654081232 learned_addr learned my addr 172.21.15.78:0/3654081232 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba5e000640 1 --2- 172.21.15.78:0/3654081232 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fba680717e0 0x7fba6815a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba66a00640 1 --2- 172.21.15.78:0/3654081232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba680713d0 0x7fba68159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba67400640 1 -- 172.21.15.78:0/3654081232 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fba680717e0 msgr2=0x7fba6815a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba67400640 1 --2- 172.21.15.78:0/3654081232 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fba680717e0 0x7fba6815a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba67400640 1 -- 172.21.15.78:0/3654081232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba680713d0 msgr2=0x7fba68159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba67400640 1 --2- 172.21.15.78:0/3654081232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba680713d0 0x7fba68159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba67400640 1 -- 172.21.15.78:0/3654081232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6814b3c0 con 0x7fba68072d40 2024-05-21T14:45:41.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba67400640 1 --2- 172.21.15.78:0/3654081232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba68072d40 0x7fba681f5a10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fba60007df0 tx=0x7fba6000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:41.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba5f400640 1 -- 172.21.15.78:0/3654081232 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6001a070 con 0x7fba68072d40 2024-05-21T14:45:41.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba5f400640 1 -- 172.21.15.78:0/3654081232 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba600039a0 con 0x7fba68072d40 2024-05-21T14:45:41.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba5f400640 1 -- 172.21.15.78:0/3654081232 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba60003d90 con 0x7fba68072d40 2024-05-21T14:45:41.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba6da00640 1 -- 172.21.15.78:0/3654081232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba68166a60 con 0x7fba68072d40 2024-05-21T14:45:41.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba6da00640 1 -- 172.21.15.78:0/3654081232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba6815bf00 con 0x7fba68072d40 2024-05-21T14:45:41.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.467+0000 7fba6da00640 1 -- 172.21.15.78:0/3654081232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba681667c0 con 0x7fba68072d40 2024-05-21T14:45:41.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.471+0000 7fba5f400640 1 -- 172.21.15.78:0/3654081232 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fba6001d070 con 0x7fba68072d40 2024-05-21T14:45:41.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.471+0000 7fba5f400640 1 --2- 172.21.15.78:0/3654081232 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fba440678f0 0x7fba44069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.471+0000 7fba5f400640 1 -- 172.21.15.78:0/3654081232 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fba60085e90 con 0x7fba68072d40 2024-05-21T14:45:41.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.471+0000 7fba66a00640 1 --2- 172.21.15.78:0/3654081232 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fba440678f0 0x7fba44069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.471+0000 7fba66a00640 1 --2- 172.21.15.78:0/3654081232 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fba440678f0 0x7fba44069e00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fba580ad000 tx=0x7fba580a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:41.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.475+0000 7fba5f400640 1 -- 172.21.15.78:0/3654081232 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fba681667c0 con 0x7fba68072d40 2024-05-21T14:45:41.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.631+0000 7fba6da00640 1 -- 172.21.15.78:0/3654081232 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fba6804f730 con 0x7fba440678f0 2024-05-21T14:45:41.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.631+0000 7fba5f400640 1 -- 172.21.15.78:0/3654081232 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fba6804f730 con 0x7fba440678f0 2024-05-21T14:45:41.643 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 5 to deep-scrub 2024-05-21T14:45:41.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.635+0000 7fba6da00640 1 -- 172.21.15.78:0/3654081232 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fba440678f0 msgr2=0x7fba44069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.635+0000 7fba6da00640 1 --2- 172.21.15.78:0/3654081232 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fba440678f0 0x7fba44069e00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fba580ad000 tx=0x7fba580a6000 comp rx=0 tx=0).stop 2024-05-21T14:45:41.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.635+0000 7fba6da00640 1 -- 172.21.15.78:0/3654081232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba68072d40 msgr2=0x7fba681f5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.635+0000 7fba6da00640 1 --2- 172.21.15.78:0/3654081232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba68072d40 0x7fba681f5a10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fba60007df0 tx=0x7fba6000d4a0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.635+0000 7fba6da00640 1 -- 172.21.15.78:0/3654081232 shutdown_connections 2024-05-21T14:45:41.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.635+0000 7fba6da00640 1 --2- 172.21.15.78:0/3654081232 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fba440678f0 0x7fba44069e00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.635+0000 7fba6da00640 1 --2- 172.21.15.78:0/3654081232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba68072d40 0x7fba681f5a10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.635+0000 7fba6da00640 1 --2- 172.21.15.78:0/3654081232 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fba680717e0 0x7fba6815a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.635+0000 7fba6da00640 1 --2- 172.21.15.78:0/3654081232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba680713d0 0x7fba68159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.635+0000 7fba6da00640 1 -- 172.21.15.78:0/3654081232 >> 172.21.15.78:0/3654081232 conn(0x7fba680cd1e0 msgr2=0x7fba68072280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:41.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.635+0000 7fba6da00640 1 -- 172.21.15.78:0/3654081232 shutdown_connections 2024-05-21T14:45:41.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.635+0000 7fba6da00640 1 -- 172.21.15.78:0/3654081232 wait complete. 2024-05-21T14:45:41.665 INFO:tasks.ceph:Scrubbing osd.6 2024-05-21T14:45:41.665 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-21T14:45:41.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.807+0000 7fdebc400640 1 Processor -- start 2024-05-21T14:45:41.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.807+0000 7fdebc400640 1 -- start start 2024-05-21T14:45:41.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.811+0000 7fdebc400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdeb415ca60 0x7fdeb4153520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.811+0000 7fdebc400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdeb4073e10 0x7fdeb4074220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.811+0000 7fdebc400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeb415ce70 con 0x7fdeb40c5f20 2024-05-21T14:45:41.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.811+0000 7fdebc400640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fdeb4072140 con 0x7fdeb4073e10 2024-05-21T14:45:41.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.811+0000 7fdebc400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fdeb4072400 con 0x7fdeb415ca60 2024-05-21T14:45:41.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.811+0000 7fdeb9000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdeb4073e10 0x7fdeb4074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.811+0000 7fdeb9000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdeb4073e10 0x7fdeb4074220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49962/0 (socket says 172.21.15.78:49962) 2024-05-21T14:45:41.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.811+0000 7fdeb9000640 1 -- 172.21.15.78:0/357805457 learned_addr learned my addr 172.21.15.78:0/357805457 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:41.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.811+0000 7fdeb9a00640 1 --2- 172.21.15.78:0/357805457 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdeb415ca60 0x7fdeb4153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.811+0000 7fdeb9000640 1 -- 172.21.15.78:0/357805457 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdeb415ca60 msgr2=0x7fdeb4153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:41.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.811+0000 7fdeb9000640 1 --2- 172.21.15.78:0/357805457 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdeb415ca60 0x7fdeb4153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.811+0000 7fdeb9000640 1 -- 172.21.15.78:0/357805457 >> v1:172.21.15.84:6789/0 conn(0x7fdeb40c5f20 legacy=0x7fdeb406b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.811+0000 7fdeb9000640 1 -- 172.21.15.78:0/357805457 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb40726e0 con 0x7fdeb4073e10 2024-05-21T14:45:41.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.815+0000 7fdeb9000640 1 --2- 172.21.15.78:0/357805457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdeb4073e10 0x7fdeb4074220 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009870 tx=0x7fdea001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4414f22e69f872 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:41.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.815+0000 7fdeb3e00640 1 -- 172.21.15.78:0/357805457 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea00b5070 con 0x7fdeb4073e10 2024-05-21T14:45:41.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.815+0000 7fdeb3e00640 1 -- 172.21.15.78:0/357805457 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea00a8a50 con 0x7fdeb4073e10 2024-05-21T14:45:41.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.815+0000 7fdeb3e00640 1 -- 172.21.15.78:0/357805457 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea00a8e20 con 0x7fdeb4073e10 2024-05-21T14:45:41.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.815+0000 7fdebc400640 1 -- 172.21.15.78:0/357805457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdeb4073e10 msgr2=0x7fdeb4074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.815+0000 7fdebc400640 1 --2- 172.21.15.78:0/357805457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdeb4073e10 0x7fdeb4074220 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009870 tx=0x7fdea001ed50 comp rx=0 tx=0).stop 2024-05-21T14:45:41.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.815+0000 7fdebc400640 1 -- 172.21.15.78:0/357805457 shutdown_connections 2024-05-21T14:45:41.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.815+0000 7fdebc400640 1 --2- 172.21.15.78:0/357805457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdeb4073e10 0x7fdeb4074220 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.815+0000 7fdebc400640 1 --2- 172.21.15.78:0/357805457 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdeb415ca60 0x7fdeb4153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.815+0000 7fdebc400640 1 -- 172.21.15.78:0/357805457 >> 172.21.15.78:0/357805457 conn(0x7fdeb40cd1d0 msgr2=0x7fdeb40c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:41.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.815+0000 7fdebc400640 1 -- 172.21.15.78:0/357805457 shutdown_connections 2024-05-21T14:45:41.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.815+0000 7fdebc400640 1 -- 172.21.15.78:0/357805457 wait complete. 2024-05-21T14:45:41.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.815+0000 7fdebc400640 1 Processor -- start 2024-05-21T14:45:41.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.815+0000 7fdebc400640 1 -- start start 2024-05-21T14:45:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdebc400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdeb4073e10 0x7fdeb41f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdebc400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdeb40c5f20 0x7fdeb40c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdebc400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeb415ca60 0x7fdeb41474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdebc400640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb4073830 con 0x7fdeb4073e10 2024-05-21T14:45:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdebc400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb4159aa0 con 0x7fdeb415ca60 2024-05-21T14:45:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdebc400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fdeb4159470 con 0x7fdeb40c5f20 2024-05-21T14:45:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdeb9a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdeb4073e10 0x7fdeb41f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdeb9a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdeb4073e10 0x7fdeb41f02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49968/0 (socket says 172.21.15.78:49968) 2024-05-21T14:45:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdeb9a00640 1 -- 172.21.15.78:0/1807321161 learned_addr learned my addr 172.21.15.78:0/1807321161 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdeb9000640 1 --2- 172.21.15.78:0/1807321161 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdeb40c5f20 0x7fdeb40c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdeba400640 1 --2- 172.21.15.78:0/1807321161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeb415ca60 0x7fdeb41474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdeb9a00640 1 -- 172.21.15.78:0/1807321161 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdeb40c5f20 msgr2=0x7fdeb40c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdeb9a00640 1 --2- 172.21.15.78:0/1807321161 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdeb40c5f20 0x7fdeb40c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdeb9a00640 1 -- 172.21.15.78:0/1807321161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeb415ca60 msgr2=0x7fdeb41474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdeb9a00640 1 --2- 172.21.15.78:0/1807321161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeb415ca60 0x7fdeb41474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdeb9a00640 1 -- 172.21.15.78:0/1807321161 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb41f07e0 con 0x7fdeb4073e10 2024-05-21T14:45:41.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdeb9a00640 1 --2- 172.21.15.78:0/1807321161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdeb4073e10 0x7fdeb41f02a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdea800e8a0 tx=0x7fdea800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:41.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdeb1600640 1 -- 172.21.15.78:0/1807321161 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea8017070 con 0x7fdeb4073e10 2024-05-21T14:45:41.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdeb1600640 1 -- 172.21.15.78:0/1807321161 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea800c940 con 0x7fdeb4073e10 2024-05-21T14:45:41.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdebc400640 1 -- 172.21.15.78:0/1807321161 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb414f050 con 0x7fdeb4073e10 2024-05-21T14:45:41.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdeb1600640 1 -- 172.21.15.78:0/1807321161 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea800ccf0 con 0x7fdeb4073e10 2024-05-21T14:45:41.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdebc400640 1 -- 172.21.15.78:0/1807321161 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeb414f610 con 0x7fdeb4073e10 2024-05-21T14:45:41.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.819+0000 7fdebc400640 1 -- 172.21.15.78:0/1807321161 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdeb404f730 con 0x7fdeb4073e10 2024-05-21T14:45:41.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.823+0000 7fdeb1600640 1 -- 172.21.15.78:0/1807321161 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdea801a070 con 0x7fdeb4073e10 2024-05-21T14:45:41.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.823+0000 7fdeb1600640 1 --2- 172.21.15.78:0/1807321161 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fde940678c0 0x7fde94069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.823+0000 7fdeb1600640 1 -- 172.21.15.78:0/1807321161 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fdea8085bd0 con 0x7fdeb4073e10 2024-05-21T14:45:41.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.823+0000 7fdeb1600640 1 --2- 172.21.15.78:0/1807321161 >> [v2:172.21.15.84:6803/4084754024,v1:172.21.15.84:6805/4084754024] conn(0x7fde9406fb70 0x7fde94071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:41.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.823+0000 7fdeb1600640 1 -- 172.21.15.78:0/1807321161 --> [v2:172.21.15.84:6803/4084754024,v1:172.21.15.84:6805/4084754024] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdea8008eb0 con 0x7fde9406fb70 2024-05-21T14:45:41.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.823+0000 7fdeb1600640 1 -- 172.21.15.78:0/1807321161 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdea808a2a0 con 0x7fdeb4073e10 2024-05-21T14:45:41.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.823+0000 7fdeb9000640 1 --2- 172.21.15.78:0/1807321161 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fde940678c0 0x7fde94069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.823+0000 7fdeba400640 1 --2- 172.21.15.78:0/1807321161 >> [v2:172.21.15.84:6803/4084754024,v1:172.21.15.84:6805/4084754024] conn(0x7fde9406fb70 0x7fde94071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:41.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.823+0000 7fdeb9000640 1 --2- 172.21.15.78:0/1807321161 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fde940678c0 0x7fde94069dd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdea00b2000 tx=0x7fdea0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:41.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.823+0000 7fdeba400640 1 --2- 172.21.15.78:0/1807321161 >> [v2:172.21.15.84:6803/4084754024,v1:172.21.15.84:6805/4084754024] conn(0x7fde9406fb70 0x7fde94071fe0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:41.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.827+0000 7fdeb1600640 1 -- 172.21.15.78:0/1807321161 <== osd.6 v2:172.21.15.84:6803/4084754024 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdea8008eb0 con 0x7fde9406fb70 2024-05-21T14:45:41.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.839+0000 7fdebc400640 1 -- 172.21.15.78:0/1807321161 --> [v2:172.21.15.84:6803/4084754024,v1:172.21.15.84:6805/4084754024] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdeb40c7d20 con 0x7fde9406fb70 2024-05-21T14:45:41.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.839+0000 7fdeb1600640 1 -- 172.21.15.78:0/1807321161 <== osd.6 v2:172.21.15.84:6803/4084754024 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdeb40c7d20 con 0x7fde9406fb70 2024-05-21T14:45:41.849 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-05-21T14:45:41.850 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T14:45:41.850 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-05-21T14:45:41.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.839+0000 7fdebc400640 1 -- 172.21.15.78:0/1807321161 >> [v2:172.21.15.84:6803/4084754024,v1:172.21.15.84:6805/4084754024] conn(0x7fde9406fb70 msgr2=0x7fde94071fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.839+0000 7fdebc400640 1 --2- 172.21.15.78:0/1807321161 >> [v2:172.21.15.84:6803/4084754024,v1:172.21.15.84:6805/4084754024] conn(0x7fde9406fb70 0x7fde94071fe0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.839+0000 7fdebc400640 1 -- 172.21.15.78:0/1807321161 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fde940678c0 msgr2=0x7fde94069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.839+0000 7fdebc400640 1 --2- 172.21.15.78:0/1807321161 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fde940678c0 0x7fde94069dd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdea00b2000 tx=0x7fdea0008040 comp rx=0 tx=0).stop 2024-05-21T14:45:41.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.839+0000 7fdebc400640 1 -- 172.21.15.78:0/1807321161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdeb4073e10 msgr2=0x7fdeb41f02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:41.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.839+0000 7fdebc400640 1 --2- 172.21.15.78:0/1807321161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdeb4073e10 0x7fdeb41f02a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdea800e8a0 tx=0x7fdea800eca0 comp rx=0 tx=0).stop 2024-05-21T14:45:41.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.839+0000 7fdeba400640 1 -- 172.21.15.78:0/1807321161 reap_dead start 2024-05-21T14:45:41.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.839+0000 7fdebc400640 1 -- 172.21.15.78:0/1807321161 shutdown_connections 2024-05-21T14:45:41.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.839+0000 7fdebc400640 1 -- 172.21.15.78:0/1807321161 >> 172.21.15.78:0/1807321161 conn(0x7fdeb40cd1d0 msgr2=0x7fdeb41e51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:41.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.839+0000 7fdebc400640 1 -- 172.21.15.78:0/1807321161 shutdown_connections 2024-05-21T14:45:41.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:41.839+0000 7fdebc400640 1 -- 172.21.15.78:0/1807321161 wait complete. 2024-05-21T14:45:41.868 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-21T14:45:42.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.007+0000 7f1b1ac00640 1 Processor -- start 2024-05-21T14:45:42.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.007+0000 7f1b1ac00640 1 -- start start 2024-05-21T14:45:42.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.007+0000 7f1b1ac00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1b14161e30 0x7f1b14164250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.007+0000 7f1b1ac00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b140737e0 con 0x7f1b141527a0 2024-05-21T14:45:42.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.007+0000 7f1b1ac00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b14073aa0 con 0x7f1b140733d0 2024-05-21T14:45:42.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.007+0000 7f1b1ac00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f1b14072980 con 0x7f1b14161e30 2024-05-21T14:45:42.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.007+0000 7f1b0b400640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1b141527a0 0x7f1b140c5440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53294/0 (socket says 172.21.15.78:53294) 2024-05-21T14:45:42.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.007+0000 7f1b0b400640 1 -- 172.21.15.78:0/732649420 learned_addr learned my addr 172.21.15.78:0/732649420 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:45:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.007+0000 7f1b18c00640 1 --2- 172.21.15.78:0/732649420 >> v2:172.21.15.84:3300/0 conn(0x7f1b14161e30 0x7f1b14164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.007+0000 7f1b13400640 1 -- 172.21.15.78:0/732649420 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4093500117 0 0) 0x7f1b140737e0 con 0x7f1b141527a0 2024-05-21T14:45:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.007+0000 7f1b13400640 1 -- 172.21.15.78:0/732649420 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1af8003530 con 0x7f1b141527a0 2024-05-21T14:45:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.007+0000 7f1b13400640 1 -- 172.21.15.78:0/732649420 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 100924071 0 0) 0x7f1af8003530 con 0x7f1b141527a0 2024-05-21T14:45:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.007+0000 7f1b18c00640 1 -- 172.21.15.78:0/732649420 >> v1:172.21.15.84:6789/0 conn(0x7f1b140733d0 legacy=0x7f1b14071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.007+0000 7f1b18c00640 1 -- 172.21.15.78:0/732649420 >> v1:172.21.15.78:6789/0 conn(0x7f1b141527a0 legacy=0x7f1b140c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.007+0000 7f1b18c00640 1 -- 172.21.15.78:0/732649420 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b14073d80 con 0x7f1b14161e30 2024-05-21T14:45:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.011+0000 7f1b18c00640 1 --2- 172.21.15.78:0/732649420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b14161e30 0x7f1b14164250 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009d90 tx=0x7f1b0c01f080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc19d759b8ae6e37 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:42.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.011+0000 7f1b13400640 1 -- 172.21.15.78:0/732649420 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c0b5070 con 0x7f1b14161e30 2024-05-21T14:45:42.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.011+0000 7f1b13400640 1 -- 172.21.15.78:0/732649420 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b0c0a8c10 con 0x7f1b14161e30 2024-05-21T14:45:42.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.011+0000 7f1b13400640 1 -- 172.21.15.78:0/732649420 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc001680 con 0x7f1b14161e30 2024-05-21T14:45:42.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.011+0000 7f1b1ac00640 1 -- 172.21.15.78:0/732649420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b14161e30 msgr2=0x7f1b14164250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.011+0000 7f1b1ac00640 1 --2- 172.21.15.78:0/732649420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b14161e30 0x7f1b14164250 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009d90 tx=0x7f1b0c01f080 comp rx=0 tx=0).stop 2024-05-21T14:45:42.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.011+0000 7f1b1ac00640 1 -- 172.21.15.78:0/732649420 shutdown_connections 2024-05-21T14:45:42.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.011+0000 7f1b1ac00640 1 --2- 172.21.15.78:0/732649420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b14161e30 0x7f1b14164250 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.011+0000 7f1b1ac00640 1 -- 172.21.15.78:0/732649420 >> 172.21.15.78:0/732649420 conn(0x7f1b140cd1e0 msgr2=0x7f1b140c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:42.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.011+0000 7f1b1ac00640 1 -- 172.21.15.78:0/732649420 shutdown_connections 2024-05-21T14:45:42.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.011+0000 7f1b1ac00640 1 -- 172.21.15.78:0/732649420 wait complete. 2024-05-21T14:45:42.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b1ac00640 1 Processor -- start 2024-05-21T14:45:42.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b1ac00640 1 -- start start 2024-05-21T14:45:42.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b1ac00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1b140733d0 0x7f1b141f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b1ac00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b141527a0 0x7f1b1414b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b1ac00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b14161e30 0x7f1b14157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b1ac00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1b14072bd0 con 0x7f1b14161e30 2024-05-21T14:45:42.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b1ac00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1b14072f40 con 0x7f1b141527a0 2024-05-21T14:45:42.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b1ac00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1b140ca100 con 0x7f1b140733d0 2024-05-21T14:45:42.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b18c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b14161e30 0x7f1b14157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b18c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b14161e30 0x7f1b14157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49976/0 (socket says 172.21.15.78:49976) 2024-05-21T14:45:42.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b18c00640 1 -- 172.21.15.78:0/1071703873 learned_addr learned my addr 172.21.15.78:0/1071703873 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:42.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b0b400640 1 --2- 172.21.15.78:0/1071703873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b141527a0 0x7f1b1414b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b13e00640 1 --2- 172.21.15.78:0/1071703873 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1b140733d0 0x7f1b141f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b18c00640 1 -- 172.21.15.78:0/1071703873 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1b140733d0 msgr2=0x7f1b141f58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b18c00640 1 --2- 172.21.15.78:0/1071703873 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1b140733d0 0x7f1b141f58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b18c00640 1 -- 172.21.15.78:0/1071703873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b141527a0 msgr2=0x7f1b1414b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b18c00640 1 --2- 172.21.15.78:0/1071703873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b141527a0 0x7f1b1414b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b18c00640 1 -- 172.21.15.78:0/1071703873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1406fa40 con 0x7f1b14161e30 2024-05-21T14:45:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b0b400640 1 --2- 172.21.15.78:0/1071703873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b141527a0 0x7f1b1414b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:45:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.015+0000 7f1b13e00640 1 --2- 172.21.15.78:0/1071703873 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1b140733d0 0x7f1b141f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:45:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.019+0000 7f1b18c00640 1 --2- 172.21.15.78:0/1071703873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b14161e30 0x7f1b14157430 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c01bc90 tx=0x7f1b0c01be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.019+0000 7f1b10c00640 1 -- 172.21.15.78:0/1071703873 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c0b5040 con 0x7f1b14161e30 2024-05-21T14:45:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.019+0000 7f1b10c00640 1 -- 172.21.15.78:0/1071703873 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b0c0c1070 con 0x7f1b14161e30 2024-05-21T14:45:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.019+0000 7f1b1ac00640 1 -- 172.21.15.78:0/1071703873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b141f5e30 con 0x7f1b14161e30 2024-05-21T14:45:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.019+0000 7f1b10c00640 1 -- 172.21.15.78:0/1071703873 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c004460 con 0x7f1b14161e30 2024-05-21T14:45:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.019+0000 7f1b1ac00640 1 -- 172.21.15.78:0/1071703873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b14151120 con 0x7f1b14161e30 2024-05-21T14:45:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.019+0000 7f1b1ac00640 1 -- 172.21.15.78:0/1071703873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b140c8a20 con 0x7f1b14161e30 2024-05-21T14:45:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.019+0000 7f1b10c00640 1 -- 172.21.15.78:0/1071703873 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b0c004600 con 0x7f1b14161e30 2024-05-21T14:45:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.019+0000 7f1b10c00640 1 --2- 172.21.15.78:0/1071703873 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1af00678c0 0x7f1af0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.019+0000 7f1b10c00640 1 -- 172.21.15.78:0/1071703873 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f1b0c124260 con 0x7f1b14161e30 2024-05-21T14:45:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.019+0000 7f1b13e00640 1 --2- 172.21.15.78:0/1071703873 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1af00678c0 0x7f1af0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.023+0000 7f1b13e00640 1 --2- 172.21.15.78:0/1071703873 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1af00678c0 0x7f1af0069dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1b04000f70 tx=0x7f1b04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:42.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.023+0000 7f1b10c00640 1 -- 172.21.15.78:0/1071703873 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1b0c018be0 con 0x7f1b14161e30 2024-05-21T14:45:42.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.183+0000 7f1b1ac00640 1 -- 172.21.15.78:0/1071703873 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f1b1406bff0 con 0x7f1af00678c0 2024-05-21T14:45:42.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.183+0000 7f1b10c00640 1 -- 172.21.15.78:0/1071703873 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1b1406bff0 con 0x7f1af00678c0 2024-05-21T14:45:42.194 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 6 to deep-scrub 2024-05-21T14:45:42.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.187+0000 7f1b1ac00640 1 -- 172.21.15.78:0/1071703873 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1af00678c0 msgr2=0x7f1af0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.187+0000 7f1b1ac00640 1 --2- 172.21.15.78:0/1071703873 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1af00678c0 0x7f1af0069dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1b04000f70 tx=0x7f1b04009040 comp rx=0 tx=0).stop 2024-05-21T14:45:42.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.187+0000 7f1b1ac00640 1 -- 172.21.15.78:0/1071703873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b14161e30 msgr2=0x7f1b14157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.187+0000 7f1b1ac00640 1 --2- 172.21.15.78:0/1071703873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b14161e30 0x7f1b14157430 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c01bc90 tx=0x7f1b0c01be20 comp rx=0 tx=0).stop 2024-05-21T14:45:42.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.187+0000 7f1b1ac00640 1 -- 172.21.15.78:0/1071703873 shutdown_connections 2024-05-21T14:45:42.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.187+0000 7f1b1ac00640 1 --2- 172.21.15.78:0/1071703873 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1af00678c0 0x7f1af0069dd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.187+0000 7f1b1ac00640 1 --2- 172.21.15.78:0/1071703873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b14161e30 0x7f1b14157430 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.187+0000 7f1b1ac00640 1 --2- 172.21.15.78:0/1071703873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b141527a0 0x7f1b1414b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.187+0000 7f1b1ac00640 1 --2- 172.21.15.78:0/1071703873 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1b140733d0 0x7f1b141f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.187+0000 7f1b1ac00640 1 -- 172.21.15.78:0/1071703873 >> 172.21.15.78:0/1071703873 conn(0x7f1b140cd1e0 msgr2=0x7f1b14160fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.187+0000 7f1b1ac00640 1 -- 172.21.15.78:0/1071703873 shutdown_connections 2024-05-21T14:45:42.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.187+0000 7f1b1ac00640 1 -- 172.21.15.78:0/1071703873 wait complete. 2024-05-21T14:45:42.216 INFO:tasks.ceph:Scrubbing osd.7 2024-05-21T14:45:42.216 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-21T14:45:42.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.359+0000 7fc181a00640 1 Processor -- start 2024-05-21T14:45:42.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.359+0000 7fc181a00640 1 -- start start 2024-05-21T14:45:42.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.359+0000 7fc181a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc17c071190 0x7fc17c158170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.359+0000 7fc181a00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc17c0c3a30 0x7fc17c0c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.359+0000 7fc181a00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc17c0c76a0 con 0x7fc17c152390 2024-05-21T14:45:42.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.359+0000 7fc181a00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fc17c0c64e0 con 0x7fc17c0c3a30 2024-05-21T14:45:42.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.359+0000 7fc181a00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fc17c0c4720 con 0x7fc17c071190 2024-05-21T14:45:42.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.359+0000 7fc181000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc17c0c3a30 0x7fc17c0c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.359+0000 7fc17b400640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc17c152390 0x7fc17c0c6f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53300/0 (socket says 172.21.15.78:53300) 2024-05-21T14:45:42.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.359+0000 7fc17b400640 1 -- 172.21.15.78:0/2016861296 learned_addr learned my addr 172.21.15.78:0/2016861296 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:45:42.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.359+0000 7fc17be00640 1 --2- 172.21.15.78:0/2016861296 >> v2:172.21.15.84:3300/0 conn(0x7fc17c071190 0x7fc17c158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.359+0000 7fc181000640 1 -- 172.21.15.78:0/2016861296 >> v2:172.21.15.84:3300/0 conn(0x7fc17c071190 msgr2=0x7fc17c158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:42.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.359+0000 7fc181000640 1 --2- 172.21.15.78:0/2016861296 >> v2:172.21.15.84:3300/0 conn(0x7fc17c071190 0x7fc17c158170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.359+0000 7fc181000640 1 -- 172.21.15.78:0/2016861296 >> v1:172.21.15.78:6789/0 conn(0x7fc17c152390 legacy=0x7fc17c0c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.359+0000 7fc181000640 1 -- 172.21.15.78:0/2016861296 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c0c55f0 con 0x7fc17c0c3a30 2024-05-21T14:45:42.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.359+0000 7fc17aa00640 1 -- 172.21.15.78:0/2016861296 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2523634527 0 0) 0x7fc17c0c76a0 con 0x7fc17c152390 2024-05-21T14:45:42.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.359+0000 7fc17be00640 1 --2- 172.21.15.78:0/2016861296 >> v2:172.21.15.84:3300/0 conn(0x7fc17c071190 0x7fc17c158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:45:42.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.363+0000 7fc181000640 1 --2- 172.21.15.78:0/2016861296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc17c0c3a30 0x7fc17c0c3e40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc17c06f520 tx=0x7fc17401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f3b776f158b8be server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:42.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.363+0000 7fc17aa00640 1 -- 172.21.15.78:0/2016861296 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1740b2070 con 0x7fc17c0c3a30 2024-05-21T14:45:42.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.363+0000 7fc17aa00640 1 -- 172.21.15.78:0/2016861296 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1740a58e0 con 0x7fc17c0c3a30 2024-05-21T14:45:42.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.363+0000 7fc17aa00640 1 -- 172.21.15.78:0/2016861296 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1740a5cb0 con 0x7fc17c0c3a30 2024-05-21T14:45:42.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.363+0000 7fc181a00640 1 -- 172.21.15.78:0/2016861296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc17c0c3a30 msgr2=0x7fc17c0c3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.363+0000 7fc181a00640 1 --2- 172.21.15.78:0/2016861296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc17c0c3a30 0x7fc17c0c3e40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc17c06f520 tx=0x7fc17401c930 comp rx=0 tx=0).stop 2024-05-21T14:45:42.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.363+0000 7fc181a00640 1 -- 172.21.15.78:0/2016861296 shutdown_connections 2024-05-21T14:45:42.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.363+0000 7fc181a00640 1 --2- 172.21.15.78:0/2016861296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc17c0c3a30 0x7fc17c0c3e40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.363+0000 7fc181a00640 1 --2- 172.21.15.78:0/2016861296 >> v2:172.21.15.84:3300/0 conn(0x7fc17c071190 0x7fc17c158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.363+0000 7fc181a00640 1 -- 172.21.15.78:0/2016861296 >> 172.21.15.78:0/2016861296 conn(0x7fc17c06bc20 msgr2=0x7fc17c06ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:42.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.363+0000 7fc181a00640 1 -- 172.21.15.78:0/2016861296 shutdown_connections 2024-05-21T14:45:42.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.363+0000 7fc181a00640 1 -- 172.21.15.78:0/2016861296 wait complete. 2024-05-21T14:45:42.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc181a00640 1 Processor -- start 2024-05-21T14:45:42.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc181a00640 1 -- start start 2024-05-21T14:45:42.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc181a00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc17c071190 0x7fc17c1f8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc181a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c0c3a30 0x7fc17c1f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc181a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc17c152390 0x7fc17c157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc181a00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c0c6970 con 0x7fc17c152390 2024-05-21T14:45:42.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc181a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c0c6170 con 0x7fc17c0c3a30 2024-05-21T14:45:42.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc181a00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fc17c165310 con 0x7fc17c071190 2024-05-21T14:45:42.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc181000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc17c152390 0x7fc17c157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc181000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc17c152390 0x7fc17c157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50000/0 (socket says 172.21.15.78:50000) 2024-05-21T14:45:42.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc181000640 1 -- 172.21.15.78:0/3931439252 learned_addr learned my addr 172.21.15.78:0/3931439252 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:42.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc17be00640 1 --2- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc17c071190 0x7fc17c1f8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc17b400640 1 --2- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c0c3a30 0x7fc17c1f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc181000640 1 -- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc17c071190 msgr2=0x7fc17c1f8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc181000640 1 --2- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc17c071190 0x7fc17c1f8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc181000640 1 -- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c0c3a30 msgr2=0x7fc17c1f54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc181000640 1 --2- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c0c3a30 0x7fc17c1f54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc181000640 1 -- 172.21.15.78:0/3931439252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c1f8b50 con 0x7fc17c152390 2024-05-21T14:45:42.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc17be00640 1 --2- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc17c071190 0x7fc17c1f8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:45:42.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc17b400640 1 --2- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c0c3a30 0x7fc17c1f54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:45:42.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc181000640 1 --2- 172.21.15.78:0/3931439252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc17c152390 0x7fc17c157750 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc1740b0040 tx=0x7fc1740196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:42.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc173e00640 1 -- 172.21.15.78:0/3931439252 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1740b2050 con 0x7fc17c152390 2024-05-21T14:45:42.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc173e00640 1 -- 172.21.15.78:0/3931439252 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1740b3040 con 0x7fc17c152390 2024-05-21T14:45:42.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.367+0000 7fc173e00640 1 -- 172.21.15.78:0/3931439252 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174003dc0 con 0x7fc17c152390 2024-05-21T14:45:42.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.371+0000 7fc181a00640 1 -- 172.21.15.78:0/3931439252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17c1f59f0 con 0x7fc17c152390 2024-05-21T14:45:42.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.371+0000 7fc181a00640 1 -- 172.21.15.78:0/3931439252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc17c152e70 con 0x7fc17c152390 2024-05-21T14:45:42.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.371+0000 7fc181a00640 1 -- 172.21.15.78:0/3931439252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc17c069f30 con 0x7fc17c152390 2024-05-21T14:45:42.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.371+0000 7fc173e00640 1 -- 172.21.15.78:0/3931439252 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc1740c1060 con 0x7fc17c152390 2024-05-21T14:45:42.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.371+0000 7fc173e00640 1 --2- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fc15c0678c0 0x7fc15c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.371+0000 7fc173e00640 1 -- 172.21.15.78:0/3931439252 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fc174120230 con 0x7fc17c152390 2024-05-21T14:45:42.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.371+0000 7fc173e00640 1 --2- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:6800/2776653794,v1:172.21.15.84:6801/2776653794] conn(0x7fc15c06fb10 0x7fc15c071f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.371+0000 7fc173e00640 1 -- 172.21.15.78:0/3931439252 --> [v2:172.21.15.84:6800/2776653794,v1:172.21.15.84:6801/2776653794] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc15c072650 con 0x7fc15c06fb10 2024-05-21T14:45:42.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.371+0000 7fc173e00640 1 -- 172.21.15.78:0/3931439252 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc174120690 con 0x7fc17c152390 2024-05-21T14:45:42.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.371+0000 7fc17be00640 1 --2- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fc15c0678c0 0x7fc15c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.371+0000 7fc17b400640 1 --2- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:6800/2776653794,v1:172.21.15.84:6801/2776653794] conn(0x7fc15c06fb10 0x7fc15c071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.375+0000 7fc17be00640 1 --2- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fc15c0678c0 0x7fc15c069dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0079d0 tx=0x7fc16c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:42.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.375+0000 7fc17b400640 1 --2- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:6800/2776653794,v1:172.21.15.84:6801/2776653794] conn(0x7fc15c06fb10 0x7fc15c071f80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:42.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.375+0000 7fc173e00640 1 -- 172.21.15.78:0/3931439252 <== osd.7 v2:172.21.15.84:6800/2776653794 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc15c072650 con 0x7fc15c06fb10 2024-05-21T14:45:42.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.387+0000 7fc181a00640 1 -- 172.21.15.78:0/3931439252 --> [v2:172.21.15.84:6800/2776653794,v1:172.21.15.84:6801/2776653794] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc17c155d40 con 0x7fc15c06fb10 2024-05-21T14:45:42.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.387+0000 7fc173e00640 1 -- 172.21.15.78:0/3931439252 <== osd.7 v2:172.21.15.84:6800/2776653794 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc17c155d40 con 0x7fc15c06fb10 2024-05-21T14:45:42.399 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-05-21T14:45:42.399 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T14:45:42.399 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-05-21T14:45:42.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.391+0000 7fc181a00640 1 -- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:6800/2776653794,v1:172.21.15.84:6801/2776653794] conn(0x7fc15c06fb10 msgr2=0x7fc15c071f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.391+0000 7fc181a00640 1 --2- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:6800/2776653794,v1:172.21.15.84:6801/2776653794] conn(0x7fc15c06fb10 0x7fc15c071f80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.391+0000 7fc181a00640 1 -- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fc15c0678c0 msgr2=0x7fc15c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.391+0000 7fc181a00640 1 --2- 172.21.15.78:0/3931439252 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fc15c0678c0 0x7fc15c069dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0079d0 tx=0x7fc16c008040 comp rx=0 tx=0).stop 2024-05-21T14:45:42.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.391+0000 7fc181a00640 1 -- 172.21.15.78:0/3931439252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc17c152390 msgr2=0x7fc17c157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.391+0000 7fc181a00640 1 --2- 172.21.15.78:0/3931439252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc17c152390 0x7fc17c157750 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc1740b0040 tx=0x7fc1740196d0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.391+0000 7fc181000640 1 -- 172.21.15.78:0/3931439252 reap_dead start 2024-05-21T14:45:42.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.391+0000 7fc181a00640 1 -- 172.21.15.78:0/3931439252 shutdown_connections 2024-05-21T14:45:42.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.391+0000 7fc181a00640 1 -- 172.21.15.78:0/3931439252 >> 172.21.15.78:0/3931439252 conn(0x7fc17c06bc20 msgr2=0x7fc17c150a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:42.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.391+0000 7fc181a00640 1 -- 172.21.15.78:0/3931439252 shutdown_connections 2024-05-21T14:45:42.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.391+0000 7fc181a00640 1 -- 172.21.15.78:0/3931439252 wait complete. 2024-05-21T14:45:42.418 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-21T14:45:42.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.555+0000 7f1f3b000640 1 Processor -- start 2024-05-21T14:45:42.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.555+0000 7f1f3b000640 1 -- start start 2024-05-21T14:45:42.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.559+0000 7f1f3b000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1f34072d40 0x7f1f34151e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.559+0000 7f1f3b000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f340713d0 0x7f1f3406b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.559+0000 7f1f3b000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f340717e0 0x7f1f3406bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.559+0000 7f1f3b000640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f1f340c8a60 con 0x7f1f34072d40 2024-05-21T14:45:42.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.559+0000 7f1f3b000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f1f340c8d40 con 0x7f1f340717e0 2024-05-21T14:45:42.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.559+0000 7f1f3b000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1f34157e90 con 0x7f1f340713d0 2024-05-21T14:45:42.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.559+0000 7f1f33e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1f34072d40 0x7f1f34151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.559+0000 7f1f33e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1f34072d40 0x7f1f34151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50014/0 (socket says 172.21.15.78:50014) 2024-05-21T14:45:42.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.559+0000 7f1f33e00640 1 -- 172.21.15.78:0/2447311272 learned_addr learned my addr 172.21.15.78:0/2447311272 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:42.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.559+0000 7f1f2b400640 1 --2- 172.21.15.78:0/2447311272 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f340713d0 0x7f1f3406b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.559+0000 7f1f39000640 1 --2- 172.21.15.78:0/2447311272 >> v2:172.21.15.84:3300/0 conn(0x7f1f340717e0 0x7f1f3406bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.559+0000 7f1f33e00640 1 -- 172.21.15.78:0/2447311272 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f340713d0 msgr2=0x7f1f3406b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:42.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.559+0000 7f1f33e00640 1 --2- 172.21.15.78:0/2447311272 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f340713d0 0x7f1f3406b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.559+0000 7f1f33e00640 1 -- 172.21.15.78:0/2447311272 >> v2:172.21.15.84:3300/0 conn(0x7f1f340717e0 msgr2=0x7f1f3406bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:42.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.559+0000 7f1f33e00640 1 --2- 172.21.15.78:0/2447311272 >> v2:172.21.15.84:3300/0 conn(0x7f1f340717e0 0x7f1f3406bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.559+0000 7f1f33e00640 1 -- 172.21.15.78:0/2447311272 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f34158170 con 0x7f1f34072d40 2024-05-21T14:45:42.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.559+0000 7f1f2b400640 1 --2- 172.21.15.78:0/2447311272 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f340713d0 0x7f1f3406b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:45:42.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.563+0000 7f1f33e00640 1 --2- 172.21.15.78:0/2447311272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f34072d40 0x7f1f34151e00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1f34071360 tx=0x7f1f2401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b4aeda5bb7d6c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:42.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.563+0000 7f1f33400640 1 -- 172.21.15.78:0/2447311272 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f240a55f0 con 0x7f1f34072d40 2024-05-21T14:45:42.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.563+0000 7f1f33400640 1 -- 172.21.15.78:0/2447311272 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f240a5790 con 0x7f1f34072d40 2024-05-21T14:45:42.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.563+0000 7f1f33400640 1 -- 172.21.15.78:0/2447311272 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f240a5b60 con 0x7f1f34072d40 2024-05-21T14:45:42.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.563+0000 7f1f3b000640 1 -- 172.21.15.78:0/2447311272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f34072d40 msgr2=0x7f1f34151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.563+0000 7f1f3b000640 1 --2- 172.21.15.78:0/2447311272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f34072d40 0x7f1f34151e00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1f34071360 tx=0x7f1f2401c9f0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.563+0000 7f1f3b000640 1 -- 172.21.15.78:0/2447311272 shutdown_connections 2024-05-21T14:45:42.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.563+0000 7f1f3b000640 1 --2- 172.21.15.78:0/2447311272 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f340713d0 0x7f1f3406b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.563+0000 7f1f3b000640 1 --2- 172.21.15.78:0/2447311272 >> v2:172.21.15.84:3300/0 conn(0x7f1f340717e0 0x7f1f3406bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.563+0000 7f1f3b000640 1 --2- 172.21.15.78:0/2447311272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f34072d40 0x7f1f34151e00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.563+0000 7f1f3b000640 1 -- 172.21.15.78:0/2447311272 >> 172.21.15.78:0/2447311272 conn(0x7f1f340cd1e0 msgr2=0x7f1f340c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:42.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.563+0000 7f1f3b000640 1 -- 172.21.15.78:0/2447311272 shutdown_connections 2024-05-21T14:45:42.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.563+0000 7f1f3b000640 1 -- 172.21.15.78:0/2447311272 wait complete. 2024-05-21T14:45:42.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f3b000640 1 Processor -- start 2024-05-21T14:45:42.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f3b000640 1 -- start start 2024-05-21T14:45:42.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f3b000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f340713d0 0x7f1f341434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f3b000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f340717e0 0x7f1f341457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f3b000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f34072d40 0x7f1f34145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f3b000640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1f340c8810 con 0x7f1f340717e0 2024-05-21T14:45:42.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f3b000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f340c8690 con 0x7f1f340713d0 2024-05-21T14:45:42.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f3b000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1f340c3660 con 0x7f1f34072d40 2024-05-21T14:45:42.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f2b400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f340717e0 0x7f1f341457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f2b400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f340717e0 0x7f1f341457e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50020/0 (socket says 172.21.15.78:50020) 2024-05-21T14:45:42.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f2b400640 1 -- 172.21.15.78:0/1936728196 learned_addr learned my addr 172.21.15.78:0/1936728196 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:42.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f33e00640 1 --2- 172.21.15.78:0/1936728196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f340713d0 0x7f1f341434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f39000640 1 --2- 172.21.15.78:0/1936728196 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f34072d40 0x7f1f34145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f2b400640 1 -- 172.21.15.78:0/1936728196 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f34072d40 msgr2=0x7f1f34145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f2b400640 1 --2- 172.21.15.78:0/1936728196 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f34072d40 0x7f1f34145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f2b400640 1 -- 172.21.15.78:0/1936728196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f340713d0 msgr2=0x7f1f341434e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f2b400640 1 --2- 172.21.15.78:0/1936728196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f340713d0 0x7f1f341434e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f2b400640 1 -- 172.21.15.78:0/1936728196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f34147df0 con 0x7f1f340717e0 2024-05-21T14:45:42.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f2b400640 1 --2- 172.21.15.78:0/1936728196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f340717e0 0x7f1f341457e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00d830 tx=0x7f1f1c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:42.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f30c00640 1 -- 172.21.15.78:0/1936728196 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c018070 con 0x7f1f340717e0 2024-05-21T14:45:42.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f30c00640 1 -- 172.21.15.78:0/1936728196 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f1c00be10 con 0x7f1f340717e0 2024-05-21T14:45:42.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f30c00640 1 -- 172.21.15.78:0/1936728196 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c004250 con 0x7f1f340717e0 2024-05-21T14:45:42.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f3b000640 1 -- 172.21.15.78:0/1936728196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f34147030 con 0x7f1f340717e0 2024-05-21T14:45:42.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f3b000640 1 -- 172.21.15.78:0/1936728196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f341475f0 con 0x7f1f340717e0 2024-05-21T14:45:42.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.567+0000 7f1f3b000640 1 -- 172.21.15.78:0/1936728196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f3404f730 con 0x7f1f340717e0 2024-05-21T14:45:42.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.571+0000 7f1f30c00640 1 -- 172.21.15.78:0/1936728196 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f1c0098b0 con 0x7f1f340717e0 2024-05-21T14:45:42.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.571+0000 7f1f30c00640 1 --2- 172.21.15.78:0/1936728196 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1f100678f0 0x7f1f10069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.571+0000 7f1f30c00640 1 -- 172.21.15.78:0/1936728196 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f1f1c085fb0 con 0x7f1f340717e0 2024-05-21T14:45:42.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.571+0000 7f1f33e00640 1 --2- 172.21.15.78:0/1936728196 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1f100678f0 0x7f1f10069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.571+0000 7f1f33e00640 1 --2- 172.21.15.78:0/1936728196 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1f100678f0 0x7f1f10069e00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1f240ae000 tx=0x7f1f240a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:42.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.575+0000 7f1f30c00640 1 -- 172.21.15.78:0/1936728196 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1f1c056a30 con 0x7f1f340717e0 2024-05-21T14:45:42.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.739+0000 7f1f3b000640 1 -- 172.21.15.78:0/1936728196 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f1f34155cb0 con 0x7f1f100678f0 2024-05-21T14:45:42.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.739+0000 7f1f30c00640 1 -- 172.21.15.78:0/1936728196 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1f34155cb0 con 0x7f1f100678f0 2024-05-21T14:45:42.750 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 7 to deep-scrub 2024-05-21T14:45:42.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.743+0000 7f1f3b000640 1 -- 172.21.15.78:0/1936728196 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1f100678f0 msgr2=0x7f1f10069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.743+0000 7f1f3b000640 1 --2- 172.21.15.78:0/1936728196 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1f100678f0 0x7f1f10069e00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1f240ae000 tx=0x7f1f240a7070 comp rx=0 tx=0).stop 2024-05-21T14:45:42.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.743+0000 7f1f3b000640 1 -- 172.21.15.78:0/1936728196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f340717e0 msgr2=0x7f1f341457e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.743+0000 7f1f3b000640 1 --2- 172.21.15.78:0/1936728196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f340717e0 0x7f1f341457e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00d830 tx=0x7f1f1c00dcf0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.743+0000 7f1f3b000640 1 -- 172.21.15.78:0/1936728196 shutdown_connections 2024-05-21T14:45:42.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.743+0000 7f1f3b000640 1 --2- 172.21.15.78:0/1936728196 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1f100678f0 0x7f1f10069e00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.743+0000 7f1f3b000640 1 --2- 172.21.15.78:0/1936728196 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f34072d40 0x7f1f34145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.743+0000 7f1f3b000640 1 --2- 172.21.15.78:0/1936728196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f340717e0 0x7f1f341457e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.743+0000 7f1f3b000640 1 --2- 172.21.15.78:0/1936728196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f340713d0 0x7f1f341434e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.743+0000 7f1f3b000640 1 -- 172.21.15.78:0/1936728196 >> 172.21.15.78:0/1936728196 conn(0x7f1f340cd1e0 msgr2=0x7f1f341573b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:42.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.743+0000 7f1f3b000640 1 -- 172.21.15.78:0/1936728196 shutdown_connections 2024-05-21T14:45:42.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.743+0000 7f1f3b000640 1 -- 172.21.15.78:0/1936728196 wait complete. 2024-05-21T14:45:42.773 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T14:45:42.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.907+0000 7f887fa00640 1 Processor -- start 2024-05-21T14:45:42.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.911+0000 7f887fa00640 1 -- start start 2024-05-21T14:45:42.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.911+0000 7f887fa00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8878071fe0 0x7f88780723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.911+0000 7f887fa00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f88780c5640 0x7f88780c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.911+0000 7f887fa00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88780715f0 con 0x7f88781529d0 2024-05-21T14:45:42.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.911+0000 7f887fa00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f8878072b80 con 0x7f88780c5640 2024-05-21T14:45:42.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.911+0000 7f887fa00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f88780c8530 con 0x7f8878071fe0 2024-05-21T14:45:42.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.911+0000 7f887da00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f88780c5640 0x7f88780c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.911+0000 7f887d000640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f88781529d0 0x7f8878072e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53316/0 (socket says 172.21.15.78:53316) 2024-05-21T14:45:42.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.911+0000 7f887d000640 1 -- 172.21.15.78:0/188550611 learned_addr learned my addr 172.21.15.78:0/188550611 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:45:42.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.911+0000 7f8877e00640 1 --2- 172.21.15.78:0/188550611 >> v2:172.21.15.84:3300/0 conn(0x7f8878071fe0 0x7f88780723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.911+0000 7f887da00640 1 -- 172.21.15.78:0/188550611 >> v2:172.21.15.84:3300/0 conn(0x7f8878071fe0 msgr2=0x7f88780723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:45:42.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.911+0000 7f887da00640 1 --2- 172.21.15.78:0/188550611 >> v2:172.21.15.84:3300/0 conn(0x7f8878071fe0 0x7f88780723f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.911+0000 7f887da00640 1 -- 172.21.15.78:0/188550611 >> v1:172.21.15.78:6789/0 conn(0x7f88781529d0 legacy=0x7f8878072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.911+0000 7f887da00640 1 -- 172.21.15.78:0/188550611 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88780c8810 con 0x7f88780c5640 2024-05-21T14:45:42.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.911+0000 7f8877400640 1 -- 172.21.15.78:0/188550611 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2972942224 0 0) 0x7f88780715f0 con 0x7f88781529d0 2024-05-21T14:45:42.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.915+0000 7f887da00640 1 --2- 172.21.15.78:0/188550611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88780c5640 0x7f88780c5a50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f88780744f0 tx=0x7f887001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dae02663f8795a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:42.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.915+0000 7f8877400640 1 -- 172.21.15.78:0/188550611 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88700b2070 con 0x7f88780c5640 2024-05-21T14:45:42.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.915+0000 7f8877400640 1 -- 172.21.15.78:0/188550611 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88700a57f0 con 0x7f88780c5640 2024-05-21T14:45:42.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.915+0000 7f8877400640 1 -- 172.21.15.78:0/188550611 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88700a5bc0 con 0x7f88780c5640 2024-05-21T14:45:42.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.915+0000 7f887fa00640 1 -- 172.21.15.78:0/188550611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88780c5640 msgr2=0x7f88780c5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.915+0000 7f887fa00640 1 --2- 172.21.15.78:0/188550611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88780c5640 0x7f88780c5a50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f88780744f0 tx=0x7f887001c930 comp rx=0 tx=0).stop 2024-05-21T14:45:42.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.915+0000 7f887fa00640 1 -- 172.21.15.78:0/188550611 shutdown_connections 2024-05-21T14:45:42.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.915+0000 7f887fa00640 1 --2- 172.21.15.78:0/188550611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88780c5640 0x7f88780c5a50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.915+0000 7f887fa00640 1 --2- 172.21.15.78:0/188550611 >> v2:172.21.15.84:3300/0 conn(0x7f8878071fe0 0x7f88780723f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.915+0000 7f887fa00640 1 -- 172.21.15.78:0/188550611 >> 172.21.15.78:0/188550611 conn(0x7f88780c9380 msgr2=0x7f88780c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:42.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.915+0000 7f887fa00640 1 -- 172.21.15.78:0/188550611 shutdown_connections 2024-05-21T14:45:42.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.915+0000 7f887fa00640 1 -- 172.21.15.78:0/188550611 wait complete. 2024-05-21T14:45:42.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887fa00640 1 Processor -- start 2024-05-21T14:45:42.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887fa00640 1 -- start start 2024-05-21T14:45:42.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887fa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8878071fe0 0x7f887815af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887fa00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f88780c5640 0x7f88781f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887fa00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88781529d0 0x7f88781514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887fa00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f88780c7610 con 0x7f88781529d0 2024-05-21T14:45:42.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887fa00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f88780c7490 con 0x7f8878071fe0 2024-05-21T14:45:42.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887fa00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f88780c7790 con 0x7f88780c5640 2024-05-21T14:45:42.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887da00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88781529d0 0x7f88781514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887da00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88781529d0 0x7f88781514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50046/0 (socket says 172.21.15.78:50046) 2024-05-21T14:45:42.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887da00640 1 -- 172.21.15.78:0/3427922636 learned_addr learned my addr 172.21.15.78:0/3427922636 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:45:42.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f8877e00640 1 --2- 172.21.15.78:0/3427922636 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f88780c5640 0x7f88781f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887d000640 1 --2- 172.21.15.78:0/3427922636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8878071fe0 0x7f887815af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887da00640 1 -- 172.21.15.78:0/3427922636 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f88780c5640 msgr2=0x7f88781f1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887da00640 1 --2- 172.21.15.78:0/3427922636 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f88780c5640 0x7f88781f1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887da00640 1 -- 172.21.15.78:0/3427922636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8878071fe0 msgr2=0x7f887815af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:42.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887da00640 1 --2- 172.21.15.78:0/3427922636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8878071fe0 0x7f887815af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:42.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887da00640 1 -- 172.21.15.78:0/3427922636 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887815b4a0 con 0x7f88781529d0 2024-05-21T14:45:42.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887da00640 1 --2- 172.21.15.78:0/3427922636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88781529d0 0x7f88781514a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f88700b0040 tx=0x7f88700196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:42.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f8874c00640 1 -- 172.21.15.78:0/3427922636 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88700b2040 con 0x7f88781529d0 2024-05-21T14:45:42.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f8874c00640 1 -- 172.21.15.78:0/3427922636 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88700b8470 con 0x7f88781529d0 2024-05-21T14:45:42.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887fa00640 1 -- 172.21.15.78:0/3427922636 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88781f34e0 con 0x7f88781529d0 2024-05-21T14:45:42.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f8874c00640 1 -- 172.21.15.78:0/3427922636 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88700b8820 con 0x7f88781529d0 2024-05-21T14:45:42.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.919+0000 7f887fa00640 1 -- 172.21.15.78:0/3427922636 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88780cc530 con 0x7f88781529d0 2024-05-21T14:45:42.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.923+0000 7f887fa00640 1 -- 172.21.15.78:0/3427922636 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88781f3240 con 0x7f88781529d0 2024-05-21T14:45:42.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.923+0000 7f8874c00640 1 -- 172.21.15.78:0/3427922636 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88700c1020 con 0x7f88781529d0 2024-05-21T14:45:42.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.923+0000 7f8874c00640 1 --2- 172.21.15.78:0/3427922636 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f88580678c0 0x7f8858069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:45:42.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.923+0000 7f8874c00640 1 -- 172.21.15.78:0/3427922636 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f8870120740 con 0x7f88781529d0 2024-05-21T14:45:42.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.923+0000 7f887d000640 1 --2- 172.21.15.78:0/3427922636 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f88580678c0 0x7f8858069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:45:42.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.923+0000 7f887d000640 1 --2- 172.21.15.78:0/3427922636 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f88580678c0 0x7f8858069dd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f886c000f70 tx=0x7f886c007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:45:42.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:42.927+0000 7f8874c00640 1 -- 172.21.15.78:0/3427922636 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f88781f3240 con 0x7f88781529d0 2024-05-21T14:45:43.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:43.083+0000 7f887fa00640 1 -- 172.21.15.78:0/3427922636 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f887804f730 con 0x7f88580678c0 2024-05-21T14:45:43.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:43.103+0000 7f8874c00640 1 -- 172.21.15.78:0/3427922636 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250498 (secure 0 0 0) 0x7f887804f730 con 0x7f88580678c0 2024-05-21T14:45:43.113 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:45:43.114 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-05-21T14:45:43.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:43.103+0000 7f887fa00640 1 -- 172.21.15.78:0/3427922636 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f88580678c0 msgr2=0x7f8858069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:43.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:43.103+0000 7f887fa00640 1 --2- 172.21.15.78:0/3427922636 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f88580678c0 0x7f8858069dd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f886c000f70 tx=0x7f886c007c10 comp rx=0 tx=0).stop 2024-05-21T14:45:43.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:43.103+0000 7f887fa00640 1 -- 172.21.15.78:0/3427922636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88781529d0 msgr2=0x7f88781514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:45:43.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:43.103+0000 7f887fa00640 1 --2- 172.21.15.78:0/3427922636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88781529d0 0x7f88781514a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f88700b0040 tx=0x7f88700196d0 comp rx=0 tx=0).stop 2024-05-21T14:45:43.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:43.103+0000 7f887fa00640 1 -- 172.21.15.78:0/3427922636 shutdown_connections 2024-05-21T14:45:43.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:43.103+0000 7f887fa00640 1 --2- 172.21.15.78:0/3427922636 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f88580678c0 0x7f8858069dd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:43.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:43.103+0000 7f887fa00640 1 --2- 172.21.15.78:0/3427922636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88781529d0 0x7f88781514a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:43.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:43.103+0000 7f887fa00640 1 --2- 172.21.15.78:0/3427922636 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f88780c5640 0x7f88781f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:43.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:43.103+0000 7f887fa00640 1 --2- 172.21.15.78:0/3427922636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8878071fe0 0x7f887815af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:45:43.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:43.103+0000 7f887fa00640 1 -- 172.21.15.78:0/3427922636 >> 172.21.15.78:0/3427922636 conn(0x7f88780c9380 msgr2=0x7f88780c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:45:43.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:43.103+0000 7f887fa00640 1 -- 172.21.15.78:0/3427922636 shutdown_connections 2024-05-21T14:45:43.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:45:43.103+0000 7f887fa00640 1 -- 172.21.15.78:0/3427922636 wait complete. 2024-05-21T14:45:43.134 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-05-21T14:45:42.554348+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":632108,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":405,"num_write_kb":2532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":848,"ondisk_log_size":848,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218600,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756120,"statfs":{"total":773094113280,"available":772870266880,"internally_reserved":0,"allocated":2531328,"data_stored":2009400,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28776,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":28,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.014739"},"pg_stats":[{"pgid":"3.3f","version":"25'8","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.491048+0000","last_change":"2024-05-21T14:43:19.606707+0000","last_active":"2024-05-21T14:45:35.491048+0000","last_peered":"2024-05-21T14:45:35.491048+0000","last_clean":"2024-05-21T14:45:35.491048+0000","last_became_active":"2024-05-21T14:43:19.606365+0000","last_became_peered":"2024-05-21T14:43:19.606365+0000","last_unstale":"2024-05-21T14:45:35.491048+0000","last_undegraded":"2024-05-21T14:45:35.491048+0000","last_fullsized":"2024-05-21T14:45:35.491048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.509442+0000","last_change":"2024-05-21T14:43:19.632879+0000","last_active":"2024-05-21T14:45:35.509442+0000","last_peered":"2024-05-21T14:45:35.509442+0000","last_clean":"2024-05-21T14:45:35.509442+0000","last_became_active":"2024-05-21T14:43:19.632218+0000","last_became_peered":"2024-05-21T14:43:19.632218+0000","last_unstale":"2024-05-21T14:45:35.509442+0000","last_undegraded":"2024-05-21T14:45:35.509442+0000","last_fullsized":"2024-05-21T14:45:35.509442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:35:49.461861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'7","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.507761+0000","last_change":"2024-05-21T14:43:19.620214+0000","last_active":"2024-05-21T14:45:35.507761+0000","last_peered":"2024-05-21T14:45:35.507761+0000","last_clean":"2024-05-21T14:45:35.507761+0000","last_became_active":"2024-05-21T14:43:19.619012+0000","last_became_peered":"2024-05-21T14:43:19.619012+0000","last_unstale":"2024-05-21T14:45:35.507761+0000","last_undegraded":"2024-05-21T14:45:35.507761+0000","last_fullsized":"2024-05-21T14:45:35.507761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:40:22.415178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'8","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.490696+0000","last_change":"2024-05-21T14:43:19.602199+0000","last_active":"2024-05-21T14:45:35.490696+0000","last_peered":"2024-05-21T14:45:35.490696+0000","last_clean":"2024-05-21T14:45:35.490696+0000","last_became_active":"2024-05-21T14:43:19.601797+0000","last_became_peered":"2024-05-21T14:43:19.601797+0000","last_unstale":"2024-05-21T14:45:35.490696+0000","last_undegraded":"2024-05-21T14:45:35.490696+0000","last_fullsized":"2024-05-21T14:45:35.490696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.494960+0000","last_change":"2024-05-21T14:43:19.623449+0000","last_active":"2024-05-21T14:45:35.494960+0000","last_peered":"2024-05-21T14:45:35.494960+0000","last_clean":"2024-05-21T14:45:35.494960+0000","last_became_active":"2024-05-21T14:43:19.623125+0000","last_became_peered":"2024-05-21T14:43:19.623125+0000","last_unstale":"2024-05-21T14:45:35.494960+0000","last_undegraded":"2024-05-21T14:45:35.494960+0000","last_fullsized":"2024-05-21T14:45:35.494960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'6","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.511110+0000","last_change":"2024-05-21T14:43:19.591222+0000","last_active":"2024-05-21T14:45:35.511110+0000","last_peered":"2024-05-21T14:45:35.511110+0000","last_clean":"2024-05-21T14:45:35.511110+0000","last_became_active":"2024-05-21T14:43:19.590858+0000","last_became_peered":"2024-05-21T14:43:19.590858+0000","last_unstale":"2024-05-21T14:45:35.511110+0000","last_undegraded":"2024-05-21T14:45:35.511110+0000","last_fullsized":"2024-05-21T14:45:35.511110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'5","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.503006+0000","last_change":"2024-05-21T14:43:19.614716+0000","last_active":"2024-05-21T14:45:35.503006+0000","last_peered":"2024-05-21T14:45:35.503006+0000","last_clean":"2024-05-21T14:45:35.503006+0000","last_became_active":"2024-05-21T14:43:19.614451+0000","last_became_peered":"2024-05-21T14:43:19.614451+0000","last_unstale":"2024-05-21T14:45:35.503006+0000","last_undegraded":"2024-05-21T14:45:35.503006+0000","last_fullsized":"2024-05-21T14:45:35.503006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'9","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.510886+0000","last_change":"2024-05-21T14:43:19.604029+0000","last_active":"2024-05-21T14:45:35.510886+0000","last_peered":"2024-05-21T14:45:35.510886+0000","last_clean":"2024-05-21T14:45:35.510886+0000","last_became_active":"2024-05-21T14:43:19.603164+0000","last_became_peered":"2024-05-21T14:43:19.603164+0000","last_unstale":"2024-05-21T14:45:35.510886+0000","last_undegraded":"2024-05-21T14:45:35.510886+0000","last_fullsized":"2024-05-21T14:45:35.510886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:14:27.286952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'11","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.488327+0000","last_change":"2024-05-21T14:43:19.613765+0000","last_active":"2024-05-21T14:45:35.488327+0000","last_peered":"2024-05-21T14:45:35.488327+0000","last_clean":"2024-05-21T14:45:35.488327+0000","last_became_active":"2024-05-21T14:43:19.613429+0000","last_became_peered":"2024-05-21T14:43:19.613429+0000","last_unstale":"2024-05-21T14:45:35.488327+0000","last_undegraded":"2024-05-21T14:45:35.488327+0000","last_fullsized":"2024-05-21T14:45:35.488327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'16","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.479901+0000","last_change":"2024-05-21T14:43:19.607400+0000","last_active":"2024-05-21T14:45:35.479901+0000","last_peered":"2024-05-21T14:45:35.479901+0000","last_clean":"2024-05-21T14:45:35.479901+0000","last_became_active":"2024-05-21T14:43:19.607105+0000","last_became_peered":"2024-05-21T14:43:19.607105+0000","last_unstale":"2024-05-21T14:45:35.479901+0000","last_undegraded":"2024-05-21T14:45:35.479901+0000","last_fullsized":"2024-05-21T14:45:35.479901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'6","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.491036+0000","last_change":"2024-05-21T14:43:19.606534+0000","last_active":"2024-05-21T14:45:35.491036+0000","last_peered":"2024-05-21T14:45:35.491036+0000","last_clean":"2024-05-21T14:45:35.491036+0000","last_became_active":"2024-05-21T14:43:19.606029+0000","last_became_peered":"2024-05-21T14:43:19.606029+0000","last_unstale":"2024-05-21T14:45:35.491036+0000","last_undegraded":"2024-05-21T14:45:35.491036+0000","last_fullsized":"2024-05-21T14:45:35.491036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'7","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.476205+0000","last_change":"2024-05-21T14:43:19.609910+0000","last_active":"2024-05-21T14:45:35.476205+0000","last_peered":"2024-05-21T14:45:35.476205+0000","last_clean":"2024-05-21T14:45:35.476205+0000","last_became_active":"2024-05-21T14:43:19.609616+0000","last_became_peered":"2024-05-21T14:43:19.609616+0000","last_unstale":"2024-05-21T14:45:35.476205+0000","last_undegraded":"2024-05-21T14:45:35.476205+0000","last_fullsized":"2024-05-21T14:45:35.476205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.478747+0000","last_change":"2024-05-21T14:43:19.604001+0000","last_active":"2024-05-21T14:45:35.478747+0000","last_peered":"2024-05-21T14:45:35.478747+0000","last_clean":"2024-05-21T14:45:35.478747+0000","last_became_active":"2024-05-21T14:43:19.596859+0000","last_became_peered":"2024-05-21T14:43:19.596859+0000","last_unstale":"2024-05-21T14:45:35.478747+0000","last_undegraded":"2024-05-21T14:45:35.478747+0000","last_fullsized":"2024-05-21T14:45:35.478747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:45:43.431420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'10","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.510026+0000","last_change":"2024-05-21T14:43:19.626837+0000","last_active":"2024-05-21T14:45:35.510026+0000","last_peered":"2024-05-21T14:45:35.510026+0000","last_clean":"2024-05-21T14:45:35.510026+0000","last_became_active":"2024-05-21T14:43:19.626213+0000","last_became_peered":"2024-05-21T14:43:19.626213+0000","last_unstale":"2024-05-21T14:45:35.510026+0000","last_undegraded":"2024-05-21T14:45:35.510026+0000","last_fullsized":"2024-05-21T14:45:35.510026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:51.705474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'7","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.506618+0000","last_change":"2024-05-21T14:43:19.613483+0000","last_active":"2024-05-21T14:45:35.506618+0000","last_peered":"2024-05-21T14:45:35.506618+0000","last_clean":"2024-05-21T14:45:35.506618+0000","last_became_active":"2024-05-21T14:43:19.612581+0000","last_became_peered":"2024-05-21T14:43:19.612581+0000","last_unstale":"2024-05-21T14:45:35.506618+0000","last_undegraded":"2024-05-21T14:45:35.506618+0000","last_fullsized":"2024-05-21T14:45:35.506618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:41:15.797196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'9","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:40.535119+0000","last_change":"2024-05-21T14:43:19.609126+0000","last_active":"2024-05-21T14:45:40.535119+0000","last_peered":"2024-05-21T14:45:40.535119+0000","last_clean":"2024-05-21T14:45:40.535119+0000","last_became_active":"2024-05-21T14:43:19.607967+0000","last_became_peered":"2024-05-21T14:43:19.607967+0000","last_unstale":"2024-05-21T14:45:40.535119+0000","last_undegraded":"2024-05-21T14:45:40.535119+0000","last_fullsized":"2024-05-21T14:45:40.535119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'8","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:40.535121+0000","last_change":"2024-05-21T14:43:19.613487+0000","last_active":"2024-05-21T14:45:40.535121+0000","last_peered":"2024-05-21T14:45:40.535121+0000","last_clean":"2024-05-21T14:45:40.535121+0000","last_became_active":"2024-05-21T14:43:19.611280+0000","last_became_peered":"2024-05-21T14:43:19.611280+0000","last_unstale":"2024-05-21T14:45:40.535121+0000","last_undegraded":"2024-05-21T14:45:40.535121+0000","last_fullsized":"2024-05-21T14:45:40.535121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'10","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.490288+0000","last_change":"2024-05-21T14:43:19.607601+0000","last_active":"2024-05-21T14:45:35.490288+0000","last_peered":"2024-05-21T14:45:35.490288+0000","last_clean":"2024-05-21T14:45:35.490288+0000","last_became_active":"2024-05-21T14:43:19.606719+0000","last_became_peered":"2024-05-21T14:43:19.606719+0000","last_unstale":"2024-05-21T14:45:35.490288+0000","last_undegraded":"2024-05-21T14:45:35.490288+0000","last_fullsized":"2024-05-21T14:45:35.490288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:04:32.310805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'7","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.972636+0000","last_change":"2024-05-21T14:43:19.618470+0000","last_active":"2024-05-21T14:45:35.972636+0000","last_peered":"2024-05-21T14:45:35.972636+0000","last_clean":"2024-05-21T14:45:35.972636+0000","last_became_active":"2024-05-21T14:43:19.617408+0000","last_became_peered":"2024-05-21T14:43:19.617408+0000","last_unstale":"2024-05-21T14:45:35.972636+0000","last_undegraded":"2024-05-21T14:45:35.972636+0000","last_fullsized":"2024-05-21T14:45:35.972636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'8","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.975029+0000","last_change":"2024-05-21T14:43:19.609835+0000","last_active":"2024-05-21T14:45:35.975029+0000","last_peered":"2024-05-21T14:45:35.975029+0000","last_clean":"2024-05-21T14:45:35.975029+0000","last_became_active":"2024-05-21T14:43:19.609525+0000","last_became_peered":"2024-05-21T14:43:19.609525+0000","last_unstale":"2024-05-21T14:45:35.975029+0000","last_undegraded":"2024-05-21T14:45:35.975029+0000","last_fullsized":"2024-05-21T14:45:35.975029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'11","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.513530+0000","last_change":"2024-05-21T14:43:19.607732+0000","last_active":"2024-05-21T14:45:35.513530+0000","last_peered":"2024-05-21T14:45:35.513530+0000","last_clean":"2024-05-21T14:45:35.513530+0000","last_became_active":"2024-05-21T14:43:19.606839+0000","last_became_peered":"2024-05-21T14:43:19.606839+0000","last_unstale":"2024-05-21T14:45:35.513530+0000","last_undegraded":"2024-05-21T14:45:35.513530+0000","last_fullsized":"2024-05-21T14:45:35.513530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:43:15.675663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'10","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.973287+0000","last_change":"2024-05-21T14:43:19.601108+0000","last_active":"2024-05-21T14:45:35.973287+0000","last_peered":"2024-05-21T14:45:35.973287+0000","last_clean":"2024-05-21T14:45:35.973287+0000","last_became_active":"2024-05-21T14:43:19.600780+0000","last_became_peered":"2024-05-21T14:43:19.600780+0000","last_unstale":"2024-05-21T14:45:35.973287+0000","last_undegraded":"2024-05-21T14:45:35.973287+0000","last_fullsized":"2024-05-21T14:45:35.973287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.507394+0000","last_change":"2024-05-21T14:43:19.620463+0000","last_active":"2024-05-21T14:45:35.507394+0000","last_peered":"2024-05-21T14:45:35.507394+0000","last_clean":"2024-05-21T14:45:35.507394+0000","last_became_active":"2024-05-21T14:43:19.614489+0000","last_became_peered":"2024-05-21T14:43:19.614489+0000","last_unstale":"2024-05-21T14:45:35.507394+0000","last_undegraded":"2024-05-21T14:45:35.507394+0000","last_fullsized":"2024-05-21T14:45:35.507394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:51:07.953352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'6","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.511630+0000","last_change":"2024-05-21T14:43:19.624683+0000","last_active":"2024-05-21T14:45:35.511630+0000","last_peered":"2024-05-21T14:45:35.511630+0000","last_clean":"2024-05-21T14:45:35.511630+0000","last_became_active":"2024-05-21T14:43:19.624304+0000","last_became_peered":"2024-05-21T14:43:19.624304+0000","last_unstale":"2024-05-21T14:45:35.511630+0000","last_undegraded":"2024-05-21T14:45:35.511630+0000","last_fullsized":"2024-05-21T14:45:35.511630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.509078+0000","last_change":"2024-05-21T14:43:19.621030+0000","last_active":"2024-05-21T14:45:35.509078+0000","last_peered":"2024-05-21T14:45:35.509078+0000","last_clean":"2024-05-21T14:45:35.509078+0000","last_became_active":"2024-05-21T14:43:19.619072+0000","last_became_peered":"2024-05-21T14:43:19.619072+0000","last_unstale":"2024-05-21T14:45:35.509078+0000","last_undegraded":"2024-05-21T14:45:35.509078+0000","last_fullsized":"2024-05-21T14:45:35.509078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:22:09.423661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'15","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.486850+0000","last_change":"2024-05-21T14:43:19.602880+0000","last_active":"2024-05-21T14:45:35.486850+0000","last_peered":"2024-05-21T14:45:35.486850+0000","last_clean":"2024-05-21T14:45:35.486850+0000","last_became_active":"2024-05-21T14:43:19.602577+0000","last_became_peered":"2024-05-21T14:43:19.602577+0000","last_unstale":"2024-05-21T14:45:35.486850+0000","last_undegraded":"2024-05-21T14:45:35.486850+0000","last_fullsized":"2024-05-21T14:45:35.486850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'6","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.507849+0000","last_change":"2024-05-21T14:43:19.632328+0000","last_active":"2024-05-21T14:45:35.507849+0000","last_peered":"2024-05-21T14:45:35.507849+0000","last_clean":"2024-05-21T14:45:35.507849+0000","last_became_active":"2024-05-21T14:43:19.631351+0000","last_became_peered":"2024-05-21T14:43:19.631351+0000","last_unstale":"2024-05-21T14:45:35.507849+0000","last_undegraded":"2024-05-21T14:45:35.507849+0000","last_fullsized":"2024-05-21T14:45:35.507849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:36:18.467070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.479802+0000","last_change":"2024-05-21T14:43:19.632282+0000","last_active":"2024-05-21T14:45:35.479802+0000","last_peered":"2024-05-21T14:45:35.479802+0000","last_clean":"2024-05-21T14:45:35.479802+0000","last_became_active":"2024-05-21T14:43:19.631522+0000","last_became_peered":"2024-05-21T14:43:19.631522+0000","last_unstale":"2024-05-21T14:45:35.479802+0000","last_undegraded":"2024-05-21T14:45:35.479802+0000","last_fullsized":"2024-05-21T14:45:35.479802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:23:32.646087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'7","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.502853+0000","last_change":"2024-05-21T14:43:19.620046+0000","last_active":"2024-05-21T14:45:35.502853+0000","last_peered":"2024-05-21T14:45:35.502853+0000","last_clean":"2024-05-21T14:45:35.502853+0000","last_became_active":"2024-05-21T14:43:19.612428+0000","last_became_peered":"2024-05-21T14:43:19.612428+0000","last_unstale":"2024-05-21T14:45:35.502853+0000","last_undegraded":"2024-05-21T14:45:35.502853+0000","last_fullsized":"2024-05-21T14:45:35.502853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:08:33.785399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'8","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.507446+0000","last_change":"2024-05-21T14:43:19.618198+0000","last_active":"2024-05-21T14:45:35.507446+0000","last_peered":"2024-05-21T14:45:35.507446+0000","last_clean":"2024-05-21T14:45:35.507446+0000","last_became_active":"2024-05-21T14:43:19.617903+0000","last_became_peered":"2024-05-21T14:43:19.617903+0000","last_unstale":"2024-05-21T14:45:35.507446+0000","last_undegraded":"2024-05-21T14:45:35.507446+0000","last_fullsized":"2024-05-21T14:45:35.507446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'12","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.495332+0000","last_change":"2024-05-21T14:43:19.613942+0000","last_active":"2024-05-21T14:45:35.495332+0000","last_peered":"2024-05-21T14:45:35.495332+0000","last_clean":"2024-05-21T14:45:35.495332+0000","last_became_active":"2024-05-21T14:43:19.613035+0000","last_became_peered":"2024-05-21T14:43:19.613035+0000","last_unstale":"2024-05-21T14:45:35.495332+0000","last_undegraded":"2024-05-21T14:45:35.495332+0000","last_fullsized":"2024-05-21T14:45:35.495332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:47:46.462547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'9","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.472849+0000","last_change":"2024-05-21T14:43:19.626414+0000","last_active":"2024-05-21T14:45:35.472849+0000","last_peered":"2024-05-21T14:45:35.472849+0000","last_clean":"2024-05-21T14:45:35.472849+0000","last_became_active":"2024-05-21T14:43:19.626080+0000","last_became_peered":"2024-05-21T14:43:19.626080+0000","last_unstale":"2024-05-21T14:45:35.472849+0000","last_undegraded":"2024-05-21T14:45:35.472849+0000","last_fullsized":"2024-05-21T14:45:35.472849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'7","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.492715+0000","last_change":"2024-05-21T14:43:19.620806+0000","last_active":"2024-05-21T14:45:35.492715+0000","last_peered":"2024-05-21T14:45:35.492715+0000","last_clean":"2024-05-21T14:45:35.492715+0000","last_became_active":"2024-05-21T14:43:19.620449+0000","last_became_peered":"2024-05-21T14:43:19.620449+0000","last_unstale":"2024-05-21T14:45:35.492715+0000","last_undegraded":"2024-05-21T14:45:35.492715+0000","last_fullsized":"2024-05-21T14:45:35.492715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172688+0000","last_change":"2024-05-21T14:43:18.603028+0000","last_active":"2024-05-21T14:44:00.172688+0000","last_peered":"2024-05-21T14:44:00.172688+0000","last_clean":"2024-05-21T14:44:00.172688+0000","last_became_active":"2024-05-21T14:43:18.602036+0000","last_became_peered":"2024-05-21T14:43:18.602036+0000","last_unstale":"2024-05-21T14:44:00.172688+0000","last_undegraded":"2024-05-21T14:44:00.172688+0000","last_fullsized":"2024-05-21T14:44:00.172688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:15:25.384197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.509869+0000","last_change":"2024-05-21T14:43:19.599725+0000","last_active":"2024-05-21T14:45:35.509869+0000","last_peered":"2024-05-21T14:45:35.509869+0000","last_clean":"2024-05-21T14:45:35.509869+0000","last_became_active":"2024-05-21T14:43:19.598972+0000","last_became_peered":"2024-05-21T14:43:19.598972+0000","last_unstale":"2024-05-21T14:45:35.509869+0000","last_undegraded":"2024-05-21T14:45:35.509869+0000","last_fullsized":"2024-05-21T14:45:35.509869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:54:00.871046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'7","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173868+0000","last_change":"2024-05-21T14:43:18.615934+0000","last_active":"2024-05-21T14:44:00.173868+0000","last_peered":"2024-05-21T14:44:00.173868+0000","last_clean":"2024-05-21T14:44:00.173868+0000","last_became_active":"2024-05-21T14:43:18.615568+0000","last_became_peered":"2024-05-21T14:43:18.615568+0000","last_unstale":"2024-05-21T14:44:00.173868+0000","last_undegraded":"2024-05-21T14:44:00.173868+0000","last_fullsized":"2024-05-21T14:44:00.173868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"23'3","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.199358+0000","last_change":"2024-05-21T14:43:18.615154+0000","last_active":"2024-05-21T14:44:00.199358+0000","last_peered":"2024-05-21T14:44:00.199358+0000","last_clean":"2024-05-21T14:44:00.199358+0000","last_became_active":"2024-05-21T14:43:18.613838+0000","last_became_peered":"2024-05-21T14:43:18.613838+0000","last_unstale":"2024-05-21T14:44:00.199358+0000","last_undegraded":"2024-05-21T14:44:00.199358+0000","last_fullsized":"2024-05-21T14:44:00.199358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:32:09.174124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.511460+0000","last_change":"2024-05-21T14:43:19.633585+0000","last_active":"2024-05-21T14:45:35.511460+0000","last_peered":"2024-05-21T14:45:35.511460+0000","last_clean":"2024-05-21T14:45:35.511460+0000","last_became_active":"2024-05-21T14:43:19.632476+0000","last_became_peered":"2024-05-21T14:43:19.632476+0000","last_unstale":"2024-05-21T14:45:35.511460+0000","last_undegraded":"2024-05-21T14:45:35.511460+0000","last_fullsized":"2024-05-21T14:45:35.511460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:53.023931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"23'3","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173552+0000","last_change":"2024-05-21T14:43:18.585548+0000","last_active":"2024-05-21T14:44:00.173552+0000","last_peered":"2024-05-21T14:44:00.173552+0000","last_clean":"2024-05-21T14:44:00.173552+0000","last_became_active":"2024-05-21T14:43:18.585099+0000","last_became_peered":"2024-05-21T14:43:18.585099+0000","last_unstale":"2024-05-21T14:44:00.173552+0000","last_undegraded":"2024-05-21T14:44:00.173552+0000","last_fullsized":"2024-05-21T14:44:00.173552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.507636+0000","last_change":"2024-05-21T14:43:19.614884+0000","last_active":"2024-05-21T14:45:35.507636+0000","last_peered":"2024-05-21T14:45:35.507636+0000","last_clean":"2024-05-21T14:45:35.507636+0000","last_became_active":"2024-05-21T14:43:19.614064+0000","last_became_peered":"2024-05-21T14:43:19.614064+0000","last_unstale":"2024-05-21T14:45:35.507636+0000","last_undegraded":"2024-05-21T14:45:35.507636+0000","last_fullsized":"2024-05-21T14:45:35.507636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:42:17.091043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'5","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:34.765227+0000","last_change":"2024-05-21T14:43:18.602794+0000","last_active":"2024-05-21T14:45:34.765227+0000","last_peered":"2024-05-21T14:45:34.765227+0000","last_clean":"2024-05-21T14:45:34.765227+0000","last_became_active":"2024-05-21T14:43:18.602429+0000","last_became_peered":"2024-05-21T14:43:18.602429+0000","last_unstale":"2024-05-21T14:45:34.765227+0000","last_undegraded":"2024-05-21T14:45:34.765227+0000","last_fullsized":"2024-05-21T14:45:34.765227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'10","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.487024+0000","last_change":"2024-05-21T14:43:19.602663+0000","last_active":"2024-05-21T14:45:35.487024+0000","last_peered":"2024-05-21T14:45:35.487024+0000","last_clean":"2024-05-21T14:45:35.487024+0000","last_became_active":"2024-05-21T14:43:19.602294+0000","last_became_peered":"2024-05-21T14:43:19.602294+0000","last_unstale":"2024-05-21T14:45:35.487024+0000","last_undegraded":"2024-05-21T14:45:35.487024+0000","last_fullsized":"2024-05-21T14:45:35.487024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'6","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:40.699462+0000","last_change":"2024-05-21T14:45:40.699492+0000","last_active":"2024-05-21T14:45:40.699462+0000","last_peered":"2024-05-21T14:45:40.699462+0000","last_clean":"2024-05-21T14:45:40.699462+0000","last_became_active":"2024-05-21T14:43:18.604262+0000","last_became_peered":"2024-05-21T14:43:18.604262+0000","last_unstale":"2024-05-21T14:45:40.699462+0000","last_undegraded":"2024-05-21T14:45:40.699462+0000","last_fullsized":"2024-05-21T14:45:40.699462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-05-21T14:45:40.699389+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-05-21T14:45:40.699389+0000","last_clean_scrub_stamp":"2024-05-21T14:45:40.699389+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:15:46.057047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'9","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.511104+0000","last_change":"2024-05-21T14:43:19.613952+0000","last_active":"2024-05-21T14:45:35.511104+0000","last_peered":"2024-05-21T14:45:35.511104+0000","last_clean":"2024-05-21T14:45:35.511104+0000","last_became_active":"2024-05-21T14:43:19.613093+0000","last_became_peered":"2024-05-21T14:43:19.613093+0000","last_unstale":"2024-05-21T14:45:35.511104+0000","last_undegraded":"2024-05-21T14:45:35.511104+0000","last_fullsized":"2024-05-21T14:45:35.511104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:03:44.925212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'8","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:34.779912+0000","last_change":"2024-05-21T14:43:18.602343+0000","last_active":"2024-05-21T14:45:34.779912+0000","last_peered":"2024-05-21T14:45:34.779912+0000","last_clean":"2024-05-21T14:45:34.779912+0000","last_became_active":"2024-05-21T14:43:18.601500+0000","last_became_peered":"2024-05-21T14:43:18.601500+0000","last_unstale":"2024-05-21T14:45:34.779912+0000","last_undegraded":"2024-05-21T14:45:34.779912+0000","last_fullsized":"2024-05-21T14:45:34.779912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:54:21.960430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'11","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:40.535015+0000","last_change":"2024-05-21T14:43:19.608580+0000","last_active":"2024-05-21T14:45:40.535015+0000","last_peered":"2024-05-21T14:45:40.535015+0000","last_clean":"2024-05-21T14:45:40.535015+0000","last_became_active":"2024-05-21T14:43:19.608038+0000","last_became_peered":"2024-05-21T14:43:19.608038+0000","last_unstale":"2024-05-21T14:45:40.535015+0000","last_undegraded":"2024-05-21T14:45:40.535015+0000","last_fullsized":"2024-05-21T14:45:40.535015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'31","reported_seq":59,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:40.755609+0000","last_change":"2024-05-21T14:45:40.755609+0000","last_active":"2024-05-21T14:45:40.755609+0000","last_peered":"2024-05-21T14:45:40.755609+0000","last_clean":"2024-05-21T14:45:40.755609+0000","last_became_active":"2024-05-21T14:43:18.606449+0000","last_became_peered":"2024-05-21T14:43:18.606449+0000","last_unstale":"2024-05-21T14:45:40.755609+0000","last_undegraded":"2024-05-21T14:45:40.755609+0000","last_fullsized":"2024-05-21T14:45:40.755609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'31","last_scrub_stamp":"2024-05-21T14:45:40.755486+0000","last_deep_scrub":"25'31","last_deep_scrub_stamp":"2024-05-21T14:45:40.755486+0000","last_clean_scrub_stamp":"2024-05-21T14:45:40.755486+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:32:03.796754+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34914,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'6","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.479951+0000","last_change":"2024-05-21T14:43:19.634014+0000","last_active":"2024-05-21T14:45:35.479951+0000","last_peered":"2024-05-21T14:45:35.479951+0000","last_clean":"2024-05-21T14:45:35.479951+0000","last_became_active":"2024-05-21T14:43:19.633664+0000","last_became_peered":"2024-05-21T14:43:19.633664+0000","last_unstale":"2024-05-21T14:45:35.479951+0000","last_undegraded":"2024-05-21T14:45:35.479951+0000","last_fullsized":"2024-05-21T14:45:35.479951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'9","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.814561+0000","last_change":"2024-05-21T14:43:18.614764+0000","last_active":"2024-05-21T14:43:59.814561+0000","last_peered":"2024-05-21T14:43:59.814561+0000","last_clean":"2024-05-21T14:43:59.814561+0000","last_became_active":"2024-05-21T14:43:18.614214+0000","last_became_peered":"2024-05-21T14:43:18.614214+0000","last_unstale":"2024-05-21T14:43:59.814561+0000","last_undegraded":"2024-05-21T14:43:59.814561+0000","last_fullsized":"2024-05-21T14:43:59.814561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:34:40.294756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'9","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.508763+0000","last_change":"2024-05-21T14:43:19.625313+0000","last_active":"2024-05-21T14:45:35.508763+0000","last_peered":"2024-05-21T14:45:35.508763+0000","last_clean":"2024-05-21T14:45:35.508763+0000","last_became_active":"2024-05-21T14:43:19.624474+0000","last_became_peered":"2024-05-21T14:43:19.624474+0000","last_unstale":"2024-05-21T14:45:35.508763+0000","last_undegraded":"2024-05-21T14:45:35.508763+0000","last_fullsized":"2024-05-21T14:45:35.508763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:28.280456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'6","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:40.534794+0000","last_change":"2024-05-21T14:43:18.600736+0000","last_active":"2024-05-21T14:45:40.534794+0000","last_peered":"2024-05-21T14:45:40.534794+0000","last_clean":"2024-05-21T14:45:40.534794+0000","last_became_active":"2024-05-21T14:43:18.600415+0000","last_became_peered":"2024-05-21T14:43:18.600415+0000","last_unstale":"2024-05-21T14:45:40.534794+0000","last_undegraded":"2024-05-21T14:45:40.534794+0000","last_fullsized":"2024-05-21T14:45:40.534794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'15","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:40.534986+0000","last_change":"2024-05-21T14:43:19.599637+0000","last_active":"2024-05-21T14:45:40.534986+0000","last_peered":"2024-05-21T14:45:40.534986+0000","last_clean":"2024-05-21T14:45:40.534986+0000","last_became_active":"2024-05-21T14:43:19.599195+0000","last_became_peered":"2024-05-21T14:43:19.599195+0000","last_unstale":"2024-05-21T14:45:40.534986+0000","last_undegraded":"2024-05-21T14:45:40.534986+0000","last_fullsized":"2024-05-21T14:45:40.534986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'8","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:39.731020+0000","last_change":"2024-05-21T14:45:39.731020+0000","last_active":"2024-05-21T14:45:39.731020+0000","last_peered":"2024-05-21T14:45:39.731020+0000","last_clean":"2024-05-21T14:45:39.731020+0000","last_became_active":"2024-05-21T14:43:18.602658+0000","last_became_peered":"2024-05-21T14:43:18.602658+0000","last_unstale":"2024-05-21T14:45:39.731020+0000","last_undegraded":"2024-05-21T14:45:39.731020+0000","last_fullsized":"2024-05-21T14:45:39.731020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2024-05-21T14:45:39.730921+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2024-05-21T14:45:39.730921+0000","last_clean_scrub_stamp":"2024-05-21T14:45:39.730921+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:52:02.191492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'6","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:39.442508+0000","last_change":"2024-05-21T14:43:19.620760+0000","last_active":"2024-05-21T14:45:39.442508+0000","last_peered":"2024-05-21T14:45:39.442508+0000","last_clean":"2024-05-21T14:45:39.442508+0000","last_became_active":"2024-05-21T14:43:19.620409+0000","last_became_peered":"2024-05-21T14:43:19.620409+0000","last_unstale":"2024-05-21T14:45:39.442508+0000","last_undegraded":"2024-05-21T14:45:39.442508+0000","last_fullsized":"2024-05-21T14:45:39.442508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'18","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.770436+0000","last_change":"2024-05-21T14:43:18.594225+0000","last_active":"2024-05-21T14:45:35.770436+0000","last_peered":"2024-05-21T14:45:35.770436+0000","last_clean":"2024-05-21T14:45:35.770436+0000","last_became_active":"2024-05-21T14:43:18.592335+0000","last_became_peered":"2024-05-21T14:43:18.592335+0000","last_unstale":"2024-05-21T14:45:35.770436+0000","last_undegraded":"2024-05-21T14:45:35.770436+0000","last_fullsized":"2024-05-21T14:45:35.770436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:00:58.772091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'6","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:40.535002+0000","last_change":"2024-05-21T14:43:19.612442+0000","last_active":"2024-05-21T14:45:40.535002+0000","last_peered":"2024-05-21T14:45:40.535002+0000","last_clean":"2024-05-21T14:45:40.535002+0000","last_became_active":"2024-05-21T14:43:19.612110+0000","last_became_peered":"2024-05-21T14:43:19.612110+0000","last_unstale":"2024-05-21T14:45:40.535002+0000","last_undegraded":"2024-05-21T14:45:40.535002+0000","last_fullsized":"2024-05-21T14:45:40.535002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.975109+0000","last_change":"2024-05-21T14:43:18.613433+0000","last_active":"2024-05-21T14:45:35.975109+0000","last_peered":"2024-05-21T14:45:35.975109+0000","last_clean":"2024-05-21T14:45:35.975109+0000","last_became_active":"2024-05-21T14:43:18.613048+0000","last_became_peered":"2024-05-21T14:43:18.613048+0000","last_unstale":"2024-05-21T14:45:35.975109+0000","last_undegraded":"2024-05-21T14:45:35.975109+0000","last_fullsized":"2024-05-21T14:45:35.975109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.978935+0000","last_change":"2024-05-21T14:43:19.597079+0000","last_active":"2024-05-21T14:45:35.978935+0000","last_peered":"2024-05-21T14:45:35.978935+0000","last_clean":"2024-05-21T14:45:35.978935+0000","last_became_active":"2024-05-21T14:43:19.596736+0000","last_became_peered":"2024-05-21T14:43:19.596736+0000","last_unstale":"2024-05-21T14:45:35.978935+0000","last_undegraded":"2024-05-21T14:45:35.978935+0000","last_fullsized":"2024-05-21T14:45:35.978935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'5","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815283+0000","last_change":"2024-05-21T14:43:18.620603+0000","last_active":"2024-05-21T14:43:59.815283+0000","last_peered":"2024-05-21T14:43:59.815283+0000","last_clean":"2024-05-21T14:43:59.815283+0000","last_became_active":"2024-05-21T14:43:18.619762+0000","last_became_peered":"2024-05-21T14:43:18.619762+0000","last_unstale":"2024-05-21T14:43:59.815283+0000","last_undegraded":"2024-05-21T14:43:59.815283+0000","last_fullsized":"2024-05-21T14:43:59.815283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:31:49.257435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'9","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.488082+0000","last_change":"2024-05-21T14:43:59.818544+0000","last_active":"2024-05-21T14:45:35.488082+0000","last_peered":"2024-05-21T14:45:35.488082+0000","last_clean":"2024-05-21T14:45:35.488082+0000","last_became_active":"2024-05-21T14:43:59.817946+0000","last_became_peered":"2024-05-21T14:43:59.817946+0000","last_unstale":"2024-05-21T14:45:35.488082+0000","last_undegraded":"2024-05-21T14:45:35.488082+0000","last_fullsized":"2024-05-21T14:45:35.488082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:20:02.691907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'3","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173272+0000","last_change":"2024-05-21T14:43:18.610121+0000","last_active":"2024-05-21T14:44:00.173272+0000","last_peered":"2024-05-21T14:44:00.173272+0000","last_clean":"2024-05-21T14:44:00.173272+0000","last_became_active":"2024-05-21T14:43:18.609349+0000","last_became_peered":"2024-05-21T14:43:18.609349+0000","last_unstale":"2024-05-21T14:44:00.173272+0000","last_undegraded":"2024-05-21T14:44:00.173272+0000","last_fullsized":"2024-05-21T14:44:00.173272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:48.330067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'6","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.975058+0000","last_change":"2024-05-21T14:43:19.605193+0000","last_active":"2024-05-21T14:45:35.975058+0000","last_peered":"2024-05-21T14:45:35.975058+0000","last_clean":"2024-05-21T14:45:35.975058+0000","last_became_active":"2024-05-21T14:43:19.604869+0000","last_became_peered":"2024-05-21T14:43:19.604869+0000","last_unstale":"2024-05-21T14:45:35.975058+0000","last_undegraded":"2024-05-21T14:45:35.975058+0000","last_fullsized":"2024-05-21T14:45:35.975058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"23'5","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.200122+0000","last_change":"2024-05-21T14:43:18.616535+0000","last_active":"2024-05-21T14:44:00.200122+0000","last_peered":"2024-05-21T14:44:00.200122+0000","last_clean":"2024-05-21T14:44:00.200122+0000","last_became_active":"2024-05-21T14:43:18.615734+0000","last_became_peered":"2024-05-21T14:43:18.615734+0000","last_unstale":"2024-05-21T14:44:00.200122+0000","last_undegraded":"2024-05-21T14:44:00.200122+0000","last_fullsized":"2024-05-21T14:44:00.200122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:10:27.821535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'7","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:36.290447+0000","last_change":"2024-05-21T14:43:19.615424+0000","last_active":"2024-05-21T14:45:36.290447+0000","last_peered":"2024-05-21T14:45:36.290447+0000","last_clean":"2024-05-21T14:45:36.290447+0000","last_became_active":"2024-05-21T14:43:19.614915+0000","last_became_peered":"2024-05-21T14:43:19.614915+0000","last_unstale":"2024-05-21T14:45:36.290447+0000","last_undegraded":"2024-05-21T14:45:36.290447+0000","last_fullsized":"2024-05-21T14:45:36.290447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":186,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:40.201626+0000","last_change":"2024-05-21T14:45:40.201657+0000","last_active":"2024-05-21T14:45:40.201626+0000","last_peered":"2024-05-21T14:45:40.201626+0000","last_clean":"2024-05-21T14:45:40.201626+0000","last_became_active":"2024-05-21T14:43:08.079934+0000","last_became_peered":"2024-05-21T14:43:08.079934+0000","last_unstale":"2024-05-21T14:45:40.201626+0000","last_undegraded":"2024-05-21T14:45:40.201626+0000","last_fullsized":"2024-05-21T14:45:40.201626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2024-05-21T14:45:40.201549+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2024-05-21T14:45:40.201549+0000","last_clean_scrub_stamp":"2024-05-21T14:45:40.201549+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:15:29.098557+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'6","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:25.971460+0000","last_change":"2024-05-21T14:43:18.599850+0000","last_active":"2024-05-21T14:45:25.971460+0000","last_peered":"2024-05-21T14:45:25.971460+0000","last_clean":"2024-05-21T14:45:25.971460+0000","last_became_active":"2024-05-21T14:43:18.599347+0000","last_became_peered":"2024-05-21T14:43:18.599347+0000","last_unstale":"2024-05-21T14:45:25.971460+0000","last_undegraded":"2024-05-21T14:45:25.971460+0000","last_fullsized":"2024-05-21T14:45:25.971460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.513105+0000","last_change":"2024-05-21T14:43:19.613056+0000","last_active":"2024-05-21T14:45:35.513105+0000","last_peered":"2024-05-21T14:45:35.513105+0000","last_clean":"2024-05-21T14:45:35.513105+0000","last_became_active":"2024-05-21T14:43:19.611889+0000","last_became_peered":"2024-05-21T14:43:19.611889+0000","last_unstale":"2024-05-21T14:45:35.513105+0000","last_undegraded":"2024-05-21T14:45:35.513105+0000","last_fullsized":"2024-05-21T14:45:35.513105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:46:20.105282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"23'4","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:20.970764+0000","last_change":"2024-05-21T14:43:18.621482+0000","last_active":"2024-05-21T14:45:20.970764+0000","last_peered":"2024-05-21T14:45:20.970764+0000","last_clean":"2024-05-21T14:45:20.970764+0000","last_became_active":"2024-05-21T14:43:18.621229+0000","last_became_peered":"2024-05-21T14:43:18.621229+0000","last_unstale":"2024-05-21T14:45:20.970764+0000","last_undegraded":"2024-05-21T14:45:20.970764+0000","last_fullsized":"2024-05-21T14:45:20.970764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'5","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.465295+0000","last_change":"2024-05-21T14:43:19.625038+0000","last_active":"2024-05-21T14:45:35.465295+0000","last_peered":"2024-05-21T14:45:35.465295+0000","last_clean":"2024-05-21T14:45:35.465295+0000","last_became_active":"2024-05-21T14:43:19.624114+0000","last_became_peered":"2024-05-21T14:43:19.624114+0000","last_unstale":"2024-05-21T14:45:35.465295+0000","last_undegraded":"2024-05-21T14:45:35.465295+0000","last_fullsized":"2024-05-21T14:45:35.465295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:11.854243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.765675+0000","last_change":"2024-05-21T14:43:18.618518+0000","last_active":"2024-05-21T14:45:35.765675+0000","last_peered":"2024-05-21T14:45:35.765675+0000","last_clean":"2024-05-21T14:45:35.765675+0000","last_became_active":"2024-05-21T14:43:18.617756+0000","last_became_peered":"2024-05-21T14:43:18.617756+0000","last_unstale":"2024-05-21T14:45:35.765675+0000","last_undegraded":"2024-05-21T14:45:35.765675+0000","last_fullsized":"2024-05-21T14:45:35.765675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:52:12.999877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.503687+0000","last_change":"2024-05-21T14:43:19.613595+0000","last_active":"2024-05-21T14:45:35.503687+0000","last_peered":"2024-05-21T14:45:35.503687+0000","last_clean":"2024-05-21T14:45:35.503687+0000","last_became_active":"2024-05-21T14:43:19.612730+0000","last_became_peered":"2024-05-21T14:43:19.612730+0000","last_unstale":"2024-05-21T14:45:35.503687+0000","last_undegraded":"2024-05-21T14:45:35.503687+0000","last_fullsized":"2024-05-21T14:45:35.503687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:01:02.847071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"23'5","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:25.971407+0000","last_change":"2024-05-21T14:43:18.608596+0000","last_active":"2024-05-21T14:45:25.971407+0000","last_peered":"2024-05-21T14:45:25.971407+0000","last_clean":"2024-05-21T14:45:25.971407+0000","last_became_active":"2024-05-21T14:43:18.608262+0000","last_became_peered":"2024-05-21T14:43:18.608262+0000","last_unstale":"2024-05-21T14:45:25.971407+0000","last_undegraded":"2024-05-21T14:45:25.971407+0000","last_fullsized":"2024-05-21T14:45:25.971407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'7","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.476683+0000","last_change":"2024-05-21T14:43:19.607815+0000","last_active":"2024-05-21T14:45:35.476683+0000","last_peered":"2024-05-21T14:45:35.476683+0000","last_clean":"2024-05-21T14:45:35.476683+0000","last_became_active":"2024-05-21T14:43:19.607513+0000","last_became_peered":"2024-05-21T14:43:19.607513+0000","last_unstale":"2024-05-21T14:45:35.476683+0000","last_undegraded":"2024-05-21T14:45:35.476683+0000","last_fullsized":"2024-05-21T14:45:35.476683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.172926+0000","last_change":"2024-05-21T14:43:18.603626+0000","last_active":"2024-05-21T14:44:00.172926+0000","last_peered":"2024-05-21T14:44:00.172926+0000","last_clean":"2024-05-21T14:44:00.172926+0000","last_became_active":"2024-05-21T14:43:18.602704+0000","last_became_peered":"2024-05-21T14:43:18.602704+0000","last_unstale":"2024-05-21T14:44:00.172926+0000","last_undegraded":"2024-05-21T14:44:00.172926+0000","last_fullsized":"2024-05-21T14:44:00.172926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:32:03.976820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.472555+0000","last_change":"2024-05-21T14:43:19.634449+0000","last_active":"2024-05-21T14:45:35.472555+0000","last_peered":"2024-05-21T14:45:35.472555+0000","last_clean":"2024-05-21T14:45:35.472555+0000","last_became_active":"2024-05-21T14:43:19.633751+0000","last_became_peered":"2024-05-21T14:43:19.633751+0000","last_unstale":"2024-05-21T14:45:35.472555+0000","last_undegraded":"2024-05-21T14:45:35.472555+0000","last_fullsized":"2024-05-21T14:45:35.472555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"23'4","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:25.971485+0000","last_change":"2024-05-21T14:43:18.608335+0000","last_active":"2024-05-21T14:45:25.971485+0000","last_peered":"2024-05-21T14:45:25.971485+0000","last_clean":"2024-05-21T14:45:25.971485+0000","last_became_active":"2024-05-21T14:43:18.607999+0000","last_became_peered":"2024-05-21T14:43:18.607999+0000","last_unstale":"2024-05-21T14:45:25.971485+0000","last_undegraded":"2024-05-21T14:45:25.971485+0000","last_fullsized":"2024-05-21T14:45:25.971485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'9","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.505561+0000","last_change":"2024-05-21T14:43:19.626742+0000","last_active":"2024-05-21T14:45:35.505561+0000","last_peered":"2024-05-21T14:45:35.505561+0000","last_clean":"2024-05-21T14:45:35.505561+0000","last_became_active":"2024-05-21T14:43:19.626024+0000","last_became_peered":"2024-05-21T14:43:19.626024+0000","last_unstale":"2024-05-21T14:45:35.505561+0000","last_undegraded":"2024-05-21T14:45:35.505561+0000","last_fullsized":"2024-05-21T14:45:35.505561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:48:15.426224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'16","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:34.765261+0000","last_change":"2024-05-21T14:43:18.616913+0000","last_active":"2024-05-21T14:45:34.765261+0000","last_peered":"2024-05-21T14:45:34.765261+0000","last_clean":"2024-05-21T14:45:34.765261+0000","last_became_active":"2024-05-21T14:43:18.616214+0000","last_became_peered":"2024-05-21T14:43:18.616214+0000","last_unstale":"2024-05-21T14:45:34.765261+0000","last_undegraded":"2024-05-21T14:45:34.765261+0000","last_fullsized":"2024-05-21T14:45:34.765261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:22.112018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'5","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.500722+0000","last_change":"2024-05-21T14:43:19.607521+0000","last_active":"2024-05-21T14:45:35.500722+0000","last_peered":"2024-05-21T14:45:35.500722+0000","last_clean":"2024-05-21T14:45:35.500722+0000","last_became_active":"2024-05-21T14:43:19.606673+0000","last_became_peered":"2024-05-21T14:43:19.606673+0000","last_unstale":"2024-05-21T14:45:35.500722+0000","last_undegraded":"2024-05-21T14:45:35.500722+0000","last_fullsized":"2024-05-21T14:45:35.500722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:50:50.373410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'8","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:34.773237+0000","last_change":"2024-05-21T14:43:18.615846+0000","last_active":"2024-05-21T14:45:34.773237+0000","last_peered":"2024-05-21T14:45:34.773237+0000","last_clean":"2024-05-21T14:45:34.773237+0000","last_became_active":"2024-05-21T14:43:18.615506+0000","last_became_peered":"2024-05-21T14:43:18.615506+0000","last_unstale":"2024-05-21T14:45:34.773237+0000","last_undegraded":"2024-05-21T14:45:34.773237+0000","last_fullsized":"2024-05-21T14:45:34.773237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'7","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.509522+0000","last_change":"2024-05-21T14:43:19.611473+0000","last_active":"2024-05-21T14:45:35.509522+0000","last_peered":"2024-05-21T14:45:35.509522+0000","last_clean":"2024-05-21T14:45:35.509522+0000","last_became_active":"2024-05-21T14:43:19.610600+0000","last_became_peered":"2024-05-21T14:43:19.610600+0000","last_unstale":"2024-05-21T14:45:35.509522+0000","last_undegraded":"2024-05-21T14:45:35.509522+0000","last_fullsized":"2024-05-21T14:45:35.509522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:48:07.659795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"23'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:30.974381+0000","last_change":"2024-05-21T14:43:18.604951+0000","last_active":"2024-05-21T14:45:30.974381+0000","last_peered":"2024-05-21T14:45:30.974381+0000","last_clean":"2024-05-21T14:45:30.974381+0000","last_became_active":"2024-05-21T14:43:18.602186+0000","last_became_peered":"2024-05-21T14:43:18.602186+0000","last_unstale":"2024-05-21T14:45:30.974381+0000","last_undegraded":"2024-05-21T14:45:30.974381+0000","last_fullsized":"2024-05-21T14:45:30.974381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'2","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:40.727951+0000","last_change":"2024-05-21T14:45:40.727976+0000","last_active":"2024-05-21T14:45:40.727951+0000","last_peered":"2024-05-21T14:45:40.727951+0000","last_clean":"2024-05-21T14:45:40.727951+0000","last_became_active":"2024-05-21T14:43:19.600499+0000","last_became_peered":"2024-05-21T14:43:19.600499+0000","last_unstale":"2024-05-21T14:45:40.727951+0000","last_undegraded":"2024-05-21T14:45:40.727951+0000","last_fullsized":"2024-05-21T14:45:40.727951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-21T14:45:40.727855+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-21T14:45:40.727855+0000","last_clean_scrub_stamp":"2024-05-21T14:45:40.727855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:07:28.918560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"23'7","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.813798+0000","last_change":"2024-05-21T14:43:18.615190+0000","last_active":"2024-05-21T14:43:59.813798+0000","last_peered":"2024-05-21T14:43:59.813798+0000","last_clean":"2024-05-21T14:43:59.813798+0000","last_became_active":"2024-05-21T14:43:18.614306+0000","last_became_peered":"2024-05-21T14:43:18.614306+0000","last_unstale":"2024-05-21T14:43:59.813798+0000","last_undegraded":"2024-05-21T14:43:59.813798+0000","last_fullsized":"2024-05-21T14:43:59.813798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:53.472559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'9","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.501271+0000","last_change":"2024-05-21T14:43:19.610903+0000","last_active":"2024-05-21T14:45:35.501271+0000","last_peered":"2024-05-21T14:45:35.501271+0000","last_clean":"2024-05-21T14:45:35.501271+0000","last_became_active":"2024-05-21T14:43:19.610101+0000","last_became_peered":"2024-05-21T14:43:19.610101+0000","last_unstale":"2024-05-21T14:45:35.501271+0000","last_undegraded":"2024-05-21T14:45:35.501271+0000","last_fullsized":"2024-05-21T14:45:35.501271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:16:24.580581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"23'3","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.200092+0000","last_change":"2024-05-21T14:43:18.617785+0000","last_active":"2024-05-21T14:44:00.200092+0000","last_peered":"2024-05-21T14:44:00.200092+0000","last_clean":"2024-05-21T14:44:00.200092+0000","last_became_active":"2024-05-21T14:43:18.617041+0000","last_became_peered":"2024-05-21T14:43:18.617041+0000","last_unstale":"2024-05-21T14:44:00.200092+0000","last_undegraded":"2024-05-21T14:44:00.200092+0000","last_fullsized":"2024-05-21T14:44:00.200092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:02:50.837158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.489733+0000","last_change":"2024-05-21T14:43:19.627096+0000","last_active":"2024-05-21T14:45:35.489733+0000","last_peered":"2024-05-21T14:45:35.489733+0000","last_clean":"2024-05-21T14:45:35.489733+0000","last_became_active":"2024-05-21T14:43:19.626265+0000","last_became_peered":"2024-05-21T14:43:19.626265+0000","last_unstale":"2024-05-21T14:45:35.489733+0000","last_undegraded":"2024-05-21T14:45:35.489733+0000","last_fullsized":"2024-05-21T14:45:35.489733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:23:47.818120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'5","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.972589+0000","last_change":"2024-05-21T14:43:18.599635+0000","last_active":"2024-05-21T14:45:35.972589+0000","last_peered":"2024-05-21T14:45:35.972589+0000","last_clean":"2024-05-21T14:45:35.972589+0000","last_became_active":"2024-05-21T14:43:18.598996+0000","last_became_peered":"2024-05-21T14:43:18.598996+0000","last_unstale":"2024-05-21T14:45:35.972589+0000","last_undegraded":"2024-05-21T14:45:35.972589+0000","last_fullsized":"2024-05-21T14:45:35.972589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'5","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.490137+0000","last_change":"2024-05-21T14:43:19.617686+0000","last_active":"2024-05-21T14:45:35.490137+0000","last_peered":"2024-05-21T14:45:35.490137+0000","last_clean":"2024-05-21T14:45:35.490137+0000","last_became_active":"2024-05-21T14:43:19.617398+0000","last_became_peered":"2024-05-21T14:43:19.617398+0000","last_unstale":"2024-05-21T14:45:35.490137+0000","last_undegraded":"2024-05-21T14:45:35.490137+0000","last_fullsized":"2024-05-21T14:45:35.490137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'15","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.491098+0000","last_change":"2024-05-21T14:43:19.601673+0000","last_active":"2024-05-21T14:45:35.491098+0000","last_peered":"2024-05-21T14:45:35.491098+0000","last_clean":"2024-05-21T14:45:35.491098+0000","last_became_active":"2024-05-21T14:43:19.601286+0000","last_became_peered":"2024-05-21T14:43:19.601286+0000","last_unstale":"2024-05-21T14:45:35.491098+0000","last_undegraded":"2024-05-21T14:45:35.491098+0000","last_fullsized":"2024-05-21T14:45:35.491098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'5","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173890+0000","last_change":"2024-05-21T14:43:18.613555+0000","last_active":"2024-05-21T14:44:00.173890+0000","last_peered":"2024-05-21T14:44:00.173890+0000","last_clean":"2024-05-21T14:44:00.173890+0000","last_became_active":"2024-05-21T14:43:18.613117+0000","last_became_peered":"2024-05-21T14:43:18.613117+0000","last_unstale":"2024-05-21T14:44:00.173890+0000","last_undegraded":"2024-05-21T14:44:00.173890+0000","last_fullsized":"2024-05-21T14:44:00.173890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'9","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.474148+0000","last_change":"2024-05-21T14:43:19.596736+0000","last_active":"2024-05-21T14:45:35.474148+0000","last_peered":"2024-05-21T14:45:35.474148+0000","last_clean":"2024-05-21T14:45:35.474148+0000","last_became_active":"2024-05-21T14:43:19.596157+0000","last_became_peered":"2024-05-21T14:43:19.596157+0000","last_unstale":"2024-05-21T14:45:35.474148+0000","last_undegraded":"2024-05-21T14:45:35.474148+0000","last_fullsized":"2024-05-21T14:45:35.474148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'13","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:34.763653+0000","last_change":"2024-05-21T14:43:18.614044+0000","last_active":"2024-05-21T14:45:34.763653+0000","last_peered":"2024-05-21T14:45:34.763653+0000","last_clean":"2024-05-21T14:45:34.763653+0000","last_became_active":"2024-05-21T14:43:18.613730+0000","last_became_peered":"2024-05-21T14:43:18.613730+0000","last_unstale":"2024-05-21T14:45:34.763653+0000","last_undegraded":"2024-05-21T14:45:34.763653+0000","last_fullsized":"2024-05-21T14:45:34.763653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'6","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.512506+0000","last_change":"2024-05-21T14:43:19.621999+0000","last_active":"2024-05-21T14:45:35.512506+0000","last_peered":"2024-05-21T14:45:35.512506+0000","last_clean":"2024-05-21T14:45:35.512506+0000","last_became_active":"2024-05-21T14:43:19.614744+0000","last_became_peered":"2024-05-21T14:43:19.614744+0000","last_unstale":"2024-05-21T14:45:35.512506+0000","last_undegraded":"2024-05-21T14:45:35.512506+0000","last_fullsized":"2024-05-21T14:45:35.512506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:32:37.316833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:44:00.173242+0000","last_change":"2024-05-21T14:43:18.614193+0000","last_active":"2024-05-21T14:44:00.173242+0000","last_peered":"2024-05-21T14:44:00.173242+0000","last_clean":"2024-05-21T14:44:00.173242+0000","last_became_active":"2024-05-21T14:43:18.609797+0000","last_became_peered":"2024-05-21T14:43:18.609797+0000","last_unstale":"2024-05-21T14:44:00.173242+0000","last_undegraded":"2024-05-21T14:44:00.173242+0000","last_fullsized":"2024-05-21T14:44:00.173242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:39:55.623816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'5","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:35.496860+0000","last_change":"2024-05-21T14:43:19.610578+0000","last_active":"2024-05-21T14:45:35.496860+0000","last_peered":"2024-05-21T14:45:35.496860+0000","last_clean":"2024-05-21T14:45:35.496860+0000","last_became_active":"2024-05-21T14:43:19.606575+0000","last_became_peered":"2024-05-21T14:43:19.606575+0000","last_unstale":"2024-05-21T14:45:35.496860+0000","last_undegraded":"2024-05-21T14:45:35.496860+0000","last_fullsized":"2024-05-21T14:45:35.496860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:18.563095+0000","last_clean_scrub_stamp":"2024-05-21T14:43:18.563095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:50:06.088520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'13","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:43:59.815910+0000","last_change":"2024-05-21T14:43:18.601862+0000","last_active":"2024-05-21T14:43:59.815910+0000","last_peered":"2024-05-21T14:43:59.815910+0000","last_clean":"2024-05-21T14:43:59.815910+0000","last_became_active":"2024-05-21T14:43:18.601311+0000","last_became_peered":"2024-05-21T14:43:18.601311+0000","last_unstale":"2024-05-21T14:43:59.815910+0000","last_undegraded":"2024-05-21T14:43:59.815910+0000","last_fullsized":"2024-05-21T14:43:59.815910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T14:43:17.549616+0000","last_clean_scrub_stamp":"2024-05-21T14:43:17.549616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:08:02.736061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":41740,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":244,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":335872,"data_stored":83480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":95528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":684746,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509473,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":129900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":95870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509474,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":128130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509473,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":684930,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509474,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":95690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":94606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":34982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":36752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T14:45:43.141 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.141 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.141 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.141 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.141 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.142 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.142 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.142 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.142 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.142 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.142 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.142 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.142 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.142 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.143 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.143 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.143 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.143 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.143 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.143 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.143 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.143 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.144 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.144 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.144 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.144 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.144 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.144 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.144 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.144 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.144 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.144 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.145 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.145 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.145 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.145 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.145 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.145 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.145 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.145 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.145 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.146 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.146 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.146 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.146 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.146 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.146 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.146 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.146 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.147 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.147 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.147 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.147 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.147 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.147 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.147 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.147 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.147 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.148 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.148 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.148 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.148 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.148 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.148 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.148 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.148 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.148 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.149 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.149 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.149 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.149 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.149 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.149 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.149 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.149 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.149 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.150 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.150 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.150 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.150 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.150 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.150 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.150 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.150 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.150 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.151 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.151 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.151 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.151 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.151 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.151 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-21T14:43:18.563095+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=18, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.151 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-05-21T14:43:17.549616+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=43, tm_sec=17, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=14, tm_min=45, tm_sec=37, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T14:45:43.151 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-21T14:45:47.369 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:45:47.373 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:46:03.152 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T14:46:03.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.299+0000 7fa680c00640 1 Processor -- start 2024-05-21T14:46:03.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.299+0000 7fa680c00640 1 -- start start 2024-05-21T14:46:03.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.299+0000 7fa680c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa67c1529d0 0x7fa67c072e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:03.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.299+0000 7fa680c00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa67c071fe0 0x7fa67c0723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:03.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.299+0000 7fa680c00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c073380 con 0x7fa67c0c5640 2024-05-21T14:46:03.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.299+0000 7fa680c00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7fa67c0715f0 con 0x7fa67c071fe0 2024-05-21T14:46:03.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.299+0000 7fa680c00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa67c072b80 con 0x7fa67c1529d0 2024-05-21T14:46:03.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.299+0000 7fa679400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa67c071fe0 0x7fa67c0723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:03.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.299+0000 7fa679400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa67c071fe0 0x7fa67c0723f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56122/0 (socket says 172.21.15.78:56122) 2024-05-21T14:46:03.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.299+0000 7fa679400640 1 -- 172.21.15.78:0/1918710574 learned_addr learned my addr 172.21.15.78:0/1918710574 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:46:03.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.299+0000 7fa679e00640 1 --2- 172.21.15.78:0/1918710574 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa67c1529d0 0x7fa67c072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.299+0000 7fa679400640 1 -- 172.21.15.78:0/1918710574 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa67c1529d0 msgr2=0x7fa67c072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:46:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.299+0000 7fa679400640 1 --2- 172.21.15.78:0/1918710574 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa67c1529d0 0x7fa67c072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.299+0000 7fa679400640 1 -- 172.21.15.78:0/1918710574 >> v1:172.21.15.84:6789/0 conn(0x7fa67c0c5640 legacy=0x7fa67c06b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.299+0000 7fa679400640 1 -- 172.21.15.78:0/1918710574 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c0c8530 con 0x7fa67c071fe0 2024-05-21T14:46:03.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.303+0000 7fa679400640 1 --2- 172.21.15.78:0/1918710574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa67c071fe0 0x7fa67c0723f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009870 tx=0x7fa66c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b18c46e8202d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:03.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.303+0000 7fa678a00640 1 -- 172.21.15.78:0/1918710574 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0b2070 con 0x7fa67c071fe0 2024-05-21T14:46:03.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.303+0000 7fa678a00640 1 -- 172.21.15.78:0/1918710574 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa66c0a9070 con 0x7fa67c071fe0 2024-05-21T14:46:03.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.303+0000 7fa678a00640 1 -- 172.21.15.78:0/1918710574 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0ad880 con 0x7fa67c071fe0 2024-05-21T14:46:03.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.303+0000 7fa680c00640 1 -- 172.21.15.78:0/1918710574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa67c071fe0 msgr2=0x7fa67c0723f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:03.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.303+0000 7fa680c00640 1 --2- 172.21.15.78:0/1918710574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa67c071fe0 0x7fa67c0723f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009870 tx=0x7fa66c01c560 comp rx=0 tx=0).stop 2024-05-21T14:46:03.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.303+0000 7fa680c00640 1 -- 172.21.15.78:0/1918710574 shutdown_connections 2024-05-21T14:46:03.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.303+0000 7fa680c00640 1 --2- 172.21.15.78:0/1918710574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa67c071fe0 0x7fa67c0723f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.303+0000 7fa680c00640 1 --2- 172.21.15.78:0/1918710574 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa67c1529d0 0x7fa67c072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.303+0000 7fa680c00640 1 -- 172.21.15.78:0/1918710574 >> 172.21.15.78:0/1918710574 conn(0x7fa67c0c9380 msgr2=0x7fa67c0c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:03.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.303+0000 7fa680c00640 1 -- 172.21.15.78:0/1918710574 shutdown_connections 2024-05-21T14:46:03.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.303+0000 7fa680c00640 1 -- 172.21.15.78:0/1918710574 wait complete. 2024-05-21T14:46:03.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa680c00640 1 Processor -- start 2024-05-21T14:46:03.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa680c00640 1 -- start start 2024-05-21T14:46:03.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa680c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa67c071fe0 0x7fa67c1f8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:03.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa680c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa67c0c5640 0x7fa67c143270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:03.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa680c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa67c1529d0 0x7fa67c13c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:03.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa680c00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c0c3a20 con 0x7fa67c1529d0 2024-05-21T14:46:03.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa680c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c0c38a0 con 0x7fa67c071fe0 2024-05-21T14:46:03.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa680c00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa67c165ea0 con 0x7fa67c0c5640 2024-05-21T14:46:03.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa67a800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa67c1529d0 0x7fa67c13c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:03.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa67a800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa67c1529d0 0x7fa67c13c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56138/0 (socket says 172.21.15.78:56138) 2024-05-21T14:46:03.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa67a800640 1 -- 172.21.15.78:0/283913043 learned_addr learned my addr 172.21.15.78:0/283913043 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:46:03.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa679e00640 1 --2- 172.21.15.78:0/283913043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa67c071fe0 0x7fa67c1f8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:03.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa679400640 1 --2- 172.21.15.78:0/283913043 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa67c0c5640 0x7fa67c143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:03.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa67a800640 1 -- 172.21.15.78:0/283913043 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa67c0c5640 msgr2=0x7fa67c143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:03.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa67a800640 1 --2- 172.21.15.78:0/283913043 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa67c0c5640 0x7fa67c143270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa67a800640 1 -- 172.21.15.78:0/283913043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa67c071fe0 msgr2=0x7fa67c1f8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:03.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa67a800640 1 --2- 172.21.15.78:0/283913043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa67c071fe0 0x7fa67c1f8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa67a800640 1 -- 172.21.15.78:0/283913043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c1f9140 con 0x7fa67c1529d0 2024-05-21T14:46:03.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.307+0000 7fa679400640 1 --2- 172.21.15.78:0/283913043 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa67c0c5640 0x7fa67c143270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:46:03.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.311+0000 7fa67a800640 1 --2- 172.21.15.78:0/283913043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa67c1529d0 0x7fa67c13c440 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c730 tx=0x7fa67400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:03.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.311+0000 7fa672000640 1 -- 172.21.15.78:0/283913043 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa674003b80 con 0x7fa67c1529d0 2024-05-21T14:46:03.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.311+0000 7fa672000640 1 -- 172.21.15.78:0/283913043 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa674003d20 con 0x7fa67c1529d0 2024-05-21T14:46:03.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.311+0000 7fa680c00640 1 -- 172.21.15.78:0/283913043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa67c1f5720 con 0x7fa67c1529d0 2024-05-21T14:46:03.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.311+0000 7fa672000640 1 -- 172.21.15.78:0/283913043 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa674005310 con 0x7fa67c1529d0 2024-05-21T14:46:03.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.311+0000 7fa680c00640 1 -- 172.21.15.78:0/283913043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa67c1f5ce0 con 0x7fa67c1529d0 2024-05-21T14:46:03.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.311+0000 7fa680c00640 1 -- 172.21.15.78:0/283913043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa67c04f730 con 0x7fa67c1529d0 2024-05-21T14:46:03.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.311+0000 7fa672000640 1 -- 172.21.15.78:0/283913043 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa6740056c0 con 0x7fa67c1529d0 2024-05-21T14:46:03.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.311+0000 7fa672000640 1 --2- 172.21.15.78:0/283913043 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa6580678c0 0x7fa658069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:03.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.311+0000 7fa672000640 1 -- 172.21.15.78:0/283913043 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fa674085d30 con 0x7fa67c1529d0 2024-05-21T14:46:03.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.315+0000 7fa679e00640 1 --2- 172.21.15.78:0/283913043 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa6580678c0 0x7fa658069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:03.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.315+0000 7fa679e00640 1 --2- 172.21.15.78:0/283913043 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa6580678c0 0x7fa658069dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa6640079c0 tx=0x7fa664008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:03.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.319+0000 7fa672000640 1 -- 172.21.15.78:0/283913043 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7fa67c073380 con 0x7fa67c1529d0 2024-05-21T14:46:03.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.475+0000 7fa680c00640 1 -- 172.21.15.78:0/283913043 --> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa67c1484a0 con 0x7fa6580678c0 2024-05-21T14:46:03.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.495+0000 7fa672000640 1 -- 172.21.15.78:0/283913043 <== mgr.4100 v2:172.21.15.84:6832/3203955676 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252430 (secure 0 0 0) 0x7fa67c1484a0 con 0x7fa6580678c0 2024-05-21T14:46:03.504 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:46:03.506 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-05-21T14:46:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.495+0000 7fa680c00640 1 -- 172.21.15.78:0/283913043 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa6580678c0 msgr2=0x7fa658069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.495+0000 7fa680c00640 1 --2- 172.21.15.78:0/283913043 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa6580678c0 0x7fa658069dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa6640079c0 tx=0x7fa664008040 comp rx=0 tx=0).stop 2024-05-21T14:46:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.495+0000 7fa680c00640 1 -- 172.21.15.78:0/283913043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa67c1529d0 msgr2=0x7fa67c13c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.495+0000 7fa680c00640 1 --2- 172.21.15.78:0/283913043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa67c1529d0 0x7fa67c13c440 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c730 tx=0x7fa67400cbf0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.495+0000 7fa680c00640 1 -- 172.21.15.78:0/283913043 shutdown_connections 2024-05-21T14:46:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.495+0000 7fa680c00640 1 --2- 172.21.15.78:0/283913043 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7fa6580678c0 0x7fa658069dd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.495+0000 7fa680c00640 1 --2- 172.21.15.78:0/283913043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa67c1529d0 0x7fa67c13c440 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.495+0000 7fa680c00640 1 --2- 172.21.15.78:0/283913043 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa67c0c5640 0x7fa67c143270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.495+0000 7fa680c00640 1 --2- 172.21.15.78:0/283913043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa67c071fe0 0x7fa67c1f8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.495+0000 7fa680c00640 1 -- 172.21.15.78:0/283913043 >> 172.21.15.78:0/283913043 conn(0x7fa67c0c9380 msgr2=0x7fa67c06b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.495+0000 7fa680c00640 1 -- 172.21.15.78:0/283913043 shutdown_connections 2024-05-21T14:46:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.495+0000 7fa680c00640 1 -- 172.21.15.78:0/283913043 wait complete. 2024-05-21T14:46:03.525 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2024-05-21T14:46:02.562349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":632108,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":405,"num_write_kb":2532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":933,"ondisk_log_size":933,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218600,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756120,"statfs":{"total":773094113280,"available":772870266880,"internally_reserved":0,"allocated":2531328,"data_stored":2009400,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004667"},"pg_stats":[{"pgid":"3.3f","version":"25'8","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:47.655496+0000","last_change":"2024-05-21T14:45:47.655522+0000","last_active":"2024-05-21T14:45:47.655496+0000","last_peered":"2024-05-21T14:45:47.655496+0000","last_clean":"2024-05-21T14:45:47.655496+0000","last_became_active":"2024-05-21T14:43:19.606365+0000","last_became_peered":"2024-05-21T14:43:19.606365+0000","last_unstale":"2024-05-21T14:45:47.655496+0000","last_undegraded":"2024-05-21T14:45:47.655496+0000","last_fullsized":"2024-05-21T14:45:47.655496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2024-05-21T14:45:47.655380+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2024-05-21T14:45:47.655380+0000","last_clean_scrub_stamp":"2024-05-21T14:45:47.655380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:11:14.156933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'4","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:56.103073+0000","last_change":"2024-05-21T14:45:56.103208+0000","last_active":"2024-05-21T14:45:56.103073+0000","last_peered":"2024-05-21T14:45:56.103073+0000","last_clean":"2024-05-21T14:45:56.103073+0000","last_became_active":"2024-05-21T14:43:19.632218+0000","last_became_peered":"2024-05-21T14:43:19.632218+0000","last_unstale":"2024-05-21T14:45:56.103073+0000","last_undegraded":"2024-05-21T14:45:56.103073+0000","last_fullsized":"2024-05-21T14:45:56.103073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-21T14:45:56.102709+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-21T14:45:56.102709+0000","last_clean_scrub_stamp":"2024-05-21T14:45:56.102709+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:01:07.704273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'7","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:51.059253+0000","last_change":"2024-05-21T14:45:51.059334+0000","last_active":"2024-05-21T14:45:51.059253+0000","last_peered":"2024-05-21T14:45:51.059253+0000","last_clean":"2024-05-21T14:45:51.059253+0000","last_became_active":"2024-05-21T14:43:19.619012+0000","last_became_peered":"2024-05-21T14:43:19.619012+0000","last_unstale":"2024-05-21T14:45:51.059253+0000","last_undegraded":"2024-05-21T14:45:51.059253+0000","last_fullsized":"2024-05-21T14:45:51.059253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2024-05-21T14:45:51.059022+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2024-05-21T14:45:51.059022+0000","last_clean_scrub_stamp":"2024-05-21T14:45:51.059022+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:06:53.489688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'8","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:45.695979+0000","last_change":"2024-05-21T14:45:45.696012+0000","last_active":"2024-05-21T14:45:45.695979+0000","last_peered":"2024-05-21T14:45:45.695979+0000","last_clean":"2024-05-21T14:45:45.695979+0000","last_became_active":"2024-05-21T14:43:19.601797+0000","last_became_peered":"2024-05-21T14:43:19.601797+0000","last_unstale":"2024-05-21T14:45:45.695979+0000","last_undegraded":"2024-05-21T14:45:45.695979+0000","last_fullsized":"2024-05-21T14:45:45.695979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2024-05-21T14:45:45.695889+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2024-05-21T14:45:45.695889+0000","last_clean_scrub_stamp":"2024-05-21T14:45:45.695889+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:14:14.343992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'4","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:53.589816+0000","last_change":"2024-05-21T14:45:53.589848+0000","last_active":"2024-05-21T14:45:53.589816+0000","last_peered":"2024-05-21T14:45:53.589816+0000","last_clean":"2024-05-21T14:45:53.589816+0000","last_became_active":"2024-05-21T14:43:19.623125+0000","last_became_peered":"2024-05-21T14:43:19.623125+0000","last_unstale":"2024-05-21T14:45:53.589816+0000","last_undegraded":"2024-05-21T14:45:53.589816+0000","last_fullsized":"2024-05-21T14:45:53.589816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-21T14:45:53.589721+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-21T14:45:53.589721+0000","last_clean_scrub_stamp":"2024-05-21T14:45:53.589721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:59:00.575755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'6","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:41.757670+0000","last_change":"2024-05-21T14:45:41.757670+0000","last_active":"2024-05-21T14:45:41.757670+0000","last_peered":"2024-05-21T14:45:41.757670+0000","last_clean":"2024-05-21T14:45:41.757670+0000","last_became_active":"2024-05-21T14:43:19.590858+0000","last_became_peered":"2024-05-21T14:43:19.590858+0000","last_unstale":"2024-05-21T14:45:41.757670+0000","last_undegraded":"2024-05-21T14:45:41.757670+0000","last_fullsized":"2024-05-21T14:45:41.757670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-05-21T14:45:41.757531+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-05-21T14:45:41.757531+0000","last_clean_scrub_stamp":"2024-05-21T14:45:41.757531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:00:03.264633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'5","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:52.628686+0000","last_change":"2024-05-21T14:45:52.628714+0000","last_active":"2024-05-21T14:45:52.628686+0000","last_peered":"2024-05-21T14:45:52.628686+0000","last_clean":"2024-05-21T14:45:52.628686+0000","last_became_active":"2024-05-21T14:43:19.614451+0000","last_became_peered":"2024-05-21T14:43:19.614451+0000","last_unstale":"2024-05-21T14:45:52.628686+0000","last_undegraded":"2024-05-21T14:45:52.628686+0000","last_fullsized":"2024-05-21T14:45:52.628686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-21T14:45:52.628583+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-21T14:45:52.628583+0000","last_clean_scrub_stamp":"2024-05-21T14:45:52.628583+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:59:13.623564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'9","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:46.051381+0000","last_change":"2024-05-21T14:45:46.051381+0000","last_active":"2024-05-21T14:45:46.051381+0000","last_peered":"2024-05-21T14:45:46.051381+0000","last_clean":"2024-05-21T14:45:46.051381+0000","last_became_active":"2024-05-21T14:43:19.603164+0000","last_became_peered":"2024-05-21T14:43:19.603164+0000","last_unstale":"2024-05-21T14:45:46.051381+0000","last_undegraded":"2024-05-21T14:45:46.051381+0000","last_fullsized":"2024-05-21T14:45:46.051381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2024-05-21T14:45:46.051099+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2024-05-21T14:45:46.051099+0000","last_clean_scrub_stamp":"2024-05-21T14:45:46.051099+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:51:40.727199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'11","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:44.252070+0000","last_change":"2024-05-21T14:45:44.252070+0000","last_active":"2024-05-21T14:45:44.252070+0000","last_peered":"2024-05-21T14:45:44.252070+0000","last_clean":"2024-05-21T14:45:44.252070+0000","last_became_active":"2024-05-21T14:43:19.613429+0000","last_became_peered":"2024-05-21T14:43:19.613429+0000","last_unstale":"2024-05-21T14:45:44.252070+0000","last_undegraded":"2024-05-21T14:45:44.252070+0000","last_fullsized":"2024-05-21T14:45:44.252070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2024-05-21T14:45:44.251971+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2024-05-21T14:45:44.251971+0000","last_clean_scrub_stamp":"2024-05-21T14:45:44.251971+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:42:02.445030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'16","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:48.639781+0000","last_change":"2024-05-21T14:45:48.639813+0000","last_active":"2024-05-21T14:45:48.639781+0000","last_peered":"2024-05-21T14:45:48.639781+0000","last_clean":"2024-05-21T14:45:48.639781+0000","last_became_active":"2024-05-21T14:43:19.607105+0000","last_became_peered":"2024-05-21T14:43:19.607105+0000","last_unstale":"2024-05-21T14:45:48.639781+0000","last_undegraded":"2024-05-21T14:45:48.639781+0000","last_fullsized":"2024-05-21T14:45:48.639781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'16","last_scrub_stamp":"2024-05-21T14:45:48.639682+0000","last_deep_scrub":"25'16","last_deep_scrub_stamp":"2024-05-21T14:45:48.639682+0000","last_clean_scrub_stamp":"2024-05-21T14:45:48.639682+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:45:47.474265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'6","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:46.677895+0000","last_change":"2024-05-21T14:45:46.677946+0000","last_active":"2024-05-21T14:45:46.677895+0000","last_peered":"2024-05-21T14:45:46.677895+0000","last_clean":"2024-05-21T14:45:46.677895+0000","last_became_active":"2024-05-21T14:43:19.606029+0000","last_became_peered":"2024-05-21T14:43:19.606029+0000","last_unstale":"2024-05-21T14:45:46.677895+0000","last_undegraded":"2024-05-21T14:45:46.677895+0000","last_fullsized":"2024-05-21T14:45:46.677895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-05-21T14:45:46.677785+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-05-21T14:45:46.677785+0000","last_clean_scrub_stamp":"2024-05-21T14:45:46.677785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:15:34.799269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'7","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:51.664245+0000","last_change":"2024-05-21T14:45:51.664292+0000","last_active":"2024-05-21T14:45:51.664245+0000","last_peered":"2024-05-21T14:45:51.664245+0000","last_clean":"2024-05-21T14:45:51.664245+0000","last_became_active":"2024-05-21T14:43:19.609616+0000","last_became_peered":"2024-05-21T14:43:19.609616+0000","last_unstale":"2024-05-21T14:45:51.664245+0000","last_undegraded":"2024-05-21T14:45:51.664245+0000","last_fullsized":"2024-05-21T14:45:51.664245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2024-05-21T14:45:51.664124+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2024-05-21T14:45:51.664124+0000","last_clean_scrub_stamp":"2024-05-21T14:45:51.664124+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:18:55.954910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"25'10","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:45.295102+0000","last_change":"2024-05-21T14:45:45.295102+0000","last_active":"2024-05-21T14:45:45.295102+0000","last_peered":"2024-05-21T14:45:45.295102+0000","last_clean":"2024-05-21T14:45:45.295102+0000","last_became_active":"2024-05-21T14:43:19.596859+0000","last_became_peered":"2024-05-21T14:43:19.596859+0000","last_unstale":"2024-05-21T14:45:45.295102+0000","last_undegraded":"2024-05-21T14:45:45.295102+0000","last_fullsized":"2024-05-21T14:45:45.295102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'10","last_scrub_stamp":"2024-05-21T14:45:45.294840+0000","last_deep_scrub":"25'10","last_deep_scrub_stamp":"2024-05-21T14:45:45.294840+0000","last_clean_scrub_stamp":"2024-05-21T14:45:45.294840+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:32:00.722670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'10","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:49.349264+0000","last_change":"2024-05-21T14:45:49.349416+0000","last_active":"2024-05-21T14:45:49.349264+0000","last_peered":"2024-05-21T14:45:49.349264+0000","last_clean":"2024-05-21T14:45:49.349264+0000","last_became_active":"2024-05-21T14:43:19.626213+0000","last_became_peered":"2024-05-21T14:43:19.626213+0000","last_unstale":"2024-05-21T14:45:49.349264+0000","last_undegraded":"2024-05-21T14:45:49.349264+0000","last_fullsized":"2024-05-21T14:45:49.349264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'10","last_scrub_stamp":"2024-05-21T14:45:49.349009+0000","last_deep_scrub":"25'10","last_deep_scrub_stamp":"2024-05-21T14:45:49.349009+0000","last_clean_scrub_stamp":"2024-05-21T14:45:49.349009+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:31:43.438342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'7","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:48.024797+0000","last_change":"2024-05-21T14:45:48.024865+0000","last_active":"2024-05-21T14:45:48.024797+0000","last_peered":"2024-05-21T14:45:48.024797+0000","last_clean":"2024-05-21T14:45:48.024797+0000","last_became_active":"2024-05-21T14:43:19.612581+0000","last_became_peered":"2024-05-21T14:43:19.612581+0000","last_unstale":"2024-05-21T14:45:48.024797+0000","last_undegraded":"2024-05-21T14:45:48.024797+0000","last_fullsized":"2024-05-21T14:45:48.024797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2024-05-21T14:45:48.024577+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2024-05-21T14:45:48.024577+0000","last_clean_scrub_stamp":"2024-05-21T14:45:48.024577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:06:36.878553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'9","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:53.744818+0000","last_change":"2024-05-21T14:45:53.744848+0000","last_active":"2024-05-21T14:45:53.744818+0000","last_peered":"2024-05-21T14:45:53.744818+0000","last_clean":"2024-05-21T14:45:53.744818+0000","last_became_active":"2024-05-21T14:43:19.607967+0000","last_became_peered":"2024-05-21T14:43:19.607967+0000","last_unstale":"2024-05-21T14:45:53.744818+0000","last_undegraded":"2024-05-21T14:45:53.744818+0000","last_fullsized":"2024-05-21T14:45:53.744818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2024-05-21T14:45:53.744718+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2024-05-21T14:45:53.744718+0000","last_clean_scrub_stamp":"2024-05-21T14:45:53.744718+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:48:54.948103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'8","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:55.733016+0000","last_change":"2024-05-21T14:45:55.733053+0000","last_active":"2024-05-21T14:45:55.733016+0000","last_peered":"2024-05-21T14:45:55.733016+0000","last_clean":"2024-05-21T14:45:55.733016+0000","last_became_active":"2024-05-21T14:43:19.611280+0000","last_became_peered":"2024-05-21T14:43:19.611280+0000","last_unstale":"2024-05-21T14:45:55.733016+0000","last_undegraded":"2024-05-21T14:45:55.733016+0000","last_fullsized":"2024-05-21T14:45:55.733016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2024-05-21T14:45:55.732919+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2024-05-21T14:45:55.732919+0000","last_clean_scrub_stamp":"2024-05-21T14:45:55.732919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:53:21.269952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'10","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:46.235909+0000","last_change":"2024-05-21T14:45:46.235979+0000","last_active":"2024-05-21T14:45:46.235909+0000","last_peered":"2024-05-21T14:45:46.235909+0000","last_clean":"2024-05-21T14:45:46.235909+0000","last_became_active":"2024-05-21T14:43:19.606719+0000","last_became_peered":"2024-05-21T14:43:19.606719+0000","last_unstale":"2024-05-21T14:45:46.235909+0000","last_undegraded":"2024-05-21T14:45:46.235909+0000","last_fullsized":"2024-05-21T14:45:46.235909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'10","last_scrub_stamp":"2024-05-21T14:45:46.235712+0000","last_deep_scrub":"25'10","last_deep_scrub_stamp":"2024-05-21T14:45:46.235712+0000","last_clean_scrub_stamp":"2024-05-21T14:45:46.235712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:33:57.446357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'7","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:59.715919+0000","last_change":"2024-05-21T14:45:59.715948+0000","last_active":"2024-05-21T14:45:59.715919+0000","last_peered":"2024-05-21T14:45:59.715919+0000","last_clean":"2024-05-21T14:45:59.715919+0000","last_became_active":"2024-05-21T14:43:19.617408+0000","last_became_peered":"2024-05-21T14:43:19.617408+0000","last_unstale":"2024-05-21T14:45:59.715919+0000","last_undegraded":"2024-05-21T14:45:59.715919+0000","last_fullsized":"2024-05-21T14:45:59.715919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2024-05-21T14:45:59.715811+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2024-05-21T14:45:59.715811+0000","last_clean_scrub_stamp":"2024-05-21T14:45:59.715811+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:33:45.064917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'8","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:50.705735+0000","last_change":"2024-05-21T14:45:50.705764+0000","last_active":"2024-05-21T14:45:50.705735+0000","last_peered":"2024-05-21T14:45:50.705735+0000","last_clean":"2024-05-21T14:45:50.705735+0000","last_became_active":"2024-05-21T14:43:19.609525+0000","last_became_peered":"2024-05-21T14:43:19.609525+0000","last_unstale":"2024-05-21T14:45:50.705735+0000","last_undegraded":"2024-05-21T14:45:50.705735+0000","last_fullsized":"2024-05-21T14:45:50.705735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2024-05-21T14:45:50.705627+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2024-05-21T14:45:50.705627+0000","last_clean_scrub_stamp":"2024-05-21T14:45:50.705627+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:04:52.113460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'11","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:48.467254+0000","last_change":"2024-05-21T14:45:48.467330+0000","last_active":"2024-05-21T14:45:48.467254+0000","last_peered":"2024-05-21T14:45:48.467254+0000","last_clean":"2024-05-21T14:45:48.467254+0000","last_became_active":"2024-05-21T14:43:19.606839+0000","last_became_peered":"2024-05-21T14:43:19.606839+0000","last_unstale":"2024-05-21T14:45:48.467254+0000","last_undegraded":"2024-05-21T14:45:48.467254+0000","last_fullsized":"2024-05-21T14:45:48.467254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2024-05-21T14:45:48.467058+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2024-05-21T14:45:48.467058+0000","last_clean_scrub_stamp":"2024-05-21T14:45:48.467058+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:04:16.377647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'10","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:43.290027+0000","last_change":"2024-05-21T14:45:43.290055+0000","last_active":"2024-05-21T14:45:43.290027+0000","last_peered":"2024-05-21T14:45:43.290027+0000","last_clean":"2024-05-21T14:45:43.290027+0000","last_became_active":"2024-05-21T14:43:19.600780+0000","last_became_peered":"2024-05-21T14:43:19.600780+0000","last_unstale":"2024-05-21T14:45:43.290027+0000","last_undegraded":"2024-05-21T14:45:43.290027+0000","last_fullsized":"2024-05-21T14:45:43.290027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'10","last_scrub_stamp":"2024-05-21T14:45:43.289951+0000","last_deep_scrub":"25'10","last_deep_scrub_stamp":"2024-05-21T14:45:43.289951+0000","last_clean_scrub_stamp":"2024-05-21T14:45:43.289951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:32:06.445639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'8","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:53.041054+0000","last_change":"2024-05-21T14:45:53.041125+0000","last_active":"2024-05-21T14:45:53.041054+0000","last_peered":"2024-05-21T14:45:53.041054+0000","last_clean":"2024-05-21T14:45:53.041054+0000","last_became_active":"2024-05-21T14:43:19.614489+0000","last_became_peered":"2024-05-21T14:43:19.614489+0000","last_unstale":"2024-05-21T14:45:53.041054+0000","last_undegraded":"2024-05-21T14:45:53.041054+0000","last_fullsized":"2024-05-21T14:45:53.041054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2024-05-21T14:45:53.040839+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2024-05-21T14:45:53.040839+0000","last_clean_scrub_stamp":"2024-05-21T14:45:53.040839+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:13:27.623200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'6","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:46:00.687413+0000","last_change":"2024-05-21T14:46:00.687442+0000","last_active":"2024-05-21T14:46:00.687413+0000","last_peered":"2024-05-21T14:46:00.687413+0000","last_clean":"2024-05-21T14:46:00.687413+0000","last_became_active":"2024-05-21T14:43:19.624304+0000","last_became_peered":"2024-05-21T14:43:19.624304+0000","last_unstale":"2024-05-21T14:46:00.687413+0000","last_undegraded":"2024-05-21T14:46:00.687413+0000","last_fullsized":"2024-05-21T14:46:00.687413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-05-21T14:46:00.687328+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-05-21T14:46:00.687328+0000","last_clean_scrub_stamp":"2024-05-21T14:46:00.687328+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:49:39.082110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'2","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:54.045246+0000","last_change":"2024-05-21T14:45:54.045337+0000","last_active":"2024-05-21T14:45:54.045246+0000","last_peered":"2024-05-21T14:45:54.045246+0000","last_clean":"2024-05-21T14:45:54.045246+0000","last_became_active":"2024-05-21T14:43:19.619072+0000","last_became_peered":"2024-05-21T14:43:19.619072+0000","last_unstale":"2024-05-21T14:45:54.045246+0000","last_undegraded":"2024-05-21T14:45:54.045246+0000","last_fullsized":"2024-05-21T14:45:54.045246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-21T14:45:54.045036+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-21T14:45:54.045036+0000","last_clean_scrub_stamp":"2024-05-21T14:45:54.045036+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:43:28.574645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'15","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:44.741451+0000","last_change":"2024-05-21T14:45:44.741476+0000","last_active":"2024-05-21T14:45:44.741451+0000","last_peered":"2024-05-21T14:45:44.741451+0000","last_clean":"2024-05-21T14:45:44.741451+0000","last_became_active":"2024-05-21T14:43:19.602577+0000","last_became_peered":"2024-05-21T14:43:19.602577+0000","last_unstale":"2024-05-21T14:45:44.741451+0000","last_undegraded":"2024-05-21T14:45:44.741451+0000","last_fullsized":"2024-05-21T14:45:44.741451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'15","last_scrub_stamp":"2024-05-21T14:45:44.741377+0000","last_deep_scrub":"25'15","last_deep_scrub_stamp":"2024-05-21T14:45:44.741377+0000","last_clean_scrub_stamp":"2024-05-21T14:45:44.741377+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:43:35.468975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'6","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:51.351948+0000","last_change":"2024-05-21T14:45:51.352027+0000","last_active":"2024-05-21T14:45:51.351948+0000","last_peered":"2024-05-21T14:45:51.351948+0000","last_clean":"2024-05-21T14:45:51.351948+0000","last_became_active":"2024-05-21T14:43:19.631351+0000","last_became_peered":"2024-05-21T14:43:19.631351+0000","last_unstale":"2024-05-21T14:45:51.351948+0000","last_undegraded":"2024-05-21T14:45:51.351948+0000","last_fullsized":"2024-05-21T14:45:51.351948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-05-21T14:45:51.351746+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-05-21T14:45:51.351746+0000","last_clean_scrub_stamp":"2024-05-21T14:45:51.351746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:18:09.843675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'4","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:50.341588+0000","last_change":"2024-05-21T14:45:50.341657+0000","last_active":"2024-05-21T14:45:50.341588+0000","last_peered":"2024-05-21T14:45:50.341588+0000","last_clean":"2024-05-21T14:45:50.341588+0000","last_became_active":"2024-05-21T14:43:19.631522+0000","last_became_peered":"2024-05-21T14:43:19.631522+0000","last_unstale":"2024-05-21T14:45:50.341588+0000","last_undegraded":"2024-05-21T14:45:50.341588+0000","last_fullsized":"2024-05-21T14:45:50.341588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-21T14:45:50.341344+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-21T14:45:50.341344+0000","last_clean_scrub_stamp":"2024-05-21T14:45:50.341344+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:13:08.387156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'7","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:52.080936+0000","last_change":"2024-05-21T14:45:52.081015+0000","last_active":"2024-05-21T14:45:52.080936+0000","last_peered":"2024-05-21T14:45:52.080936+0000","last_clean":"2024-05-21T14:45:52.080936+0000","last_became_active":"2024-05-21T14:43:19.612428+0000","last_became_peered":"2024-05-21T14:43:19.612428+0000","last_unstale":"2024-05-21T14:45:52.080936+0000","last_undegraded":"2024-05-21T14:45:52.080936+0000","last_fullsized":"2024-05-21T14:45:52.080936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2024-05-21T14:45:52.080709+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2024-05-21T14:45:52.080709+0000","last_clean_scrub_stamp":"2024-05-21T14:45:52.080709+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:41:38.160783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'8","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:58.693080+0000","last_change":"2024-05-21T14:45:58.693111+0000","last_active":"2024-05-21T14:45:58.693080+0000","last_peered":"2024-05-21T14:45:58.693080+0000","last_clean":"2024-05-21T14:45:58.693080+0000","last_became_active":"2024-05-21T14:43:19.617903+0000","last_became_peered":"2024-05-21T14:43:19.617903+0000","last_unstale":"2024-05-21T14:45:58.693080+0000","last_undegraded":"2024-05-21T14:45:58.693080+0000","last_fullsized":"2024-05-21T14:45:58.693080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2024-05-21T14:45:58.692946+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2024-05-21T14:45:58.692946+0000","last_clean_scrub_stamp":"2024-05-21T14:45:58.692946+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:17:50.345411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'12","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:47.241023+0000","last_change":"2024-05-21T14:45:47.241090+0000","last_active":"2024-05-21T14:45:47.241023+0000","last_peered":"2024-05-21T14:45:47.241023+0000","last_clean":"2024-05-21T14:45:47.241023+0000","last_became_active":"2024-05-21T14:43:19.613035+0000","last_became_peered":"2024-05-21T14:43:19.613035+0000","last_unstale":"2024-05-21T14:45:47.241023+0000","last_undegraded":"2024-05-21T14:45:47.241023+0000","last_fullsized":"2024-05-21T14:45:47.241023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'12","last_scrub_stamp":"2024-05-21T14:45:47.240817+0000","last_deep_scrub":"25'12","last_deep_scrub_stamp":"2024-05-21T14:45:47.240817+0000","last_clean_scrub_stamp":"2024-05-21T14:45:47.240817+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:16:41.944047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'9","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:46.710872+0000","last_change":"2024-05-21T14:45:46.710901+0000","last_active":"2024-05-21T14:45:46.710872+0000","last_peered":"2024-05-21T14:45:46.710872+0000","last_clean":"2024-05-21T14:45:46.710872+0000","last_became_active":"2024-05-21T14:43:19.626080+0000","last_became_peered":"2024-05-21T14:43:19.626080+0000","last_unstale":"2024-05-21T14:45:46.710872+0000","last_undegraded":"2024-05-21T14:45:46.710872+0000","last_fullsized":"2024-05-21T14:45:46.710872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2024-05-21T14:45:46.710755+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2024-05-21T14:45:46.710755+0000","last_clean_scrub_stamp":"2024-05-21T14:45:46.710755+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:05:07.810222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'7","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:46.204754+0000","last_change":"2024-05-21T14:45:46.204754+0000","last_active":"2024-05-21T14:45:46.204754+0000","last_peered":"2024-05-21T14:45:46.204754+0000","last_clean":"2024-05-21T14:45:46.204754+0000","last_became_active":"2024-05-21T14:43:19.620449+0000","last_became_peered":"2024-05-21T14:43:19.620449+0000","last_unstale":"2024-05-21T14:45:46.204754+0000","last_undegraded":"2024-05-21T14:45:46.204754+0000","last_fullsized":"2024-05-21T14:45:46.204754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2024-05-21T14:45:46.204625+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2024-05-21T14:45:46.204625+0000","last_clean_scrub_stamp":"2024-05-21T14:45:46.204625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:02:16.500176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'7","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:42.062764+0000","last_change":"2024-05-21T14:45:42.062764+0000","last_active":"2024-05-21T14:45:42.062764+0000","last_peered":"2024-05-21T14:45:42.062764+0000","last_clean":"2024-05-21T14:45:42.062764+0000","last_became_active":"2024-05-21T14:43:18.602036+0000","last_became_peered":"2024-05-21T14:43:18.602036+0000","last_unstale":"2024-05-21T14:45:42.062764+0000","last_undegraded":"2024-05-21T14:45:42.062764+0000","last_fullsized":"2024-05-21T14:45:42.062764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2024-05-21T14:45:42.062464+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2024-05-21T14:45:42.062464+0000","last_clean_scrub_stamp":"2024-05-21T14:45:42.062464+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:09:25.274670+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'8","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:46.464078+0000","last_change":"2024-05-21T14:45:46.464078+0000","last_active":"2024-05-21T14:45:46.464078+0000","last_peered":"2024-05-21T14:45:46.464078+0000","last_clean":"2024-05-21T14:45:46.464078+0000","last_became_active":"2024-05-21T14:43:19.598972+0000","last_became_peered":"2024-05-21T14:43:19.598972+0000","last_unstale":"2024-05-21T14:45:46.464078+0000","last_undegraded":"2024-05-21T14:45:46.464078+0000","last_fullsized":"2024-05-21T14:45:46.464078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2024-05-21T14:45:46.463780+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2024-05-21T14:45:46.463780+0000","last_clean_scrub_stamp":"2024-05-21T14:45:46.463780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:17:47.326491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"25'10","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:52.744745+0000","last_change":"2024-05-21T14:45:52.744795+0000","last_active":"2024-05-21T14:45:52.744745+0000","last_peered":"2024-05-21T14:45:52.744745+0000","last_clean":"2024-05-21T14:45:52.744745+0000","last_became_active":"2024-05-21T14:43:18.615568+0000","last_became_peered":"2024-05-21T14:43:18.615568+0000","last_unstale":"2024-05-21T14:45:52.744745+0000","last_undegraded":"2024-05-21T14:45:52.744745+0000","last_fullsized":"2024-05-21T14:45:52.744745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'10","last_scrub_stamp":"2024-05-21T14:45:52.744652+0000","last_deep_scrub":"25'10","last_deep_scrub_stamp":"2024-05-21T14:45:52.744652+0000","last_clean_scrub_stamp":"2024-05-21T14:45:52.744652+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:25:44.168710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'5","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:42.248765+0000","last_change":"2024-05-21T14:45:42.248765+0000","last_active":"2024-05-21T14:45:42.248765+0000","last_peered":"2024-05-21T14:45:42.248765+0000","last_clean":"2024-05-21T14:45:42.248765+0000","last_became_active":"2024-05-21T14:43:18.613838+0000","last_became_peered":"2024-05-21T14:43:18.613838+0000","last_unstale":"2024-05-21T14:45:42.248765+0000","last_undegraded":"2024-05-21T14:45:42.248765+0000","last_fullsized":"2024-05-21T14:45:42.248765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-21T14:45:42.248365+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-21T14:45:42.248365+0000","last_clean_scrub_stamp":"2024-05-21T14:45:42.248365+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:29:32.652481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'8","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:57.123138+0000","last_change":"2024-05-21T14:45:57.123266+0000","last_active":"2024-05-21T14:45:57.123138+0000","last_peered":"2024-05-21T14:45:57.123138+0000","last_clean":"2024-05-21T14:45:57.123138+0000","last_became_active":"2024-05-21T14:43:19.632476+0000","last_became_peered":"2024-05-21T14:43:19.632476+0000","last_unstale":"2024-05-21T14:45:57.123138+0000","last_undegraded":"2024-05-21T14:45:57.123138+0000","last_fullsized":"2024-05-21T14:45:57.123138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2024-05-21T14:45:57.122814+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2024-05-21T14:45:57.122814+0000","last_clean_scrub_stamp":"2024-05-21T14:45:57.122814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:57:29.967103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"25'4","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:45.747904+0000","last_change":"2024-05-21T14:45:45.747904+0000","last_active":"2024-05-21T14:45:45.747904+0000","last_peered":"2024-05-21T14:45:45.747904+0000","last_clean":"2024-05-21T14:45:45.747904+0000","last_became_active":"2024-05-21T14:43:18.585099+0000","last_became_peered":"2024-05-21T14:43:18.585099+0000","last_unstale":"2024-05-21T14:45:45.747904+0000","last_undegraded":"2024-05-21T14:45:45.747904+0000","last_fullsized":"2024-05-21T14:45:45.747904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-21T14:45:45.747778+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-21T14:45:45.747778+0000","last_clean_scrub_stamp":"2024-05-21T14:45:45.747778+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:49:04.632412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'10","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:52.521384+0000","last_change":"2024-05-21T14:45:52.521491+0000","last_active":"2024-05-21T14:45:52.521384+0000","last_peered":"2024-05-21T14:45:52.521384+0000","last_clean":"2024-05-21T14:45:52.521384+0000","last_became_active":"2024-05-21T14:43:19.614064+0000","last_became_peered":"2024-05-21T14:43:19.614064+0000","last_unstale":"2024-05-21T14:45:52.521384+0000","last_undegraded":"2024-05-21T14:45:52.521384+0000","last_fullsized":"2024-05-21T14:45:52.521384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'10","last_scrub_stamp":"2024-05-21T14:45:52.521178+0000","last_deep_scrub":"25'10","last_deep_scrub_stamp":"2024-05-21T14:45:52.521178+0000","last_clean_scrub_stamp":"2024-05-21T14:45:52.521178+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:28:22.798769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'8","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:41.244128+0000","last_change":"2024-05-21T14:45:41.244128+0000","last_active":"2024-05-21T14:45:41.244128+0000","last_peered":"2024-05-21T14:45:41.244128+0000","last_clean":"2024-05-21T14:45:41.244128+0000","last_became_active":"2024-05-21T14:43:18.602429+0000","last_became_peered":"2024-05-21T14:43:18.602429+0000","last_unstale":"2024-05-21T14:45:41.244128+0000","last_undegraded":"2024-05-21T14:45:41.244128+0000","last_fullsized":"2024-05-21T14:45:41.244128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2024-05-21T14:45:41.244027+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2024-05-21T14:45:41.244027+0000","last_clean_scrub_stamp":"2024-05-21T14:45:41.244027+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:25:24.855107+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'10","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:43.740236+0000","last_change":"2024-05-21T14:45:43.740236+0000","last_active":"2024-05-21T14:45:43.740236+0000","last_peered":"2024-05-21T14:45:43.740236+0000","last_clean":"2024-05-21T14:45:43.740236+0000","last_became_active":"2024-05-21T14:43:19.602294+0000","last_became_peered":"2024-05-21T14:43:19.602294+0000","last_unstale":"2024-05-21T14:45:43.740236+0000","last_undegraded":"2024-05-21T14:45:43.740236+0000","last_fullsized":"2024-05-21T14:45:43.740236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'10","last_scrub_stamp":"2024-05-21T14:45:43.740096+0000","last_deep_scrub":"25'10","last_deep_scrub_stamp":"2024-05-21T14:45:43.740096+0000","last_clean_scrub_stamp":"2024-05-21T14:45:43.740096+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:40:07.527823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"25'6","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:40.699492+0000","last_change":"2024-05-21T14:45:40.699492+0000","last_active":"2024-05-21T14:45:40.699492+0000","last_peered":"2024-05-21T14:45:40.699492+0000","last_clean":"2024-05-21T14:45:40.699492+0000","last_became_active":"2024-05-21T14:43:18.604262+0000","last_became_peered":"2024-05-21T14:43:18.604262+0000","last_unstale":"2024-05-21T14:45:40.699492+0000","last_undegraded":"2024-05-21T14:45:40.699492+0000","last_fullsized":"2024-05-21T14:45:40.699492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-05-21T14:45:40.699389+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-05-21T14:45:40.699389+0000","last_clean_scrub_stamp":"2024-05-21T14:45:40.699389+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:15:46.057047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'9","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:50.071097+0000","last_change":"2024-05-21T14:45:50.071188+0000","last_active":"2024-05-21T14:45:50.071097+0000","last_peered":"2024-05-21T14:45:50.071097+0000","last_clean":"2024-05-21T14:45:50.071097+0000","last_became_active":"2024-05-21T14:43:19.613093+0000","last_became_peered":"2024-05-21T14:43:19.613093+0000","last_unstale":"2024-05-21T14:45:50.071097+0000","last_undegraded":"2024-05-21T14:45:50.071097+0000","last_fullsized":"2024-05-21T14:45:50.071097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2024-05-21T14:45:50.070874+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2024-05-21T14:45:50.070874+0000","last_clean_scrub_stamp":"2024-05-21T14:45:50.070874+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:11:18.496726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'11","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:43.243478+0000","last_change":"2024-05-21T14:45:43.243478+0000","last_active":"2024-05-21T14:45:43.243478+0000","last_peered":"2024-05-21T14:45:43.243478+0000","last_clean":"2024-05-21T14:45:43.243478+0000","last_became_active":"2024-05-21T14:43:18.601500+0000","last_became_peered":"2024-05-21T14:43:18.601500+0000","last_unstale":"2024-05-21T14:45:43.243478+0000","last_undegraded":"2024-05-21T14:45:43.243478+0000","last_fullsized":"2024-05-21T14:45:43.243478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2024-05-21T14:45:43.243200+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2024-05-21T14:45:43.243200+0000","last_clean_scrub_stamp":"2024-05-21T14:45:43.243200+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:42:20.936029+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'11","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:43.708272+0000","last_change":"2024-05-21T14:45:43.708298+0000","last_active":"2024-05-21T14:45:43.708272+0000","last_peered":"2024-05-21T14:45:43.708272+0000","last_clean":"2024-05-21T14:45:43.708272+0000","last_became_active":"2024-05-21T14:43:19.608038+0000","last_became_peered":"2024-05-21T14:43:19.608038+0000","last_unstale":"2024-05-21T14:45:43.708272+0000","last_undegraded":"2024-05-21T14:45:43.708272+0000","last_fullsized":"2024-05-21T14:45:43.708272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2024-05-21T14:45:43.708162+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2024-05-21T14:45:43.708162+0000","last_clean_scrub_stamp":"2024-05-21T14:45:43.708162+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:47:01.837677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'31","reported_seq":59,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:40.755609+0000","last_change":"2024-05-21T14:45:40.755609+0000","last_active":"2024-05-21T14:45:40.755609+0000","last_peered":"2024-05-21T14:45:40.755609+0000","last_clean":"2024-05-21T14:45:40.755609+0000","last_became_active":"2024-05-21T14:43:18.606449+0000","last_became_peered":"2024-05-21T14:43:18.606449+0000","last_unstale":"2024-05-21T14:45:40.755609+0000","last_undegraded":"2024-05-21T14:45:40.755609+0000","last_fullsized":"2024-05-21T14:45:40.755609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'31","last_scrub_stamp":"2024-05-21T14:45:40.755486+0000","last_deep_scrub":"25'31","last_deep_scrub_stamp":"2024-05-21T14:45:40.755486+0000","last_clean_scrub_stamp":"2024-05-21T14:45:40.755486+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:32:03.796754+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34914,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'6","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:54.575204+0000","last_change":"2024-05-21T14:45:54.575234+0000","last_active":"2024-05-21T14:45:54.575204+0000","last_peered":"2024-05-21T14:45:54.575204+0000","last_clean":"2024-05-21T14:45:54.575204+0000","last_became_active":"2024-05-21T14:43:19.633664+0000","last_became_peered":"2024-05-21T14:43:19.633664+0000","last_unstale":"2024-05-21T14:45:54.575204+0000","last_undegraded":"2024-05-21T14:45:54.575204+0000","last_fullsized":"2024-05-21T14:45:54.575204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-05-21T14:45:54.575108+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-05-21T14:45:54.575108+0000","last_clean_scrub_stamp":"2024-05-21T14:45:54.575108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:16:24.317422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'15","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:44.255173+0000","last_change":"2024-05-21T14:45:44.255264+0000","last_active":"2024-05-21T14:45:44.255173+0000","last_peered":"2024-05-21T14:45:44.255173+0000","last_clean":"2024-05-21T14:45:44.255173+0000","last_became_active":"2024-05-21T14:43:18.614214+0000","last_became_peered":"2024-05-21T14:43:18.614214+0000","last_unstale":"2024-05-21T14:45:44.255173+0000","last_undegraded":"2024-05-21T14:45:44.255173+0000","last_fullsized":"2024-05-21T14:45:44.255173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'15","last_scrub_stamp":"2024-05-21T14:45:44.254964+0000","last_deep_scrub":"25'15","last_deep_scrub_stamp":"2024-05-21T14:45:44.254964+0000","last_clean_scrub_stamp":"2024-05-21T14:45:44.254964+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:28:33.177130+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'9","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:47.353150+0000","last_change":"2024-05-21T14:45:47.353290+0000","last_active":"2024-05-21T14:45:47.353150+0000","last_peered":"2024-05-21T14:45:47.353150+0000","last_clean":"2024-05-21T14:45:47.353150+0000","last_became_active":"2024-05-21T14:43:19.624474+0000","last_became_peered":"2024-05-21T14:43:19.624474+0000","last_unstale":"2024-05-21T14:45:47.353150+0000","last_undegraded":"2024-05-21T14:45:47.353150+0000","last_fullsized":"2024-05-21T14:45:47.353150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2024-05-21T14:45:47.352912+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2024-05-21T14:45:47.352912+0000","last_clean_scrub_stamp":"2024-05-21T14:45:47.352912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:14:14.176573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"25'9","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:48.680034+0000","last_change":"2024-05-21T14:45:48.680070+0000","last_active":"2024-05-21T14:45:48.680034+0000","last_peered":"2024-05-21T14:45:48.680034+0000","last_clean":"2024-05-21T14:45:48.680034+0000","last_became_active":"2024-05-21T14:43:18.600415+0000","last_became_peered":"2024-05-21T14:43:18.600415+0000","last_unstale":"2024-05-21T14:45:48.680034+0000","last_undegraded":"2024-05-21T14:45:48.680034+0000","last_fullsized":"2024-05-21T14:45:48.680034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2024-05-21T14:45:48.679949+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2024-05-21T14:45:48.679949+0000","last_clean_scrub_stamp":"2024-05-21T14:45:48.679949+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:21:59.313470+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'15","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:42.729222+0000","last_change":"2024-05-21T14:45:42.729247+0000","last_active":"2024-05-21T14:45:42.729222+0000","last_peered":"2024-05-21T14:45:42.729222+0000","last_clean":"2024-05-21T14:45:42.729222+0000","last_became_active":"2024-05-21T14:43:19.599195+0000","last_became_peered":"2024-05-21T14:43:19.599195+0000","last_unstale":"2024-05-21T14:45:42.729222+0000","last_undegraded":"2024-05-21T14:45:42.729222+0000","last_fullsized":"2024-05-21T14:45:42.729222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'15","last_scrub_stamp":"2024-05-21T14:45:42.729142+0000","last_deep_scrub":"25'15","last_deep_scrub_stamp":"2024-05-21T14:45:42.729142+0000","last_clean_scrub_stamp":"2024-05-21T14:45:42.729142+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:08:14.933853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"25'8","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:39.731020+0000","last_change":"2024-05-21T14:45:39.731020+0000","last_active":"2024-05-21T14:45:39.731020+0000","last_peered":"2024-05-21T14:45:39.731020+0000","last_clean":"2024-05-21T14:45:39.731020+0000","last_became_active":"2024-05-21T14:43:18.602658+0000","last_became_peered":"2024-05-21T14:43:18.602658+0000","last_unstale":"2024-05-21T14:45:39.731020+0000","last_undegraded":"2024-05-21T14:45:39.731020+0000","last_fullsized":"2024-05-21T14:45:39.731020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2024-05-21T14:45:39.730921+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2024-05-21T14:45:39.730921+0000","last_clean_scrub_stamp":"2024-05-21T14:45:39.730921+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:52:02.191492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'6","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:45.222492+0000","last_change":"2024-05-21T14:45:45.222524+0000","last_active":"2024-05-21T14:45:45.222492+0000","last_peered":"2024-05-21T14:45:45.222492+0000","last_clean":"2024-05-21T14:45:45.222492+0000","last_became_active":"2024-05-21T14:43:19.620409+0000","last_became_peered":"2024-05-21T14:43:19.620409+0000","last_unstale":"2024-05-21T14:45:45.222492+0000","last_undegraded":"2024-05-21T14:45:45.222492+0000","last_fullsized":"2024-05-21T14:45:45.222492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-05-21T14:45:45.222387+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-05-21T14:45:45.222387+0000","last_clean_scrub_stamp":"2024-05-21T14:45:45.222387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:20:58.445401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'26","reported_seq":54,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:41.523313+0000","last_change":"2024-05-21T14:45:41.523403+0000","last_active":"2024-05-21T14:45:41.523313+0000","last_peered":"2024-05-21T14:45:41.523313+0000","last_clean":"2024-05-21T14:45:41.523313+0000","last_became_active":"2024-05-21T14:43:18.592335+0000","last_became_peered":"2024-05-21T14:43:18.592335+0000","last_unstale":"2024-05-21T14:45:41.523313+0000","last_undegraded":"2024-05-21T14:45:41.523313+0000","last_fullsized":"2024-05-21T14:45:41.523313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'26","last_scrub_stamp":"2024-05-21T14:45:41.523111+0000","last_deep_scrub":"25'26","last_deep_scrub_stamp":"2024-05-21T14:45:41.523111+0000","last_clean_scrub_stamp":"2024-05-21T14:45:41.523111+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:39:12.824297+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'6","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:54.743933+0000","last_change":"2024-05-21T14:45:54.743961+0000","last_active":"2024-05-21T14:45:54.743933+0000","last_peered":"2024-05-21T14:45:54.743933+0000","last_clean":"2024-05-21T14:45:54.743933+0000","last_became_active":"2024-05-21T14:43:19.612110+0000","last_became_peered":"2024-05-21T14:43:19.612110+0000","last_unstale":"2024-05-21T14:45:54.743933+0000","last_undegraded":"2024-05-21T14:45:54.743933+0000","last_fullsized":"2024-05-21T14:45:54.743933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-05-21T14:45:54.743795+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-05-21T14:45:54.743795+0000","last_clean_scrub_stamp":"2024-05-21T14:45:54.743795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:41:28.756601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'4","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:42.707509+0000","last_change":"2024-05-21T14:45:42.707536+0000","last_active":"2024-05-21T14:45:42.707509+0000","last_peered":"2024-05-21T14:45:42.707509+0000","last_clean":"2024-05-21T14:45:42.707509+0000","last_became_active":"2024-05-21T14:43:18.613048+0000","last_became_peered":"2024-05-21T14:43:18.613048+0000","last_unstale":"2024-05-21T14:45:42.707509+0000","last_undegraded":"2024-05-21T14:45:42.707509+0000","last_fullsized":"2024-05-21T14:45:42.707509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-21T14:45:42.707439+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-21T14:45:42.707439+0000","last_clean_scrub_stamp":"2024-05-21T14:45:42.707439+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:13:39.769994+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'5","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:42.753028+0000","last_change":"2024-05-21T14:45:42.753071+0000","last_active":"2024-05-21T14:45:42.753028+0000","last_peered":"2024-05-21T14:45:42.753028+0000","last_clean":"2024-05-21T14:45:42.753028+0000","last_became_active":"2024-05-21T14:43:19.596736+0000","last_became_peered":"2024-05-21T14:43:19.596736+0000","last_unstale":"2024-05-21T14:45:42.753028+0000","last_undegraded":"2024-05-21T14:45:42.753028+0000","last_fullsized":"2024-05-21T14:45:42.753028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-21T14:45:42.752898+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-21T14:45:42.752898+0000","last_clean_scrub_stamp":"2024-05-21T14:45:42.752898+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:19:41.124597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'7","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:45.460553+0000","last_change":"2024-05-21T14:45:45.460636+0000","last_active":"2024-05-21T14:45:45.460553+0000","last_peered":"2024-05-21T14:45:45.460553+0000","last_clean":"2024-05-21T14:45:45.460553+0000","last_became_active":"2024-05-21T14:43:18.619762+0000","last_became_peered":"2024-05-21T14:43:18.619762+0000","last_unstale":"2024-05-21T14:45:45.460553+0000","last_undegraded":"2024-05-21T14:45:45.460553+0000","last_fullsized":"2024-05-21T14:45:45.460553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2024-05-21T14:45:45.460335+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2024-05-21T14:45:45.460335+0000","last_clean_scrub_stamp":"2024-05-21T14:45:45.460335+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:59:55.152120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'9","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:49.204015+0000","last_change":"2024-05-21T14:45:49.204089+0000","last_active":"2024-05-21T14:45:49.204015+0000","last_peered":"2024-05-21T14:45:49.204015+0000","last_clean":"2024-05-21T14:45:49.204015+0000","last_became_active":"2024-05-21T14:43:59.817946+0000","last_became_peered":"2024-05-21T14:43:59.817946+0000","last_unstale":"2024-05-21T14:45:49.204015+0000","last_undegraded":"2024-05-21T14:45:49.204015+0000","last_fullsized":"2024-05-21T14:45:49.204015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2024-05-21T14:45:49.203802+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2024-05-21T14:45:49.203802+0000","last_clean_scrub_stamp":"2024-05-21T14:45:49.203802+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:18:29.289718+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"25'4","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:44.052061+0000","last_change":"2024-05-21T14:45:44.052135+0000","last_active":"2024-05-21T14:45:44.052061+0000","last_peered":"2024-05-21T14:45:44.052061+0000","last_clean":"2024-05-21T14:45:44.052061+0000","last_became_active":"2024-05-21T14:43:18.609349+0000","last_became_peered":"2024-05-21T14:43:18.609349+0000","last_unstale":"2024-05-21T14:45:44.052061+0000","last_undegraded":"2024-05-21T14:45:44.052061+0000","last_fullsized":"2024-05-21T14:45:44.052061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-21T14:45:44.051857+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-21T14:45:44.051857+0000","last_clean_scrub_stamp":"2024-05-21T14:45:44.051857+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:40:56.004360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'6","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:45.690514+0000","last_change":"2024-05-21T14:45:45.690542+0000","last_active":"2024-05-21T14:45:45.690514+0000","last_peered":"2024-05-21T14:45:45.690514+0000","last_clean":"2024-05-21T14:45:45.690514+0000","last_became_active":"2024-05-21T14:43:19.604869+0000","last_became_peered":"2024-05-21T14:43:19.604869+0000","last_unstale":"2024-05-21T14:45:45.690514+0000","last_undegraded":"2024-05-21T14:45:45.690514+0000","last_fullsized":"2024-05-21T14:45:45.690514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-05-21T14:45:45.690422+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-05-21T14:45:45.690422+0000","last_clean_scrub_stamp":"2024-05-21T14:45:45.690422+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:42:50.383134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"25'8","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:43.266844+0000","last_change":"2024-05-21T14:45:43.266922+0000","last_active":"2024-05-21T14:45:43.266844+0000","last_peered":"2024-05-21T14:45:43.266844+0000","last_clean":"2024-05-21T14:45:43.266844+0000","last_became_active":"2024-05-21T14:43:18.615734+0000","last_became_peered":"2024-05-21T14:43:18.615734+0000","last_unstale":"2024-05-21T14:45:43.266844+0000","last_undegraded":"2024-05-21T14:45:43.266844+0000","last_fullsized":"2024-05-21T14:45:43.266844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2024-05-21T14:45:43.266652+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2024-05-21T14:45:43.266652+0000","last_clean_scrub_stamp":"2024-05-21T14:45:43.266652+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:41:28.079858+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'7","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:56.763460+0000","last_change":"2024-05-21T14:45:56.763491+0000","last_active":"2024-05-21T14:45:56.763460+0000","last_peered":"2024-05-21T14:45:56.763460+0000","last_clean":"2024-05-21T14:45:56.763460+0000","last_became_active":"2024-05-21T14:43:19.614915+0000","last_became_peered":"2024-05-21T14:43:19.614915+0000","last_unstale":"2024-05-21T14:45:56.763460+0000","last_undegraded":"2024-05-21T14:45:56.763460+0000","last_fullsized":"2024-05-21T14:45:56.763460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2024-05-21T14:45:56.763345+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2024-05-21T14:45:56.763345+0000","last_clean_scrub_stamp":"2024-05-21T14:45:56.763345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:57:32.851286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":186,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:40.201626+0000","last_change":"2024-05-21T14:45:40.201657+0000","last_active":"2024-05-21T14:45:40.201626+0000","last_peered":"2024-05-21T14:45:40.201626+0000","last_clean":"2024-05-21T14:45:40.201626+0000","last_became_active":"2024-05-21T14:43:08.079934+0000","last_became_peered":"2024-05-21T14:43:08.079934+0000","last_unstale":"2024-05-21T14:45:40.201626+0000","last_undegraded":"2024-05-21T14:45:40.201626+0000","last_fullsized":"2024-05-21T14:45:40.201626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2024-05-21T14:45:40.201549+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2024-05-21T14:45:40.201549+0000","last_clean_scrub_stamp":"2024-05-21T14:45:40.201549+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:15:29.098557+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'11","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:47.666013+0000","last_change":"2024-05-21T14:45:47.666092+0000","last_active":"2024-05-21T14:45:47.666013+0000","last_peered":"2024-05-21T14:45:47.666013+0000","last_clean":"2024-05-21T14:45:47.666013+0000","last_became_active":"2024-05-21T14:43:18.599347+0000","last_became_peered":"2024-05-21T14:43:18.599347+0000","last_unstale":"2024-05-21T14:45:47.666013+0000","last_undegraded":"2024-05-21T14:45:47.666013+0000","last_fullsized":"2024-05-21T14:45:47.666013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2024-05-21T14:45:47.665871+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2024-05-21T14:45:47.665871+0000","last_clean_scrub_stamp":"2024-05-21T14:45:47.665871+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:14:12.336052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'8","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:51.515295+0000","last_change":"2024-05-21T14:45:51.515362+0000","last_active":"2024-05-21T14:45:51.515295+0000","last_peered":"2024-05-21T14:45:51.515295+0000","last_clean":"2024-05-21T14:45:51.515295+0000","last_became_active":"2024-05-21T14:43:19.611889+0000","last_became_peered":"2024-05-21T14:43:19.611889+0000","last_unstale":"2024-05-21T14:45:51.515295+0000","last_undegraded":"2024-05-21T14:45:51.515295+0000","last_fullsized":"2024-05-21T14:45:51.515295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2024-05-21T14:45:51.515095+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2024-05-21T14:45:51.515095+0000","last_clean_scrub_stamp":"2024-05-21T14:45:51.515095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:35:48.979884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"25'5","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:44.735894+0000","last_change":"2024-05-21T14:45:44.735926+0000","last_active":"2024-05-21T14:45:44.735894+0000","last_peered":"2024-05-21T14:45:44.735894+0000","last_clean":"2024-05-21T14:45:44.735894+0000","last_became_active":"2024-05-21T14:43:18.621229+0000","last_became_peered":"2024-05-21T14:43:18.621229+0000","last_unstale":"2024-05-21T14:45:44.735894+0000","last_undegraded":"2024-05-21T14:45:44.735894+0000","last_fullsized":"2024-05-21T14:45:44.735894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-21T14:45:44.735818+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-21T14:45:44.735818+0000","last_clean_scrub_stamp":"2024-05-21T14:45:44.735818+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:06:10.862199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'5","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:46.339344+0000","last_change":"2024-05-21T14:45:46.339415+0000","last_active":"2024-05-21T14:45:46.339344+0000","last_peered":"2024-05-21T14:45:46.339344+0000","last_clean":"2024-05-21T14:45:46.339344+0000","last_became_active":"2024-05-21T14:43:19.624114+0000","last_became_peered":"2024-05-21T14:43:19.624114+0000","last_unstale":"2024-05-21T14:45:46.339344+0000","last_undegraded":"2024-05-21T14:45:46.339344+0000","last_fullsized":"2024-05-21T14:45:46.339344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-21T14:45:46.339139+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-21T14:45:46.339139+0000","last_clean_scrub_stamp":"2024-05-21T14:45:46.339139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:35:19.320024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'11","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:45.237572+0000","last_change":"2024-05-21T14:45:45.237652+0000","last_active":"2024-05-21T14:45:45.237572+0000","last_peered":"2024-05-21T14:45:45.237572+0000","last_clean":"2024-05-21T14:45:45.237572+0000","last_became_active":"2024-05-21T14:43:18.617756+0000","last_became_peered":"2024-05-21T14:43:18.617756+0000","last_unstale":"2024-05-21T14:45:45.237572+0000","last_undegraded":"2024-05-21T14:45:45.237572+0000","last_fullsized":"2024-05-21T14:45:45.237572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2024-05-21T14:45:45.237344+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2024-05-21T14:45:45.237344+0000","last_clean_scrub_stamp":"2024-05-21T14:45:45.237344+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:58:18.965562+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'8","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:49.060392+0000","last_change":"2024-05-21T14:45:49.060485+0000","last_active":"2024-05-21T14:45:49.060392+0000","last_peered":"2024-05-21T14:45:49.060392+0000","last_clean":"2024-05-21T14:45:49.060392+0000","last_became_active":"2024-05-21T14:43:19.612730+0000","last_became_peered":"2024-05-21T14:43:19.612730+0000","last_unstale":"2024-05-21T14:45:49.060392+0000","last_undegraded":"2024-05-21T14:45:49.060392+0000","last_fullsized":"2024-05-21T14:45:49.060392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2024-05-21T14:45:49.060176+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2024-05-21T14:45:49.060176+0000","last_clean_scrub_stamp":"2024-05-21T14:45:49.060176+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:39:32.718893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"25'7","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:50.750160+0000","last_change":"2024-05-21T14:45:50.750194+0000","last_active":"2024-05-21T14:45:50.750160+0000","last_peered":"2024-05-21T14:45:50.750160+0000","last_clean":"2024-05-21T14:45:50.750160+0000","last_became_active":"2024-05-21T14:43:18.608262+0000","last_became_peered":"2024-05-21T14:43:18.608262+0000","last_unstale":"2024-05-21T14:45:50.750160+0000","last_undegraded":"2024-05-21T14:45:50.750160+0000","last_fullsized":"2024-05-21T14:45:50.750160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2024-05-21T14:45:50.750052+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2024-05-21T14:45:50.750052+0000","last_clean_scrub_stamp":"2024-05-21T14:45:50.750052+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:15:18.099970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'7","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:49.685542+0000","last_change":"2024-05-21T14:45:49.685573+0000","last_active":"2024-05-21T14:45:49.685542+0000","last_peered":"2024-05-21T14:45:49.685542+0000","last_clean":"2024-05-21T14:45:49.685542+0000","last_became_active":"2024-05-21T14:43:19.607513+0000","last_became_peered":"2024-05-21T14:43:19.607513+0000","last_unstale":"2024-05-21T14:45:49.685542+0000","last_undegraded":"2024-05-21T14:45:49.685542+0000","last_fullsized":"2024-05-21T14:45:49.685542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2024-05-21T14:45:49.685445+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2024-05-21T14:45:49.685445+0000","last_clean_scrub_stamp":"2024-05-21T14:45:49.685445+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:21:57.344566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"23'1","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:43.054654+0000","last_change":"2024-05-21T14:45:43.054783+0000","last_active":"2024-05-21T14:45:43.054654+0000","last_peered":"2024-05-21T14:45:43.054654+0000","last_clean":"2024-05-21T14:45:43.054654+0000","last_became_active":"2024-05-21T14:43:18.602704+0000","last_became_peered":"2024-05-21T14:43:18.602704+0000","last_unstale":"2024-05-21T14:45:43.054654+0000","last_undegraded":"2024-05-21T14:45:43.054654+0000","last_fullsized":"2024-05-21T14:45:43.054654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2024-05-21T14:45:43.054324+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2024-05-21T14:45:43.054324+0000","last_clean_scrub_stamp":"2024-05-21T14:45:43.054324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:20:07.161952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'5","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:47.669625+0000","last_change":"2024-05-21T14:45:47.669651+0000","last_active":"2024-05-21T14:45:47.669625+0000","last_peered":"2024-05-21T14:45:47.669625+0000","last_clean":"2024-05-21T14:45:47.669625+0000","last_became_active":"2024-05-21T14:43:19.633751+0000","last_became_peered":"2024-05-21T14:43:19.633751+0000","last_unstale":"2024-05-21T14:45:47.669625+0000","last_undegraded":"2024-05-21T14:45:47.669625+0000","last_fullsized":"2024-05-21T14:45:47.669625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-21T14:45:47.669539+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-21T14:45:47.669539+0000","last_clean_scrub_stamp":"2024-05-21T14:45:47.669539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:48:53.463362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"25'7","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:49.709162+0000","last_change":"2024-05-21T14:45:49.709215+0000","last_active":"2024-05-21T14:45:49.709162+0000","last_peered":"2024-05-21T14:45:49.709162+0000","last_clean":"2024-05-21T14:45:49.709162+0000","last_became_active":"2024-05-21T14:43:18.607999+0000","last_became_peered":"2024-05-21T14:43:18.607999+0000","last_unstale":"2024-05-21T14:45:49.709162+0000","last_undegraded":"2024-05-21T14:45:49.709162+0000","last_fullsized":"2024-05-21T14:45:49.709162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2024-05-21T14:45:49.709024+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2024-05-21T14:45:49.709024+0000","last_clean_scrub_stamp":"2024-05-21T14:45:49.709024+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:07:46.675773+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'9","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:48.319629+0000","last_change":"2024-05-21T14:45:48.319715+0000","last_active":"2024-05-21T14:45:48.319629+0000","last_peered":"2024-05-21T14:45:48.319629+0000","last_clean":"2024-05-21T14:45:48.319629+0000","last_became_active":"2024-05-21T14:43:19.626024+0000","last_became_peered":"2024-05-21T14:43:19.626024+0000","last_unstale":"2024-05-21T14:45:48.319629+0000","last_undegraded":"2024-05-21T14:45:48.319629+0000","last_fullsized":"2024-05-21T14:45:48.319629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2024-05-21T14:45:48.319429+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2024-05-21T14:45:48.319429+0000","last_clean_scrub_stamp":"2024-05-21T14:45:48.319429+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:32:09.098852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'19","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:44.485236+0000","last_change":"2024-05-21T14:45:44.485316+0000","last_active":"2024-05-21T14:45:44.485236+0000","last_peered":"2024-05-21T14:45:44.485236+0000","last_clean":"2024-05-21T14:45:44.485236+0000","last_became_active":"2024-05-21T14:43:18.616214+0000","last_became_peered":"2024-05-21T14:43:18.616214+0000","last_unstale":"2024-05-21T14:45:44.485236+0000","last_undegraded":"2024-05-21T14:45:44.485236+0000","last_fullsized":"2024-05-21T14:45:44.485236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'19","last_scrub_stamp":"2024-05-21T14:45:44.485050+0000","last_deep_scrub":"25'19","last_deep_scrub_stamp":"2024-05-21T14:45:44.485050+0000","last_clean_scrub_stamp":"2024-05-21T14:45:44.485050+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:55:15.397004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'5","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:47.464513+0000","last_change":"2024-05-21T14:45:47.464554+0000","last_active":"2024-05-21T14:45:47.464513+0000","last_peered":"2024-05-21T14:45:47.464513+0000","last_clean":"2024-05-21T14:45:47.464513+0000","last_became_active":"2024-05-21T14:43:19.606673+0000","last_became_peered":"2024-05-21T14:43:19.606673+0000","last_unstale":"2024-05-21T14:45:47.464513+0000","last_undegraded":"2024-05-21T14:45:47.464513+0000","last_fullsized":"2024-05-21T14:45:47.464513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-21T14:45:47.464400+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-21T14:45:47.464400+0000","last_clean_scrub_stamp":"2024-05-21T14:45:47.464400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:22:39.191383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'12","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:51.748751+0000","last_change":"2024-05-21T14:45:51.748846+0000","last_active":"2024-05-21T14:45:51.748751+0000","last_peered":"2024-05-21T14:45:51.748751+0000","last_clean":"2024-05-21T14:45:51.748751+0000","last_became_active":"2024-05-21T14:43:18.615506+0000","last_became_peered":"2024-05-21T14:43:18.615506+0000","last_unstale":"2024-05-21T14:45:51.748751+0000","last_undegraded":"2024-05-21T14:45:51.748751+0000","last_fullsized":"2024-05-21T14:45:51.748751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'12","last_scrub_stamp":"2024-05-21T14:45:51.748632+0000","last_deep_scrub":"25'12","last_deep_scrub_stamp":"2024-05-21T14:45:51.748632+0000","last_clean_scrub_stamp":"2024-05-21T14:45:51.748632+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T02:10:25.855535+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'7","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:50.550215+0000","last_change":"2024-05-21T14:45:50.550281+0000","last_active":"2024-05-21T14:45:50.550215+0000","last_peered":"2024-05-21T14:45:50.550215+0000","last_clean":"2024-05-21T14:45:50.550215+0000","last_became_active":"2024-05-21T14:43:19.610600+0000","last_became_peered":"2024-05-21T14:43:19.610600+0000","last_unstale":"2024-05-21T14:45:50.550215+0000","last_undegraded":"2024-05-21T14:45:50.550215+0000","last_fullsized":"2024-05-21T14:45:50.550215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2024-05-21T14:45:50.550007+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2024-05-21T14:45:50.550007+0000","last_clean_scrub_stamp":"2024-05-21T14:45:50.550007+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:48:03.805034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'3","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:41.655121+0000","last_change":"2024-05-21T14:45:41.655149+0000","last_active":"2024-05-21T14:45:41.655121+0000","last_peered":"2024-05-21T14:45:41.655121+0000","last_clean":"2024-05-21T14:45:41.655121+0000","last_became_active":"2024-05-21T14:43:18.602186+0000","last_became_peered":"2024-05-21T14:43:18.602186+0000","last_unstale":"2024-05-21T14:45:41.655121+0000","last_undegraded":"2024-05-21T14:45:41.655121+0000","last_fullsized":"2024-05-21T14:45:41.655121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-05-21T14:45:41.655048+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-05-21T14:45:41.655048+0000","last_clean_scrub_stamp":"2024-05-21T14:45:41.655048+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:14.548661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'2","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:40.727951+0000","last_change":"2024-05-21T14:45:40.727976+0000","last_active":"2024-05-21T14:45:40.727951+0000","last_peered":"2024-05-21T14:45:40.727951+0000","last_clean":"2024-05-21T14:45:40.727951+0000","last_became_active":"2024-05-21T14:43:19.600499+0000","last_became_peered":"2024-05-21T14:43:19.600499+0000","last_unstale":"2024-05-21T14:45:40.727951+0000","last_undegraded":"2024-05-21T14:45:40.727951+0000","last_fullsized":"2024-05-21T14:45:40.727951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-21T14:45:40.727855+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-21T14:45:40.727855+0000","last_clean_scrub_stamp":"2024-05-21T14:45:40.727855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:07:28.918560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'11","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:43.438009+0000","last_change":"2024-05-21T14:45:43.438092+0000","last_active":"2024-05-21T14:45:43.438009+0000","last_peered":"2024-05-21T14:45:43.438009+0000","last_clean":"2024-05-21T14:45:43.438009+0000","last_became_active":"2024-05-21T14:43:18.614306+0000","last_became_peered":"2024-05-21T14:43:18.614306+0000","last_unstale":"2024-05-21T14:45:43.438009+0000","last_undegraded":"2024-05-21T14:45:43.438009+0000","last_fullsized":"2024-05-21T14:45:43.438009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2024-05-21T14:45:43.437808+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2024-05-21T14:45:43.437808+0000","last_clean_scrub_stamp":"2024-05-21T14:45:43.437808+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:34:05.699056+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'9","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:49.510185+0000","last_change":"2024-05-21T14:45:49.510252+0000","last_active":"2024-05-21T14:45:49.510185+0000","last_peered":"2024-05-21T14:45:49.510185+0000","last_clean":"2024-05-21T14:45:49.510185+0000","last_became_active":"2024-05-21T14:43:19.610101+0000","last_became_peered":"2024-05-21T14:43:19.610101+0000","last_unstale":"2024-05-21T14:45:49.510185+0000","last_undegraded":"2024-05-21T14:45:49.510185+0000","last_fullsized":"2024-05-21T14:45:49.510185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2024-05-21T14:45:49.509983+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2024-05-21T14:45:49.509983+0000","last_clean_scrub_stamp":"2024-05-21T14:45:49.509983+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:18:48.184025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"25'5","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:44.279981+0000","last_change":"2024-05-21T14:45:44.280062+0000","last_active":"2024-05-21T14:45:44.279981+0000","last_peered":"2024-05-21T14:45:44.279981+0000","last_clean":"2024-05-21T14:45:44.279981+0000","last_became_active":"2024-05-21T14:43:18.617041+0000","last_became_peered":"2024-05-21T14:43:18.617041+0000","last_unstale":"2024-05-21T14:45:44.279981+0000","last_undegraded":"2024-05-21T14:45:44.279981+0000","last_fullsized":"2024-05-21T14:45:44.279981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-21T14:45:44.279775+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-21T14:45:44.279775+0000","last_clean_scrub_stamp":"2024-05-21T14:45:44.279775+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:18:25.916008+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'8","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:48.218453+0000","last_change":"2024-05-21T14:45:48.218530+0000","last_active":"2024-05-21T14:45:48.218453+0000","last_peered":"2024-05-21T14:45:48.218453+0000","last_clean":"2024-05-21T14:45:48.218453+0000","last_became_active":"2024-05-21T14:43:19.626265+0000","last_became_peered":"2024-05-21T14:43:19.626265+0000","last_unstale":"2024-05-21T14:45:48.218453+0000","last_undegraded":"2024-05-21T14:45:48.218453+0000","last_fullsized":"2024-05-21T14:45:48.218453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2024-05-21T14:45:48.218254+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2024-05-21T14:45:48.218254+0000","last_clean_scrub_stamp":"2024-05-21T14:45:48.218254+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:03:01.054343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'7","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:46.706595+0000","last_change":"2024-05-21T14:45:46.706666+0000","last_active":"2024-05-21T14:45:46.706595+0000","last_peered":"2024-05-21T14:45:46.706595+0000","last_clean":"2024-05-21T14:45:46.706595+0000","last_became_active":"2024-05-21T14:43:18.598996+0000","last_became_peered":"2024-05-21T14:43:18.598996+0000","last_unstale":"2024-05-21T14:45:46.706595+0000","last_undegraded":"2024-05-21T14:45:46.706595+0000","last_fullsized":"2024-05-21T14:45:46.706595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2024-05-21T14:45:46.706493+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2024-05-21T14:45:46.706493+0000","last_clean_scrub_stamp":"2024-05-21T14:45:46.706493+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:10:31.445785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'5","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:57.731869+0000","last_change":"2024-05-21T14:45:57.731905+0000","last_active":"2024-05-21T14:45:57.731869+0000","last_peered":"2024-05-21T14:45:57.731869+0000","last_clean":"2024-05-21T14:45:57.731869+0000","last_became_active":"2024-05-21T14:43:19.617398+0000","last_became_peered":"2024-05-21T14:43:19.617398+0000","last_unstale":"2024-05-21T14:45:57.731869+0000","last_undegraded":"2024-05-21T14:45:57.731869+0000","last_fullsized":"2024-05-21T14:45:57.731869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-21T14:45:57.731760+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-21T14:45:57.731760+0000","last_clean_scrub_stamp":"2024-05-21T14:45:57.731760+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:07:24.364130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'15","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:41.734808+0000","last_change":"2024-05-21T14:45:41.734808+0000","last_active":"2024-05-21T14:45:41.734808+0000","last_peered":"2024-05-21T14:45:41.734808+0000","last_clean":"2024-05-21T14:45:41.734808+0000","last_became_active":"2024-05-21T14:43:19.601286+0000","last_became_peered":"2024-05-21T14:43:19.601286+0000","last_unstale":"2024-05-21T14:45:41.734808+0000","last_undegraded":"2024-05-21T14:45:41.734808+0000","last_fullsized":"2024-05-21T14:45:41.734808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'15","last_scrub_stamp":"2024-05-21T14:45:41.734667+0000","last_deep_scrub":"25'15","last_deep_scrub_stamp":"2024-05-21T14:45:41.734667+0000","last_clean_scrub_stamp":"2024-05-21T14:45:41.734667+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:58:51.445640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'8","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:43.671981+0000","last_change":"2024-05-21T14:45:43.671981+0000","last_active":"2024-05-21T14:45:43.671981+0000","last_peered":"2024-05-21T14:45:43.671981+0000","last_clean":"2024-05-21T14:45:43.671981+0000","last_became_active":"2024-05-21T14:43:18.613117+0000","last_became_peered":"2024-05-21T14:43:18.613117+0000","last_unstale":"2024-05-21T14:45:43.671981+0000","last_undegraded":"2024-05-21T14:45:43.671981+0000","last_fullsized":"2024-05-21T14:45:43.671981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2024-05-21T14:45:43.671870+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2024-05-21T14:45:43.671870+0000","last_clean_scrub_stamp":"2024-05-21T14:45:43.671870+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:34:25.477486+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'9","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:42.276305+0000","last_change":"2024-05-21T14:45:42.276305+0000","last_active":"2024-05-21T14:45:42.276305+0000","last_peered":"2024-05-21T14:45:42.276305+0000","last_clean":"2024-05-21T14:45:42.276305+0000","last_became_active":"2024-05-21T14:43:19.596157+0000","last_became_peered":"2024-05-21T14:43:19.596157+0000","last_unstale":"2024-05-21T14:45:42.276305+0000","last_undegraded":"2024-05-21T14:45:42.276305+0000","last_fullsized":"2024-05-21T14:45:42.276305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2024-05-21T14:45:42.276203+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2024-05-21T14:45:42.276203+0000","last_clean_scrub_stamp":"2024-05-21T14:45:42.276203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:00.384609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'20","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:44.723059+0000","last_change":"2024-05-21T14:45:44.723059+0000","last_active":"2024-05-21T14:45:44.723059+0000","last_peered":"2024-05-21T14:45:44.723059+0000","last_clean":"2024-05-21T14:45:44.723059+0000","last_became_active":"2024-05-21T14:43:18.613730+0000","last_became_peered":"2024-05-21T14:43:18.613730+0000","last_unstale":"2024-05-21T14:45:44.723059+0000","last_undegraded":"2024-05-21T14:45:44.723059+0000","last_fullsized":"2024-05-21T14:45:44.723059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'20","last_scrub_stamp":"2024-05-21T14:45:44.722900+0000","last_deep_scrub":"25'20","last_deep_scrub_stamp":"2024-05-21T14:45:44.722900+0000","last_clean_scrub_stamp":"2024-05-21T14:45:44.722900+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:56:55.287165+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'6","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:55.066580+0000","last_change":"2024-05-21T14:45:55.066669+0000","last_active":"2024-05-21T14:45:55.066580+0000","last_peered":"2024-05-21T14:45:55.066580+0000","last_clean":"2024-05-21T14:45:55.066580+0000","last_became_active":"2024-05-21T14:43:19.614744+0000","last_became_peered":"2024-05-21T14:43:19.614744+0000","last_unstale":"2024-05-21T14:45:55.066580+0000","last_undegraded":"2024-05-21T14:45:55.066580+0000","last_fullsized":"2024-05-21T14:45:55.066580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-05-21T14:45:55.066369+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-05-21T14:45:55.066369+0000","last_clean_scrub_stamp":"2024-05-21T14:45:55.066369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:26:51.048063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'2","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:45.042834+0000","last_change":"2024-05-21T14:45:45.042928+0000","last_active":"2024-05-21T14:45:45.042834+0000","last_peered":"2024-05-21T14:45:45.042834+0000","last_clean":"2024-05-21T14:45:45.042834+0000","last_became_active":"2024-05-21T14:43:18.609797+0000","last_became_peered":"2024-05-21T14:43:18.609797+0000","last_unstale":"2024-05-21T14:45:45.042834+0000","last_undegraded":"2024-05-21T14:45:45.042834+0000","last_fullsized":"2024-05-21T14:45:45.042834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-05-21T14:45:45.042608+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-05-21T14:45:45.042608+0000","last_clean_scrub_stamp":"2024-05-21T14:45:45.042608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:52:03.300985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'5","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:47.040387+0000","last_change":"2024-05-21T14:45:47.040460+0000","last_active":"2024-05-21T14:45:47.040387+0000","last_peered":"2024-05-21T14:45:47.040387+0000","last_clean":"2024-05-21T14:45:47.040387+0000","last_became_active":"2024-05-21T14:43:19.606575+0000","last_became_peered":"2024-05-21T14:43:19.606575+0000","last_unstale":"2024-05-21T14:45:47.040387+0000","last_undegraded":"2024-05-21T14:45:47.040387+0000","last_fullsized":"2024-05-21T14:45:47.040387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-21T14:45:47.040175+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-21T14:45:47.040175+0000","last_clean_scrub_stamp":"2024-05-21T14:45:47.040175+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:06:18.202944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'19","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T14:45:42.482771+0000","last_change":"2024-05-21T14:45:42.482852+0000","last_active":"2024-05-21T14:45:42.482771+0000","last_peered":"2024-05-21T14:45:42.482771+0000","last_clean":"2024-05-21T14:45:42.482771+0000","last_became_active":"2024-05-21T14:43:18.601311+0000","last_became_peered":"2024-05-21T14:43:18.601311+0000","last_unstale":"2024-05-21T14:45:42.482771+0000","last_undegraded":"2024-05-21T14:45:42.482771+0000","last_fullsized":"2024-05-21T14:45:42.482771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'19","last_scrub_stamp":"2024-05-21T14:45:42.482570+0000","last_deep_scrub":"25'19","last_deep_scrub_stamp":"2024-05-21T14:45:42.482570+0000","last_clean_scrub_stamp":"2024-05-21T14:45:42.482570+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:13:51.802776+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":41740,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":244,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":335872,"data_stored":83480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":311,"ondisk_log_size":311,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66776,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":95528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509478,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":684746,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":129900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509478,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":95870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":128130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":684930,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":95690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":94606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33388,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":34982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":36752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T14:46:03.532 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-21T14:46:03.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.703+0000 7f1d5d400640 1 Processor -- start 2024-05-21T14:46:03.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.703+0000 7f1d5d400640 1 -- start start 2024-05-21T14:46:03.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.703+0000 7f1d5d400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1d581527a0 0x7f1d580c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:03.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.703+0000 7f1d5d400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1d580c5980 0x7f1d58162e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:03.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.703+0000 7f1d5d400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d580737e0 con 0x7f1d580733d0 2024-05-21T14:46:03.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.703+0000 7f1d5d400640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f1d58072980 con 0x7f1d581527a0 2024-05-21T14:46:03.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.703+0000 7f1d5d400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f1d58072f40 con 0x7f1d580c5980 2024-05-21T14:46:03.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.703+0000 7f1d55e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1d581527a0 0x7f1d580c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:03.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.703+0000 7f1d55e00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1d581527a0 0x7f1d580c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56144/0 (socket says 172.21.15.78:56144) 2024-05-21T14:46:03.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.703+0000 7f1d55e00640 1 -- 172.21.15.78:0/3142877018 learned_addr learned my addr 172.21.15.78:0/3142877018 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:46:03.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.703+0000 7f1d57200640 1 --2- 172.21.15.78:0/3142877018 >> v2:172.21.15.84:3300/0 conn(0x7f1d580c5980 0x7f1d58162e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:03.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.703+0000 7f1d55e00640 1 -- 172.21.15.78:0/3142877018 >> v2:172.21.15.84:3300/0 conn(0x7f1d580c5980 msgr2=0x7f1d58162e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:46:03.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.703+0000 7f1d55e00640 1 --2- 172.21.15.78:0/3142877018 >> v2:172.21.15.84:3300/0 conn(0x7f1d580c5980 0x7f1d58162e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.707+0000 7f1d55e00640 1 -- 172.21.15.78:0/3142877018 >> v1:172.21.15.84:6789/0 conn(0x7f1d580733d0 legacy=0x7f1d58071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:03.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.707+0000 7f1d55e00640 1 -- 172.21.15.78:0/3142877018 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d58073aa0 con 0x7f1d581527a0 2024-05-21T14:46:03.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.707+0000 7f1d57200640 1 --2- 172.21.15.78:0/3142877018 >> v2:172.21.15.84:3300/0 conn(0x7f1d580c5980 0x7f1d58162e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:46:03.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.707+0000 7f1d55e00640 1 --2- 172.21.15.78:0/3142877018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d581527a0 0x7f1d580c5440 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1d58072b00 tx=0x7f1d4401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96729640a004d602 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:03.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.707+0000 7f1d55400640 1 -- 172.21.15.78:0/3142877018 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d440b5070 con 0x7f1d581527a0 2024-05-21T14:46:03.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.707+0000 7f1d55400640 1 -- 172.21.15.78:0/3142877018 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d440a8a10 con 0x7f1d581527a0 2024-05-21T14:46:03.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.707+0000 7f1d55400640 1 -- 172.21.15.78:0/3142877018 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d440a8de0 con 0x7f1d581527a0 2024-05-21T14:46:03.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.707+0000 7f1d5d400640 1 -- 172.21.15.78:0/3142877018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d581527a0 msgr2=0x7f1d580c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:03.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.707+0000 7f1d5d400640 1 --2- 172.21.15.78:0/3142877018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d581527a0 0x7f1d580c5440 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1d58072b00 tx=0x7f1d4401ed10 comp rx=0 tx=0).stop 2024-05-21T14:46:03.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.711+0000 7f1d5d400640 1 -- 172.21.15.78:0/3142877018 shutdown_connections 2024-05-21T14:46:03.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.711+0000 7f1d5d400640 1 --2- 172.21.15.78:0/3142877018 >> v2:172.21.15.84:3300/0 conn(0x7f1d580c5980 0x7f1d58162e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.711+0000 7f1d5d400640 1 --2- 172.21.15.78:0/3142877018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d581527a0 0x7f1d580c5440 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.711+0000 7f1d5d400640 1 -- 172.21.15.78:0/3142877018 >> 172.21.15.78:0/3142877018 conn(0x7f1d580cd1e0 msgr2=0x7f1d580c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:03.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.711+0000 7f1d5d400640 1 -- 172.21.15.78:0/3142877018 shutdown_connections 2024-05-21T14:46:03.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.711+0000 7f1d5d400640 1 -- 172.21.15.78:0/3142877018 wait complete. 2024-05-21T14:46:03.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.711+0000 7f1d5d400640 1 Processor -- start 2024-05-21T14:46:03.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.711+0000 7f1d5d400640 1 -- start start 2024-05-21T14:46:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.711+0000 7f1d5d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d580733d0 0x7f1d5814d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.711+0000 7f1d5d400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d580c5980 0x7f1d581efd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.711+0000 7f1d5d400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d581527a0 0x7f1d5815bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.711+0000 7f1d5d400640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1d58072bd0 con 0x7f1d580c5980 2024-05-21T14:46:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.711+0000 7f1d5d400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1d58074060 con 0x7f1d580733d0 2024-05-21T14:46:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.711+0000 7f1d5d400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1d580ca100 con 0x7f1d581527a0 2024-05-21T14:46:03.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d55e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d580c5980 0x7f1d581efd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d55e00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d580c5980 0x7f1d581efd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56158/0 (socket says 172.21.15.78:56158) 2024-05-21T14:46:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d55e00640 1 -- 172.21.15.78:0/1011841504 learned_addr learned my addr 172.21.15.78:0/1011841504 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:46:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d56800640 1 --2- 172.21.15.78:0/1011841504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d580733d0 0x7f1d5814d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d57200640 1 --2- 172.21.15.78:0/1011841504 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d581527a0 0x7f1d5815bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d55e00640 1 -- 172.21.15.78:0/1011841504 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d581527a0 msgr2=0x7f1d5815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d55e00640 1 --2- 172.21.15.78:0/1011841504 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d581527a0 0x7f1d5815bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d55e00640 1 -- 172.21.15.78:0/1011841504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d580733d0 msgr2=0x7f1d5814d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d55e00640 1 --2- 172.21.15.78:0/1011841504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d580733d0 0x7f1d5814d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d55e00640 1 -- 172.21.15.78:0/1011841504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d581f0280 con 0x7f1d580c5980 2024-05-21T14:46:03.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d55e00640 1 --2- 172.21.15.78:0/1011841504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d580c5980 0x7f1d581efd40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1d4401b920 tx=0x7f1d4401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:03.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d4ea00640 1 -- 172.21.15.78:0/1011841504 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d440b5070 con 0x7f1d580c5980 2024-05-21T14:46:03.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d4ea00640 1 -- 172.21.15.78:0/1011841504 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d440b0b30 con 0x7f1d580c5980 2024-05-21T14:46:03.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d5d400640 1 -- 172.21.15.78:0/1011841504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5814cca0 con 0x7f1d580c5980 2024-05-21T14:46:03.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d4ea00640 1 -- 172.21.15.78:0/1011841504 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d440bb410 con 0x7f1d580c5980 2024-05-21T14:46:03.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d5d400640 1 -- 172.21.15.78:0/1011841504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d5814e5e0 con 0x7f1d580c5980 2024-05-21T14:46:03.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d5d400640 1 -- 172.21.15.78:0/1011841504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d580c74d0 con 0x7f1d580c5980 2024-05-21T14:46:03.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.715+0000 7f1d4ea00640 1 -- 172.21.15.78:0/1011841504 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d440c2060 con 0x7f1d580c5980 2024-05-21T14:46:03.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.719+0000 7f1d4ea00640 1 --2- 172.21.15.78:0/1011841504 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1d380678f0 0x7f1d38069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:03.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.719+0000 7f1d4ea00640 1 -- 172.21.15.78:0/1011841504 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f1d44122e30 con 0x7f1d580c5980 2024-05-21T14:46:03.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.719+0000 7f1d56800640 1 --2- 172.21.15.78:0/1011841504 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1d380678f0 0x7f1d38069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:03.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.719+0000 7f1d56800640 1 --2- 172.21.15.78:0/1011841504 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1d380678f0 0x7f1d38069e00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1d48000f70 tx=0x7f1d48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:03.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.723+0000 7f1d4ea00640 1 -- 172.21.15.78:0/1011841504 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1d44018870 con 0x7f1d580c5980 2024-05-21T14:46:03.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.883+0000 7f1d5d400640 1 -- 172.21.15.78:0/1011841504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f1d580c71f0 con 0x7f1d580c5980 2024-05-21T14:46:03.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.887+0000 7f1d4ea00640 1 -- 172.21.15.78:0/1011841504 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f1d440f38b0 con 0x7f1d580c5980 2024-05-21T14:46:03.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.887+0000 7f1d4ea00640 1 -- 172.21.15.78:0/1011841504 <== mon.0 v2:172.21.15.78:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1d440a8a10 con 0x7f1d580c5980 2024-05-21T14:46:03.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.891+0000 7f1d5d400640 1 -- 172.21.15.78:0/1011841504 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1d380678f0 msgr2=0x7f1d38069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:03.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.891+0000 7f1d5d400640 1 --2- 172.21.15.78:0/1011841504 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1d380678f0 0x7f1d38069e00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1d48000f70 tx=0x7f1d48009040 comp rx=0 tx=0).stop 2024-05-21T14:46:03.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.891+0000 7f1d5d400640 1 -- 172.21.15.78:0/1011841504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d580c5980 msgr2=0x7f1d581efd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:03.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.891+0000 7f1d5d400640 1 --2- 172.21.15.78:0/1011841504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d580c5980 0x7f1d581efd40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1d4401b920 tx=0x7f1d4401bab0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.891+0000 7f1d5d400640 1 -- 172.21.15.78:0/1011841504 shutdown_connections 2024-05-21T14:46:03.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.891+0000 7f1d5d400640 1 --2- 172.21.15.78:0/1011841504 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1d380678f0 0x7f1d38069e00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.891+0000 7f1d5d400640 1 --2- 172.21.15.78:0/1011841504 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d581527a0 0x7f1d5815bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.891+0000 7f1d5d400640 1 --2- 172.21.15.78:0/1011841504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d580c5980 0x7f1d581efd40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.891+0000 7f1d5d400640 1 --2- 172.21.15.78:0/1011841504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d580733d0 0x7f1d5814d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:03.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.891+0000 7f1d5d400640 1 -- 172.21.15.78:0/1011841504 >> 172.21.15.78:0/1011841504 conn(0x7f1d580cd1e0 msgr2=0x7f1d581551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:03.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.891+0000 7f1d5d400640 1 -- 172.21.15.78:0/1011841504 shutdown_connections 2024-05-21T14:46:03.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:03.891+0000 7f1d5d400640 1 -- 172.21.15.78:0/1011841504 wait complete. 2024-05-21T14:46:03.919 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-21T14:46:03.920 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T14:46:04.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.055+0000 7f0eb5a00640 1 Processor -- start 2024-05-21T14:46:04.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.055+0000 7f0eb5a00640 1 -- start start 2024-05-21T14:46:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.059+0000 7f0eb5a00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0eb00c6760 0x7f0eb00c7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.059+0000 7f0eb5a00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0eb00736d0 0x7f0eb0073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.059+0000 7f0eb5a00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0eb0159810 0x7f0eb0159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.059+0000 7f0eb5a00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f0eb015cbb0 con 0x7f0eb00736d0 2024-05-21T14:46:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.059+0000 7f0eb5a00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f0eb0153cd0 con 0x7f0eb0159810 2024-05-21T14:46:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.059+0000 7f0eb5a00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb015cdf0 con 0x7f0eb00c6760 2024-05-21T14:46:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.059+0000 7f0ea6000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0eb00736d0 0x7f0eb0073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.059+0000 7f0ea6000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0eb00736d0 0x7f0eb0073ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56168/0 (socket says 172.21.15.78:56168) 2024-05-21T14:46:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.059+0000 7f0ea6000640 1 -- 172.21.15.78:0/1267699870 learned_addr learned my addr 172.21.15.78:0/1267699870 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:46:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.059+0000 7f0eaf400640 1 --2- 172.21.15.78:0/1267699870 >> v2:172.21.15.84:3300/0 conn(0x7f0eb0159810 0x7f0eb0159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.059+0000 7f0eaea00640 1 --2- 172.21.15.78:0/1267699870 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0eb00c6760 0x7f0eb00c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.059+0000 7f0ea6000640 1 -- 172.21.15.78:0/1267699870 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0eb00c6760 msgr2=0x7f0eb00c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:46:04.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.059+0000 7f0ea6000640 1 --2- 172.21.15.78:0/1267699870 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0eb00c6760 0x7f0eb00c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.059+0000 7f0ea6000640 1 -- 172.21.15.78:0/1267699870 >> v2:172.21.15.84:3300/0 conn(0x7f0eb0159810 msgr2=0x7f0eb0159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:46:04.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.059+0000 7f0ea6000640 1 --2- 172.21.15.78:0/1267699870 >> v2:172.21.15.84:3300/0 conn(0x7f0eb0159810 0x7f0eb0159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.059+0000 7f0ea6000640 1 -- 172.21.15.78:0/1267699870 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb015d0d0 con 0x7f0eb00736d0 2024-05-21T14:46:04.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.059+0000 7f0ea6000640 1 --2- 172.21.15.78:0/1267699870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb00736d0 0x7f0eb0073ae0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0070db0 tx=0x7f0e9801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7350a4cf9b262d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:04.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.063+0000 7f0eae000640 1 -- 172.21.15.78:0/1267699870 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e980b0070 con 0x7f0eb00736d0 2024-05-21T14:46:04.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.063+0000 7f0eae000640 1 -- 172.21.15.78:0/1267699870 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0e980ab600 con 0x7f0eb00736d0 2024-05-21T14:46:04.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.063+0000 7f0eae000640 1 -- 172.21.15.78:0/1267699870 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e980ab9f0 con 0x7f0eb00736d0 2024-05-21T14:46:04.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.063+0000 7f0eb5a00640 1 -- 172.21.15.78:0/1267699870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb00736d0 msgr2=0x7f0eb0073ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:04.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.063+0000 7f0eb5a00640 1 --2- 172.21.15.78:0/1267699870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb00736d0 0x7f0eb0073ae0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0070db0 tx=0x7f0e9801c490 comp rx=0 tx=0).stop 2024-05-21T14:46:04.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.063+0000 7f0eb5a00640 1 -- 172.21.15.78:0/1267699870 shutdown_connections 2024-05-21T14:46:04.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.063+0000 7f0eb5a00640 1 --2- 172.21.15.78:0/1267699870 >> v2:172.21.15.84:3300/0 conn(0x7f0eb0159810 0x7f0eb0159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.063+0000 7f0eb5a00640 1 --2- 172.21.15.78:0/1267699870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb00736d0 0x7f0eb0073ae0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.063+0000 7f0eb5a00640 1 --2- 172.21.15.78:0/1267699870 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0eb00c6760 0x7f0eb00c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.063+0000 7f0eb5a00640 1 -- 172.21.15.78:0/1267699870 >> 172.21.15.78:0/1267699870 conn(0x7f0eb00c9380 msgr2=0x7f0eb00c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:04.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.063+0000 7f0eb5a00640 1 -- 172.21.15.78:0/1267699870 shutdown_connections 2024-05-21T14:46:04.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.063+0000 7f0eb5a00640 1 -- 172.21.15.78:0/1267699870 wait complete. 2024-05-21T14:46:04.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.063+0000 7f0eb5a00640 1 Processor -- start 2024-05-21T14:46:04.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.063+0000 7f0eb5a00640 1 -- start start 2024-05-21T14:46:04.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eb5a00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb00736d0 0x7f0eb01f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eb5a00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0eb00c6760 0x7f0eb015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eb5a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb0159810 0x7f0eb00cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eb5a00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb00c7850 con 0x7f0eb00736d0 2024-05-21T14:46:04.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eb5a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb015a160 con 0x7f0eb0159810 2024-05-21T14:46:04.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eb5a00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb00c79d0 con 0x7f0eb00c6760 2024-05-21T14:46:04.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eaea00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb00736d0 0x7f0eb01f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eaea00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb00736d0 0x7f0eb01f6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56180/0 (socket says 172.21.15.78:56180) 2024-05-21T14:46:04.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eaea00640 1 -- 172.21.15.78:0/299525076 learned_addr learned my addr 172.21.15.78:0/299525076 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:46:04.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0ea6000640 1 --2- 172.21.15.78:0/299525076 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0eb00c6760 0x7f0eb015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eaf400640 1 --2- 172.21.15.78:0/299525076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb0159810 0x7f0eb00cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eaea00640 1 -- 172.21.15.78:0/299525076 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0eb00c6760 msgr2=0x7f0eb015b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:04.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eaea00640 1 --2- 172.21.15.78:0/299525076 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0eb00c6760 0x7f0eb015b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eaea00640 1 -- 172.21.15.78:0/299525076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb0159810 msgr2=0x7f0eb00cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:04.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eaea00640 1 --2- 172.21.15.78:0/299525076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb0159810 0x7f0eb00cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eaea00640 1 -- 172.21.15.78:0/299525076 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb01f7150 con 0x7f0eb00736d0 2024-05-21T14:46:04.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eaea00640 1 --2- 172.21.15.78:0/299525076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb00736d0 0x7f0eb01f6c10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0007e60 tx=0x7f0ea000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:04.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0ea7400640 1 -- 172.21.15.78:0/299525076 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0014620 con 0x7f0eb00736d0 2024-05-21T14:46:04.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0ea7400640 1 -- 172.21.15.78:0/299525076 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0ea0019070 con 0x7f0eb00736d0 2024-05-21T14:46:04.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eb5a00640 1 -- 172.21.15.78:0/299525076 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb0146aa0 con 0x7f0eb00736d0 2024-05-21T14:46:04.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0ea7400640 1 -- 172.21.15.78:0/299525076 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0014a00 con 0x7f0eb00736d0 2024-05-21T14:46:04.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eb5a00640 1 -- 172.21.15.78:0/299525076 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb015b720 con 0x7f0eb00736d0 2024-05-21T14:46:04.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.067+0000 7f0eb5a00640 1 -- 172.21.15.78:0/299525076 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb0163d20 con 0x7f0eb00736d0 2024-05-21T14:46:04.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.071+0000 7f0ea7400640 1 -- 172.21.15.78:0/299525076 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ea0014ba0 con 0x7f0eb00736d0 2024-05-21T14:46:04.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.071+0000 7f0ea7400640 1 --2- 172.21.15.78:0/299525076 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0e8c0678c0 0x7f0e8c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.071+0000 7f0ea7400640 1 -- 172.21.15.78:0/299525076 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f0ea0086460 con 0x7f0eb00736d0 2024-05-21T14:46:04.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.071+0000 7f0ea6000640 1 --2- 172.21.15.78:0/299525076 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0e8c0678c0 0x7f0e8c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.071+0000 7f0ea6000640 1 --2- 172.21.15.78:0/299525076 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0e8c0678c0 0x7f0e8c069dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0e980ad000 tx=0x7f0e98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:04.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.075+0000 7f0ea7400640 1 -- 172.21.15.78:0/299525076 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f0ea0056f70 con 0x7f0eb00736d0 2024-05-21T14:46:04.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.263+0000 7f0eb5a00640 1 -- 172.21.15.78:0/299525076 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0eb0159db0 con 0x7f0eb00736d0 2024-05-21T14:46:04.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.263+0000 7f0ea7400640 1 -- 172.21.15.78:0/299525076 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6906 (secure 0 0 0) 0x7f0ea0056870 con 0x7f0eb00736d0 2024-05-21T14:46:04.273 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:46:04.273 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1952345794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1952345794},{"type":"v1","addr":"172.21.15.78:6833","nonce":1952345794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T14:43:18.985546+0000","modified":"2024-05-21T14:43:48.761495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4321,"mds_1":4300,"mds_2":4297,"mds_3":4294,"mds_4":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6836/3517628193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3517628193},{"type":"v1","addr":"172.21.15.78:6836","nonce":3517628193}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":9,"addr":"172.21.15.84:6835/3155872080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3155872080},{"type":"v1","addr":"172.21.15.84:6835","nonce":3155872080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6838/1750816366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1750816366},{"type":"v1","addr":"172.21.15.84:6838","nonce":1750816366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6839/4232079477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6837","nonce":4232079477},{"type":"v1","addr":"172.21.15.84:6839","nonce":4232079477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6837/1924967428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1924967428},{"type":"v1","addr":"172.21.15.78:6837","nonce":1924967428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4272,4294,4297,4300,4321]},"id":1}]} 2024-05-21T14:46:04.273 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 16 2024-05-21T14:46:04.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.267+0000 7f0eb5a00640 1 -- 172.21.15.78:0/299525076 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0e8c0678c0 msgr2=0x7f0e8c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:04.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.267+0000 7f0eb5a00640 1 --2- 172.21.15.78:0/299525076 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0e8c0678c0 0x7f0e8c069dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0e980ad000 tx=0x7f0e98008040 comp rx=0 tx=0).stop 2024-05-21T14:46:04.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.267+0000 7f0eb5a00640 1 -- 172.21.15.78:0/299525076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb00736d0 msgr2=0x7f0eb01f6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:04.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.267+0000 7f0eb5a00640 1 --2- 172.21.15.78:0/299525076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb00736d0 0x7f0eb01f6c10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0007e60 tx=0x7f0ea000e4b0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.267+0000 7f0eb5a00640 1 -- 172.21.15.78:0/299525076 shutdown_connections 2024-05-21T14:46:04.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.267+0000 7f0eb5a00640 1 --2- 172.21.15.78:0/299525076 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0e8c0678c0 0x7f0e8c069dd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.267+0000 7f0eb5a00640 1 --2- 172.21.15.78:0/299525076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb0159810 0x7f0eb00cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.267+0000 7f0eb5a00640 1 --2- 172.21.15.78:0/299525076 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0eb00c6760 0x7f0eb015b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.267+0000 7f0eb5a00640 1 --2- 172.21.15.78:0/299525076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb00736d0 0x7f0eb01f6c10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.267+0000 7f0eb5a00640 1 -- 172.21.15.78:0/299525076 >> 172.21.15.78:0/299525076 conn(0x7f0eb00c9380 msgr2=0x7f0eb00c6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:04.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.267+0000 7f0eb5a00640 1 -- 172.21.15.78:0/299525076 shutdown_connections 2024-05-21T14:46:04.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.267+0000 7f0eb5a00640 1 -- 172.21.15.78:0/299525076 wait complete. 2024-05-21T14:46:04.295 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T14:46:04.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.431+0000 7f0e40800640 1 Processor -- start 2024-05-21T14:46:04.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.431+0000 7f0e40800640 1 -- start start 2024-05-21T14:46:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.435+0000 7f0e40800640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0e380736d0 0x7f0e38073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.435+0000 7f0e40800640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0e38159810 0x7f0e38159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.435+0000 7f0e40800640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e38153cd0 con 0x7f0e380c6760 2024-05-21T14:46:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.435+0000 7f0e40800640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f0e3815cbb0 con 0x7f0e380736d0 2024-05-21T14:46:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.435+0000 7f0e40800640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f0e3815cdf0 con 0x7f0e38159810 2024-05-21T14:46:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.435+0000 7f0e3d400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0e380736d0 0x7f0e38073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.435+0000 7f0e3d400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0e380736d0 0x7f0e38073ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56190/0 (socket says 172.21.15.78:56190) 2024-05-21T14:46:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.435+0000 7f0e3d400640 1 -- 172.21.15.78:0/1765831004 learned_addr learned my addr 172.21.15.78:0/1765831004 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:46:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.435+0000 7f0e3e800640 1 --2- 172.21.15.78:0/1765831004 >> v2:172.21.15.84:3300/0 conn(0x7f0e38159810 0x7f0e38159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.435+0000 7f0e3d400640 1 -- 172.21.15.78:0/1765831004 >> v2:172.21.15.84:3300/0 conn(0x7f0e38159810 msgr2=0x7f0e38159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:46:04.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.435+0000 7f0e3d400640 1 --2- 172.21.15.78:0/1765831004 >> v2:172.21.15.84:3300/0 conn(0x7f0e38159810 0x7f0e38159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.435+0000 7f0e3d400640 1 -- 172.21.15.78:0/1765831004 >> v1:172.21.15.84:6789/0 conn(0x7f0e380c6760 legacy=0x7f0e380c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:04.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.435+0000 7f0e3d400640 1 -- 172.21.15.78:0/1765831004 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3815d0d0 con 0x7f0e380736d0 2024-05-21T14:46:04.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.439+0000 7f0e3d400640 1 --2- 172.21.15.78:0/1765831004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e380736d0 0x7f0e38073ae0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0e380c6230 tx=0x7f0e2801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd2a1983d9742fe server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:04.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.439+0000 7f0e3ca00640 1 -- 172.21.15.78:0/1765831004 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e280b0070 con 0x7f0e380736d0 2024-05-21T14:46:04.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.439+0000 7f0e3ca00640 1 -- 172.21.15.78:0/1765831004 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0e280ab600 con 0x7f0e380736d0 2024-05-21T14:46:04.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.439+0000 7f0e3ca00640 1 -- 172.21.15.78:0/1765831004 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e280ab9f0 con 0x7f0e380736d0 2024-05-21T14:46:04.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.439+0000 7f0e40800640 1 -- 172.21.15.78:0/1765831004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e380736d0 msgr2=0x7f0e38073ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:04.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.439+0000 7f0e40800640 1 --2- 172.21.15.78:0/1765831004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e380736d0 0x7f0e38073ae0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0e380c6230 tx=0x7f0e2801c490 comp rx=0 tx=0).stop 2024-05-21T14:46:04.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.439+0000 7f0e40800640 1 -- 172.21.15.78:0/1765831004 shutdown_connections 2024-05-21T14:46:04.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.439+0000 7f0e40800640 1 --2- 172.21.15.78:0/1765831004 >> v2:172.21.15.84:3300/0 conn(0x7f0e38159810 0x7f0e38159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.439+0000 7f0e40800640 1 --2- 172.21.15.78:0/1765831004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e380736d0 0x7f0e38073ae0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.439+0000 7f0e40800640 1 -- 172.21.15.78:0/1765831004 >> 172.21.15.78:0/1765831004 conn(0x7f0e380c9380 msgr2=0x7f0e380c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:04.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.439+0000 7f0e40800640 1 -- 172.21.15.78:0/1765831004 shutdown_connections 2024-05-21T14:46:04.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.439+0000 7f0e40800640 1 -- 172.21.15.78:0/1765831004 wait complete. 2024-05-21T14:46:04.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.439+0000 7f0e40800640 1 Processor -- start 2024-05-21T14:46:04.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e40800640 1 -- start start 2024-05-21T14:46:04.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e40800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0e380736d0 0x7f0e381463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e40800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e380c6760 0x7f0e381f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e40800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e38159810 0x7f0e380cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e40800640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0e380c6b70 con 0x7f0e38159810 2024-05-21T14:46:04.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e40800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3815a160 con 0x7f0e380c6760 2024-05-21T14:46:04.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e40800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0e380c6cf0 con 0x7f0e380736d0 2024-05-21T14:46:04.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e3e800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e38159810 0x7f0e380cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e3e800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e38159810 0x7f0e380cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56192/0 (socket says 172.21.15.78:56192) 2024-05-21T14:46:04.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e3e800640 1 -- 172.21.15.78:0/447081107 learned_addr learned my addr 172.21.15.78:0/447081107 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:46:04.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e3de00640 1 --2- 172.21.15.78:0/447081107 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0e380736d0 0x7f0e381463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e3d400640 1 --2- 172.21.15.78:0/447081107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e380c6760 0x7f0e381f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e3e800640 1 -- 172.21.15.78:0/447081107 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0e380736d0 msgr2=0x7f0e381463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:04.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e3e800640 1 --2- 172.21.15.78:0/447081107 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0e380736d0 0x7f0e381463b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e3e800640 1 -- 172.21.15.78:0/447081107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e380c6760 msgr2=0x7f0e381f5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:04.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e3e800640 1 --2- 172.21.15.78:0/447081107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e380c6760 0x7f0e381f5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e3e800640 1 -- 172.21.15.78:0/447081107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e381468f0 con 0x7f0e38159810 2024-05-21T14:46:04.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e3e800640 1 --2- 172.21.15.78:0/447081107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e38159810 0x7f0e380cb980 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400efc0 tx=0x7f0e3400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:04.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e32000640 1 -- 172.21.15.78:0/447081107 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e34018020 con 0x7f0e38159810 2024-05-21T14:46:04.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e32000640 1 -- 172.21.15.78:0/447081107 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0e34014480 con 0x7f0e38159810 2024-05-21T14:46:04.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e40800640 1 -- 172.21.15.78:0/447081107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e381491b0 con 0x7f0e38159810 2024-05-21T14:46:04.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e32000640 1 -- 172.21.15.78:0/447081107 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e34014890 con 0x7f0e38159810 2024-05-21T14:46:04.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e40800640 1 -- 172.21.15.78:0/447081107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e38149870 con 0x7f0e38159810 2024-05-21T14:46:04.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.443+0000 7f0e40800640 1 -- 172.21.15.78:0/447081107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e38157010 con 0x7f0e38159810 2024-05-21T14:46:04.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.447+0000 7f0e32000640 1 -- 172.21.15.78:0/447081107 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0e3401b020 con 0x7f0e38159810 2024-05-21T14:46:04.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.447+0000 7f0e32000640 1 --2- 172.21.15.78:0/447081107 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0e1c0678c0 0x7f0e1c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.447+0000 7f0e32000640 1 -- 172.21.15.78:0/447081107 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f0e34086a60 con 0x7f0e38159810 2024-05-21T14:46:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.447+0000 7f0e3de00640 1 --2- 172.21.15.78:0/447081107 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0e1c0678c0 0x7f0e1c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.447+0000 7f0e3de00640 1 --2- 172.21.15.78:0/447081107 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0e1c0678c0 0x7f0e1c069dd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c001770 tx=0x7f0e2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:04.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.451+0000 7f0e32000640 1 -- 172.21.15.78:0/447081107 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f0e34022030 con 0x7f0e38159810 2024-05-21T14:46:04.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.639+0000 7f0e40800640 1 -- 172.21.15.78:0/447081107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e380c7d00 con 0x7f0e38159810 2024-05-21T14:46:04.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.639+0000 7f0e32000640 1 -- 172.21.15.78:0/447081107 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6906 (secure 0 0 0) 0x7f0e381491b0 con 0x7f0e38159810 2024-05-21T14:46:04.651 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:46:04.651 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1952345794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1952345794},{"type":"v1","addr":"172.21.15.78:6833","nonce":1952345794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T14:43:18.985546+0000","modified":"2024-05-21T14:43:48.761495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4321,"mds_1":4300,"mds_2":4297,"mds_3":4294,"mds_4":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":4,"incarnation":15,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6836/3517628193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3517628193},{"type":"v1","addr":"172.21.15.78:6836","nonce":3517628193}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":9,"addr":"172.21.15.84:6835/3155872080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3155872080},{"type":"v1","addr":"172.21.15.84:6835","nonce":3155872080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6838/1750816366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1750816366},{"type":"v1","addr":"172.21.15.84:6838","nonce":1750816366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6839/4232079477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6837","nonce":4232079477},{"type":"v1","addr":"172.21.15.84:6839","nonce":4232079477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4321":{"gid":4321,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6837/1924967428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":1924967428},{"type":"v1","addr":"172.21.15.78:6837","nonce":1924967428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4321,"qdb_cluster":[4272,4294,4297,4300,4321]},"id":1}]} 2024-05-21T14:46:04.651 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 16 2024-05-21T14:46:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.643+0000 7f0e40800640 1 -- 172.21.15.78:0/447081107 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0e1c0678c0 msgr2=0x7f0e1c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.643+0000 7f0e40800640 1 --2- 172.21.15.78:0/447081107 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0e1c0678c0 0x7f0e1c069dd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c001770 tx=0x7f0e2c009040 comp rx=0 tx=0).stop 2024-05-21T14:46:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.643+0000 7f0e40800640 1 -- 172.21.15.78:0/447081107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e38159810 msgr2=0x7f0e380cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.643+0000 7f0e40800640 1 --2- 172.21.15.78:0/447081107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e38159810 0x7f0e380cb980 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400efc0 tx=0x7f0e3400c490 comp rx=0 tx=0).stop 2024-05-21T14:46:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.643+0000 7f0e40800640 1 -- 172.21.15.78:0/447081107 shutdown_connections 2024-05-21T14:46:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.643+0000 7f0e40800640 1 --2- 172.21.15.78:0/447081107 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f0e1c0678c0 0x7f0e1c069dd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.643+0000 7f0e40800640 1 --2- 172.21.15.78:0/447081107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e38159810 0x7f0e380cb980 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.643+0000 7f0e40800640 1 --2- 172.21.15.78:0/447081107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e380c6760 0x7f0e381f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.643+0000 7f0e40800640 1 --2- 172.21.15.78:0/447081107 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0e380736d0 0x7f0e381463b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.643+0000 7f0e40800640 1 -- 172.21.15.78:0/447081107 >> 172.21.15.78:0/447081107 conn(0x7f0e380c9380 msgr2=0x7f0e3806ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.643+0000 7f0e40800640 1 -- 172.21.15.78:0/447081107 shutdown_connections 2024-05-21T14:46:04.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.643+0000 7f0e40800640 1 -- 172.21.15.78:0/447081107 wait complete. 2024-05-21T14:46:04.672 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T14:46:04.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.807+0000 7f6e16400640 1 Processor -- start 2024-05-21T14:46:04.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.807+0000 7f6e16400640 1 -- start start 2024-05-21T14:46:04.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.811+0000 7f6e16400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e101529d0 0x7f6e10072e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.811+0000 7f6e16400640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e100723f0 0x7f6e10162e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.811+0000 7f6e16400640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e10073380 con 0x7f6e10071fe0 2024-05-21T14:46:04.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.811+0000 7f6e16400640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f6e100715f0 con 0x7f6e101529d0 2024-05-21T14:46:04.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.811+0000 7f6e16400640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f6e10072b80 con 0x7f6e100723f0 2024-05-21T14:46:04.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.811+0000 7f6e0f400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e101529d0 0x7f6e10072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.811+0000 7f6e0f400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e101529d0 0x7f6e10072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56194/0 (socket says 172.21.15.78:56194) 2024-05-21T14:46:04.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.811+0000 7f6e0f400640 1 -- 172.21.15.78:0/3594329953 learned_addr learned my addr 172.21.15.78:0/3594329953 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:46:04.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.811+0000 7f6e0fe00640 1 --2- 172.21.15.78:0/3594329953 >> v2:172.21.15.84:3300/0 conn(0x7f6e100723f0 0x7f6e10162e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.811+0000 7f6e0f400640 1 -- 172.21.15.78:0/3594329953 >> v2:172.21.15.84:3300/0 conn(0x7f6e100723f0 msgr2=0x7f6e10162e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:46:04.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.811+0000 7f6e0f400640 1 --2- 172.21.15.78:0/3594329953 >> v2:172.21.15.84:3300/0 conn(0x7f6e100723f0 0x7f6e10162e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.811+0000 7f6e0f400640 1 -- 172.21.15.78:0/3594329953 >> v1:172.21.15.84:6789/0 conn(0x7f6e10071fe0 legacy=0x7f6e100c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:04.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.811+0000 7f6e0f400640 1 -- 172.21.15.78:0/3594329953 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e100c8530 con 0x7f6e101529d0 2024-05-21T14:46:04.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.811+0000 7f6e0fe00640 1 --2- 172.21.15.78:0/3594329953 >> v2:172.21.15.84:3300/0 conn(0x7f6e100723f0 0x7f6e10162e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:46:04.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.815+0000 7f6e0f400640 1 --2- 172.21.15.78:0/3594329953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e101529d0 0x7f6e10072e40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6e100c34e0 tx=0x7f6e0001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598ca26459c1c101 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:04.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.815+0000 7f6e0ea00640 1 -- 172.21.15.78:0/3594329953 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e000b0070 con 0x7f6e101529d0 2024-05-21T14:46:04.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.815+0000 7f6e0ea00640 1 -- 172.21.15.78:0/3594329953 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6e000ab600 con 0x7f6e101529d0 2024-05-21T14:46:04.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.815+0000 7f6e0ea00640 1 -- 172.21.15.78:0/3594329953 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e000ab9f0 con 0x7f6e101529d0 2024-05-21T14:46:04.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.815+0000 7f6e16400640 1 -- 172.21.15.78:0/3594329953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e101529d0 msgr2=0x7f6e10072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:04.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.815+0000 7f6e16400640 1 --2- 172.21.15.78:0/3594329953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e101529d0 0x7f6e10072e40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6e100c34e0 tx=0x7f6e0001c520 comp rx=0 tx=0).stop 2024-05-21T14:46:04.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.815+0000 7f6e16400640 1 -- 172.21.15.78:0/3594329953 shutdown_connections 2024-05-21T14:46:04.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.815+0000 7f6e16400640 1 --2- 172.21.15.78:0/3594329953 >> v2:172.21.15.84:3300/0 conn(0x7f6e100723f0 0x7f6e10162e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.815+0000 7f6e16400640 1 --2- 172.21.15.78:0/3594329953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e101529d0 0x7f6e10072e40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.815+0000 7f6e16400640 1 -- 172.21.15.78:0/3594329953 >> 172.21.15.78:0/3594329953 conn(0x7f6e100c9380 msgr2=0x7f6e100c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:04.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.815+0000 7f6e16400640 1 -- 172.21.15.78:0/3594329953 shutdown_connections 2024-05-21T14:46:04.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.815+0000 7f6e16400640 1 -- 172.21.15.78:0/3594329953 wait complete. 2024-05-21T14:46:04.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e16400640 1 Processor -- start 2024-05-21T14:46:04.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e16400640 1 -- start start 2024-05-21T14:46:04.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e16400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e10071fe0 0x7f6e101624b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e16400640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6e100723f0 0x7f6e101f8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e16400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e101529d0 0x7f6e1014d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e16400640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6e100c5ed0 con 0x7f6e101529d0 2024-05-21T14:46:04.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e16400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6e100c5d50 con 0x7f6e10071fe0 2024-05-21T14:46:04.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e16400640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f6e100c38a0 con 0x7f6e100723f0 2024-05-21T14:46:04.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e0fe00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e101529d0 0x7f6e1014d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e0fe00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e101529d0 0x7f6e1014d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56204/0 (socket says 172.21.15.78:56204) 2024-05-21T14:46:04.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e0fe00640 1 -- 172.21.15.78:0/3603889247 learned_addr learned my addr 172.21.15.78:0/3603889247 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:46:04.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e0f400640 1 --2- 172.21.15.78:0/3603889247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e10071fe0 0x7f6e101624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e07e00640 1 --2- 172.21.15.78:0/3603889247 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6e100723f0 0x7f6e101f8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e0fe00640 1 -- 172.21.15.78:0/3603889247 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6e100723f0 msgr2=0x7f6e101f8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:04.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e0fe00640 1 --2- 172.21.15.78:0/3603889247 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6e100723f0 0x7f6e101f8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e0fe00640 1 -- 172.21.15.78:0/3603889247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e10071fe0 msgr2=0x7f6e101624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:04.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e0fe00640 1 --2- 172.21.15.78:0/3603889247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e10071fe0 0x7f6e101624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e0fe00640 1 -- 172.21.15.78:0/3603889247 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e101f8d80 con 0x7f6e101529d0 2024-05-21T14:46:04.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e0fe00640 1 --2- 172.21.15.78:0/3603889247 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e101529d0 0x7f6e1014d1e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6e08007ef0 tx=0x7f6e0800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:04.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e07400640 1 -- 172.21.15.78:0/3603889247 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0801a070 con 0x7f6e101529d0 2024-05-21T14:46:04.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e07400640 1 -- 172.21.15.78:0/3603889247 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6e08015600 con 0x7f6e101529d0 2024-05-21T14:46:04.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e16400640 1 -- 172.21.15.78:0/3603889247 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e101610f0 con 0x7f6e101529d0 2024-05-21T14:46:04.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e07400640 1 -- 172.21.15.78:0/3603889247 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e08015a10 con 0x7f6e101529d0 2024-05-21T14:46:04.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.819+0000 7f6e16400640 1 -- 172.21.15.78:0/3603889247 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e101616b0 con 0x7f6e101529d0 2024-05-21T14:46:04.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.823+0000 7f6e16400640 1 -- 172.21.15.78:0/3603889247 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e1004f730 con 0x7f6e101529d0 2024-05-21T14:46:04.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.823+0000 7f6e07400640 1 -- 172.21.15.78:0/3603889247 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6e0801d070 con 0x7f6e101529d0 2024-05-21T14:46:04.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.823+0000 7f6e07400640 1 --2- 172.21.15.78:0/3603889247 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f6dec0678c0 0x7f6dec069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:04.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.823+0000 7f6e07400640 1 -- 172.21.15.78:0/3603889247 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f6e08085ff0 con 0x7f6e101529d0 2024-05-21T14:46:04.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.823+0000 7f6e0f400640 1 --2- 172.21.15.78:0/3603889247 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f6dec0678c0 0x7f6dec069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:04.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.823+0000 7f6e0f400640 1 --2- 172.21.15.78:0/3603889247 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f6dec0678c0 0x7f6dec069dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6e000ad000 tx=0x7f6e00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:04.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.827+0000 7f6e07400640 1 -- 172.21.15.78:0/3603889247 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f6e08010070 con 0x7f6e101529d0 2024-05-21T14:46:04.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.987+0000 7f6e16400640 1 -- 172.21.15.78:0/3603889247 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e100cae70 con 0x7f6e101529d0 2024-05-21T14:46:04.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.987+0000 7f6e07400640 1 -- 172.21.15.78:0/3603889247 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16585 (secure 0 0 0) 0x7f6e080563d0 con 0x7f6e101529d0 2024-05-21T14:46:04.997 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-05-21T14:46:04.997 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"6eb3ee76-1ecf-4815-bcfc-1b3a8ff744aa","created":"2024-05-21T14:42:53.893292+0000","modified":"2024-05-21T14:43:59.799293+0000","last_up_change":"2024-05-21T14:43:05.040399+0000","last_in_change":"2024-05-21T14:42:56.469635+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T14:43:06.569415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T14:43:17.088549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T14:43:18.012571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"29c2e728-8789-46bd-8f2d-d6d00fefbdbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6801","nonce":2618175314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6803","nonce":2618175314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6807","nonce":2618175314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2618175314},{"type":"v1","addr":"172.21.15.78:6805","nonce":2618175314}]},"public_addr":"172.21.15.78:6801/2618175314","cluster_addr":"172.21.15.78:6803/2618175314","heartbeat_back_addr":"172.21.15.78:6807/2618175314","heartbeat_front_addr":"172.21.15.78:6805/2618175314","state":["exists","up"]},{"osd":1,"uuid":"906a2733-8b89-43ef-b744-39fc9e74955b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6825","nonce":840893414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6827","nonce":840893414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6831","nonce":840893414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":840893414},{"type":"v1","addr":"172.21.15.78:6829","nonce":840893414}]},"public_addr":"172.21.15.78:6825/840893414","cluster_addr":"172.21.15.78:6827/840893414","heartbeat_back_addr":"172.21.15.78:6831/840893414","heartbeat_front_addr":"172.21.15.78:6829/840893414","state":["exists","up"]},{"osd":2,"uuid":"cde17f1c-3cee-47a4-ac9c-a3419d285ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6810","nonce":68473545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6814","nonce":68473545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6822","nonce":68473545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":68473545},{"type":"v1","addr":"172.21.15.78:6818","nonce":68473545}]},"public_addr":"172.21.15.78:6810/68473545","cluster_addr":"172.21.15.78:6814/68473545","heartbeat_back_addr":"172.21.15.78:6822/68473545","heartbeat_front_addr":"172.21.15.78:6818/68473545","state":["exists","up"]},{"osd":3,"uuid":"b2863049-8ee1-4960-8471-9453c3b5cf2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6811","nonce":3531240521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6815","nonce":3531240521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6823","nonce":3531240521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3531240521},{"type":"v1","addr":"172.21.15.78:6819","nonce":3531240521}]},"public_addr":"172.21.15.78:6811/3531240521","cluster_addr":"172.21.15.78:6815/3531240521","heartbeat_back_addr":"172.21.15.78:6823/3531240521","heartbeat_front_addr":"172.21.15.78:6819/3531240521","state":["exists","up"]},{"osd":4,"uuid":"278ccf0a-20cd-4fc3-b405-d291376b898c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6804","nonce":1494211791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6810","nonce":1494211791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6823","nonce":1494211791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6813","nonce":1494211791},{"type":"v1","addr":"172.21.15.84:6816","nonce":1494211791}]},"public_addr":"172.21.15.84:6804/1494211791","cluster_addr":"172.21.15.84:6810/1494211791","heartbeat_back_addr":"172.21.15.84:6823/1494211791","heartbeat_front_addr":"172.21.15.84:6816/1494211791","state":["exists","up"]},{"osd":5,"uuid":"4f88be08-f0c2-47a3-9291-b127f56d92cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6825","nonce":3186857851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6827","nonce":3186857851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6831","nonce":3186857851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3186857851},{"type":"v1","addr":"172.21.15.84:6829","nonce":3186857851}]},"public_addr":"172.21.15.84:6825/3186857851","cluster_addr":"172.21.15.84:6827/3186857851","heartbeat_back_addr":"172.21.15.84:6831/3186857851","heartbeat_front_addr":"172.21.15.84:6829/3186857851","state":["exists","up"]},{"osd":6,"uuid":"7a6fc449-1be1-4654-82ac-596df6f939c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6805","nonce":4084754024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6811","nonce":4084754024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6822","nonce":4084754024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4084754024},{"type":"v1","addr":"172.21.15.84:6817","nonce":4084754024}]},"public_addr":"172.21.15.84:6805/4084754024","cluster_addr":"172.21.15.84:6811/4084754024","heartbeat_back_addr":"172.21.15.84:6822/4084754024","heartbeat_front_addr":"172.21.15.84:6817/4084754024","state":["exists","up"]},{"osd":7,"uuid":"b4b56151-6eb0-413e-9ecc-436b8af9e735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6801","nonce":2776653794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6809","nonce":2776653794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6821","nonce":2776653794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2776653794},{"type":"v1","addr":"172.21.15.84:6815","nonce":2776653794}]},"public_addr":"172.21.15.84:6801/2776653794","cluster_addr":"172.21.15.84:6809/2776653794","heartbeat_back_addr":"172.21.15.84:6821/2776653794","heartbeat_front_addr":"172.21.15.84:6815/2776653794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.346978+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.261435+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.328019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.051983+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.028534+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.088465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:02.074023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T14:43:01.801787+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T14:46:04.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.991+0000 7f6e16400640 1 -- 172.21.15.78:0/3603889247 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f6dec0678c0 msgr2=0x7f6dec069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:04.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.991+0000 7f6e16400640 1 --2- 172.21.15.78:0/3603889247 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f6dec0678c0 0x7f6dec069dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6e000ad000 tx=0x7f6e00008040 comp rx=0 tx=0).stop 2024-05-21T14:46:04.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.991+0000 7f6e16400640 1 -- 172.21.15.78:0/3603889247 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e101529d0 msgr2=0x7f6e1014d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:04.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.991+0000 7f6e16400640 1 --2- 172.21.15.78:0/3603889247 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e101529d0 0x7f6e1014d1e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6e08007ef0 tx=0x7f6e0800d4a0 comp rx=0 tx=0).stop 2024-05-21T14:46:04.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.991+0000 7f6e16400640 1 -- 172.21.15.78:0/3603889247 shutdown_connections 2024-05-21T14:46:04.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.991+0000 7f6e16400640 1 --2- 172.21.15.78:0/3603889247 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f6dec0678c0 0x7f6dec069dd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.991+0000 7f6e16400640 1 --2- 172.21.15.78:0/3603889247 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e101529d0 0x7f6e1014d1e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.991+0000 7f6e16400640 1 --2- 172.21.15.78:0/3603889247 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6e100723f0 0x7f6e101f8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.991+0000 7f6e16400640 1 --2- 172.21.15.78:0/3603889247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e10071fe0 0x7f6e101624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.991+0000 7f6e16400640 1 -- 172.21.15.78:0/3603889247 >> 172.21.15.78:0/3603889247 conn(0x7f6e100c9380 msgr2=0x7f6e10150b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:05.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.991+0000 7f6e16400640 1 -- 172.21.15.78:0/3603889247 shutdown_connections 2024-05-21T14:46:05.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:04.991+0000 7f6e16400640 1 -- 172.21.15.78:0/3603889247 wait complete. 2024-05-21T14:46:05.019 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-21T14:46:05.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.155+0000 7f1d26000640 1 Processor -- start 2024-05-21T14:46:05.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.155+0000 7f1d26000640 1 -- start start 2024-05-21T14:46:05.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.159+0000 7f1d26000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d200c5c30 0x7f1d201538d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:05.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.159+0000 7f1d26000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1d200c7f90 0x7f1d2015cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:05.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.159+0000 7f1d26000640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1d200c6540 0x7f1d200735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:05.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.159+0000 7f1d26000640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f1d20153e10 con 0x7f1d200c6540 2024-05-21T14:46:05.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.159+0000 7f1d26000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f1d200c4370 con 0x7f1d200c7f90 2024-05-21T14:46:05.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.159+0000 7f1d26000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1d200c7240 con 0x7f1d200c5c30 2024-05-21T14:46:05.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.159+0000 7f1d1fe00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1d200c6540 0x7f1d200735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:05.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.159+0000 7f1d1fe00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1d200c6540 0x7f1d200735e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56220/0 (socket says 172.21.15.78:56220) 2024-05-21T14:46:05.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.159+0000 7f1d1fe00640 1 -- 172.21.15.78:0/947109425 learned_addr learned my addr 172.21.15.78:0/947109425 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:46:05.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.159+0000 7f1d16a00640 1 --2- 172.21.15.78:0/947109425 >> v2:172.21.15.84:3300/0 conn(0x7f1d200c7f90 0x7f1d2015cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:05.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.159+0000 7f1d1f400640 1 --2- 172.21.15.78:0/947109425 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d200c5c30 0x7f1d201538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:05.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.159+0000 7f1d1fe00640 1 -- 172.21.15.78:0/947109425 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d200c5c30 msgr2=0x7f1d201538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:46:05.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.159+0000 7f1d1fe00640 1 --2- 172.21.15.78:0/947109425 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d200c5c30 0x7f1d201538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.159+0000 7f1d1fe00640 1 -- 172.21.15.78:0/947109425 >> v2:172.21.15.84:3300/0 conn(0x7f1d200c7f90 msgr2=0x7f1d2015cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:46:05.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.159+0000 7f1d1fe00640 1 --2- 172.21.15.78:0/947109425 >> v2:172.21.15.84:3300/0 conn(0x7f1d200c7f90 0x7f1d2015cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.159+0000 7f1d1fe00640 1 -- 172.21.15.78:0/947109425 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d200c74e0 con 0x7f1d200c6540 2024-05-21T14:46:05.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.163+0000 7f1d1fe00640 1 --2- 172.21.15.78:0/947109425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d200c6540 0x7f1d200735e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1d200cd8d0 tx=0x7f1d1801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52356728173aa47c server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:05.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.163+0000 7f1d1ea00640 1 -- 172.21.15.78:0/947109425 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d180a5670 con 0x7f1d200c6540 2024-05-21T14:46:05.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.163+0000 7f1d1ea00640 1 -- 172.21.15.78:0/947109425 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1d180a5810 con 0x7f1d200c6540 2024-05-21T14:46:05.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.163+0000 7f1d1ea00640 1 -- 172.21.15.78:0/947109425 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d180a5c00 con 0x7f1d200c6540 2024-05-21T14:46:05.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.163+0000 7f1d26000640 1 -- 172.21.15.78:0/947109425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d200c6540 msgr2=0x7f1d200735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:05.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.163+0000 7f1d26000640 1 --2- 172.21.15.78:0/947109425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d200c6540 0x7f1d200735e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1d200cd8d0 tx=0x7f1d1801c9f0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.163+0000 7f1d26000640 1 -- 172.21.15.78:0/947109425 shutdown_connections 2024-05-21T14:46:05.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.163+0000 7f1d26000640 1 --2- 172.21.15.78:0/947109425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d200c6540 0x7f1d200735e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.163+0000 7f1d26000640 1 --2- 172.21.15.78:0/947109425 >> v2:172.21.15.84:3300/0 conn(0x7f1d200c7f90 0x7f1d2015cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.163+0000 7f1d26000640 1 --2- 172.21.15.78:0/947109425 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d200c5c30 0x7f1d201538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.163+0000 7f1d26000640 1 -- 172.21.15.78:0/947109425 >> 172.21.15.78:0/947109425 conn(0x7f1d200cd1e0 msgr2=0x7f1d200c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:05.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.163+0000 7f1d26000640 1 -- 172.21.15.78:0/947109425 shutdown_connections 2024-05-21T14:46:05.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.163+0000 7f1d26000640 1 -- 172.21.15.78:0/947109425 wait complete. 2024-05-21T14:46:05.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.163+0000 7f1d26000640 1 Processor -- start 2024-05-21T14:46:05.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.163+0000 7f1d26000640 1 -- start start 2024-05-21T14:46:05.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d26000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d200c5c30 0x7f1d2015c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:05.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d26000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d200c6540 0x7f1d20073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d26000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d200c7f90 0x7f1d2014cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d26000640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2006be30 con 0x7f1d200c5c30 2024-05-21T14:46:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d26000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2015d1d0 con 0x7f1d200c6540 2024-05-21T14:46:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d26000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1d2006bfb0 con 0x7f1d200c7f90 2024-05-21T14:46:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d1f400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d200c5c30 0x7f1d2015c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d1f400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d200c5c30 0x7f1d2015c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56234/0 (socket says 172.21.15.78:56234) 2024-05-21T14:46:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d1f400640 1 -- 172.21.15.78:0/876621022 learned_addr learned my addr 172.21.15.78:0/876621022 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:46:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d1fe00640 1 --2- 172.21.15.78:0/876621022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d200c7f90 0x7f1d2014cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d16a00640 1 --2- 172.21.15.78:0/876621022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d200c6540 0x7f1d20073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d1f400640 1 -- 172.21.15.78:0/876621022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d200c7f90 msgr2=0x7f1d2014cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d1f400640 1 --2- 172.21.15.78:0/876621022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d200c7f90 0x7f1d2014cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d1f400640 1 -- 172.21.15.78:0/876621022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d200c6540 msgr2=0x7f1d20073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:05.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d1f400640 1 --2- 172.21.15.78:0/876621022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d200c6540 0x7f1d20073100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d1f400640 1 -- 172.21.15.78:0/876621022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2015c8a0 con 0x7f1d200c5c30 2024-05-21T14:46:05.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d1f400640 1 --2- 172.21.15.78:0/876621022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d200c5c30 0x7f1d2015c360 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000d830 tx=0x7f1d1000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:05.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d17e00640 1 -- 172.21.15.78:0/876621022 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10018030 con 0x7f1d200c5c30 2024-05-21T14:46:05.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d17e00640 1 -- 172.21.15.78:0/876621022 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1d1000be10 con 0x7f1d200c5c30 2024-05-21T14:46:05.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d26000640 1 -- 172.21.15.78:0/876621022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d201553d0 con 0x7f1d200c5c30 2024-05-21T14:46:05.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d17e00640 1 -- 172.21.15.78:0/876621022 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d100098b0 con 0x7f1d200c5c30 2024-05-21T14:46:05.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d26000640 1 -- 172.21.15.78:0/876621022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d20154370 con 0x7f1d200c5c30 2024-05-21T14:46:05.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.167+0000 7f1d26000640 1 -- 172.21.15.78:0/876621022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d200c7b40 con 0x7f1d200c5c30 2024-05-21T14:46:05.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.171+0000 7f1d17e00640 1 -- 172.21.15.78:0/876621022 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d1001b070 con 0x7f1d200c5c30 2024-05-21T14:46:05.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.171+0000 7f1d17e00640 1 --2- 172.21.15.78:0/876621022 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1cfc0678f0 0x7f1cfc069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:05.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.171+0000 7f1d17e00640 1 -- 172.21.15.78:0/876621022 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f1d10085fd0 con 0x7f1d200c5c30 2024-05-21T14:46:05.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.171+0000 7f1d16a00640 1 --2- 172.21.15.78:0/876621022 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1cfc0678f0 0x7f1cfc069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:05.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.171+0000 7f1d16a00640 1 --2- 172.21.15.78:0/876621022 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1cfc0678f0 0x7f1cfc069e00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1d2015db30 tx=0x7f1d08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:05.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.175+0000 7f1d17e00640 1 -- 172.21.15.78:0/876621022 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f1d100569c0 con 0x7f1d200c5c30 2024-05-21T14:46:05.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.363+0000 7f1d26000640 1 -- 172.21.15.78:0/876621022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1d200c8780 con 0x7f1d200c5c30 2024-05-21T14:46:05.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.363+0000 7f1d17e00640 1 -- 172.21.15.78:0/876621022 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7f1d100562c0 con 0x7f1d200c5c30 2024-05-21T14:46:05.374 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-21T14:46:05.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.367+0000 7f1d26000640 1 -- 172.21.15.78:0/876621022 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1cfc0678f0 msgr2=0x7f1cfc069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:05.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.367+0000 7f1d26000640 1 --2- 172.21.15.78:0/876621022 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1cfc0678f0 0x7f1cfc069e00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1d2015db30 tx=0x7f1d08008040 comp rx=0 tx=0).stop 2024-05-21T14:46:05.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.367+0000 7f1d26000640 1 -- 172.21.15.78:0/876621022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d200c5c30 msgr2=0x7f1d2015c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:05.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.367+0000 7f1d26000640 1 --2- 172.21.15.78:0/876621022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d200c5c30 0x7f1d2015c360 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000d830 tx=0x7f1d1000dcf0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.367+0000 7f1d26000640 1 -- 172.21.15.78:0/876621022 shutdown_connections 2024-05-21T14:46:05.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.367+0000 7f1d26000640 1 --2- 172.21.15.78:0/876621022 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f1cfc0678f0 0x7f1cfc069e00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.367+0000 7f1d26000640 1 --2- 172.21.15.78:0/876621022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d200c7f90 0x7f1d2014cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.367+0000 7f1d26000640 1 --2- 172.21.15.78:0/876621022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d200c6540 0x7f1d20073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.367+0000 7f1d26000640 1 --2- 172.21.15.78:0/876621022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d200c5c30 0x7f1d2015c360 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.367+0000 7f1d26000640 1 -- 172.21.15.78:0/876621022 >> 172.21.15.78:0/876621022 conn(0x7f1d200cd1e0 msgr2=0x7f1d2014e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:05.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.367+0000 7f1d26000640 1 -- 172.21.15.78:0/876621022 shutdown_connections 2024-05-21T14:46:05.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.367+0000 7f1d26000640 1 -- 172.21.15.78:0/876621022 wait complete. 2024-05-21T14:46:05.410 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-21T14:46:05.471 INFO:tasks.ceph.mds.d.smithi084.stdout:starting mds.d at 2024-05-21T14:46:05.486 INFO:tasks.ceph.mds.f.smithi084.stdout:starting mds.f at 2024-05-21T14:46:05.487 INFO:tasks.ceph.mds.b.smithi084.stdout:starting mds.b at 2024-05-21T14:46:05.512 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2024-05-21T14:46:05.534 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-05-21T14:46:05.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.563+0000 7f23d8000640 1 Processor -- start 2024-05-21T14:46:05.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.563+0000 7f23d8000640 1 -- start start 2024-05-21T14:46:05.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.563+0000 7f23d8000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f23d00733d0 0x7f23d0071910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:05.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.563+0000 7f23d8000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f23d0160e20 0x7f23d0163240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:05.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.563+0000 7f23d8000640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23d0071e50 con 0x7f23d01527a0 2024-05-21T14:46:05.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.563+0000 7f23d8000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f23d0072980 con 0x7f23d0160e20 2024-05-21T14:46:05.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.563+0000 7f23d8000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f23d0072f40 con 0x7f23d00733d0 2024-05-21T14:46:05.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.563+0000 7f23d4c00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f23d01527a0 0x7f23d00c5440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54466/0 (socket says 172.21.15.78:54466) 2024-05-21T14:46:05.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.563+0000 7f23d4c00640 1 -- 172.21.15.78:0/1152167431 learned_addr learned my addr 172.21.15.78:0/1152167431 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:46:05.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.563+0000 7f23d5600640 1 --2- 172.21.15.78:0/1152167431 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f23d00733d0 0x7f23d0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:05.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.563+0000 7f23d6000640 1 --2- 172.21.15.78:0/1152167431 >> v2:172.21.15.84:3300/0 conn(0x7f23d0160e20 0x7f23d0163240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:05.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.563+0000 7f23d5600640 1 -- 172.21.15.78:0/1152167431 >> v2:172.21.15.84:3300/0 conn(0x7f23d0160e20 msgr2=0x7f23d0163240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:46:05.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.563+0000 7f23d5600640 1 --2- 172.21.15.78:0/1152167431 >> v2:172.21.15.84:3300/0 conn(0x7f23d0160e20 0x7f23d0163240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.563+0000 7f23d5600640 1 -- 172.21.15.78:0/1152167431 >> v1:172.21.15.78:6789/0 conn(0x7f23d01527a0 legacy=0x7f23d00c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:05.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.563+0000 7f23cfe00640 1 -- 172.21.15.78:0/1152167431 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3334127642 0 0) 0x7f23d0071e50 con 0x7f23d01527a0 2024-05-21T14:46:05.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.563+0000 7f23d5600640 1 -- 172.21.15.78:0/1152167431 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d00737e0 con 0x7f23d00733d0 2024-05-21T14:46:05.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.563+0000 7f23d6000640 1 --2- 172.21.15.78:0/1152167431 >> v2:172.21.15.84:3300/0 conn(0x7f23d0160e20 0x7f23d0163240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T14:46:05.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.567+0000 7f23d5600640 1 --2- 172.21.15.78:0/1152167431 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f23d00733d0 0x7f23d0071910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f23c40097c0 tx=0x7f23c401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8c0735642a91325 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:05.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.567+0000 7f23cfe00640 1 -- 172.21.15.78:0/1152167431 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c40b5070 con 0x7f23d00733d0 2024-05-21T14:46:05.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.567+0000 7f23cfe00640 1 -- 172.21.15.78:0/1152167431 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f23c40a8990 con 0x7f23d00733d0 2024-05-21T14:46:05.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.567+0000 7f23cfe00640 1 -- 172.21.15.78:0/1152167431 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c40a8d80 con 0x7f23d00733d0 2024-05-21T14:46:05.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.567+0000 7f23d8000640 1 -- 172.21.15.78:0/1152167431 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f23d00733d0 msgr2=0x7f23d0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:05.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.567+0000 7f23d8000640 1 --2- 172.21.15.78:0/1152167431 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f23d00733d0 0x7f23d0071910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f23c40097c0 tx=0x7f23c401ec90 comp rx=0 tx=0).stop 2024-05-21T14:46:05.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.567+0000 7f23d8000640 1 -- 172.21.15.78:0/1152167431 shutdown_connections 2024-05-21T14:46:05.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.567+0000 7f23d8000640 1 --2- 172.21.15.78:0/1152167431 >> v2:172.21.15.84:3300/0 conn(0x7f23d0160e20 0x7f23d0163240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.567+0000 7f23d8000640 1 --2- 172.21.15.78:0/1152167431 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f23d00733d0 0x7f23d0071910 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.567+0000 7f23d8000640 1 -- 172.21.15.78:0/1152167431 >> 172.21.15.78:0/1152167431 conn(0x7f23d00cd1e0 msgr2=0x7f23d00c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:05.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.567+0000 7f23d8000640 1 -- 172.21.15.78:0/1152167431 shutdown_connections 2024-05-21T14:46:05.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.567+0000 7f23d8000640 1 -- 172.21.15.78:0/1152167431 wait complete. 2024-05-21T14:46:05.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d8000640 1 Processor -- start 2024-05-21T14:46:05.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d8000640 1 -- start start 2024-05-21T14:46:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d8000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23d00733d0 0x7f23d014a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d8000640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f23d01527a0 0x7f23d00cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d8000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23d0160e20 0x7f23d00cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d8000640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f23d0074060 con 0x7f23d0160e20 2024-05-21T14:46:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d8000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f23d0073d80 con 0x7f23d00733d0 2024-05-21T14:46:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d8000640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f23d0072bd0 con 0x7f23d01527a0 2024-05-21T14:46:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d6000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23d0160e20 0x7f23d00cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d6000640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23d0160e20 0x7f23d00cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56264/0 (socket says 172.21.15.78:56264) 2024-05-21T14:46:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d6000640 1 -- 172.21.15.78:0/885124199 learned_addr learned my addr 172.21.15.78:0/885124199 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:46:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d4c00640 1 --2- 172.21.15.78:0/885124199 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f23d01527a0 0x7f23d00cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d5600640 1 --2- 172.21.15.78:0/885124199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23d00733d0 0x7f23d014a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d6000640 1 -- 172.21.15.78:0/885124199 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f23d01527a0 msgr2=0x7f23d00cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d6000640 1 --2- 172.21.15.78:0/885124199 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f23d01527a0 0x7f23d00cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d6000640 1 -- 172.21.15.78:0/885124199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23d00733d0 msgr2=0x7f23d014a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:05.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d6000640 1 --2- 172.21.15.78:0/885124199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23d00733d0 0x7f23d014a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:05.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d6000640 1 -- 172.21.15.78:0/885124199 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d01f6070 con 0x7f23d0160e20 2024-05-21T14:46:05.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.571+0000 7f23d5600640 1 --2- 172.21.15.78:0/885124199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23d00733d0 0x7f23d014a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:46:05.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.575+0000 7f23d6000640 1 --2- 172.21.15.78:0/885124199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23d0160e20 0x7f23d00cbb90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f23c8009e60 tx=0x7f23c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:05.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.575+0000 7f23cd600640 1 -- 172.21.15.78:0/885124199 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c8018030 con 0x7f23d0160e20 2024-05-21T14:46:05.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.575+0000 7f23cd600640 1 -- 172.21.15.78:0/885124199 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f23c800cdf0 con 0x7f23d0160e20 2024-05-21T14:46:05.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.575+0000 7f23cd600640 1 -- 172.21.15.78:0/885124199 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c8003be0 con 0x7f23d0160e20 2024-05-21T14:46:05.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.575+0000 7f23d8000640 1 -- 172.21.15.78:0/885124199 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d0158220 con 0x7f23d0160e20 2024-05-21T14:46:05.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.575+0000 7f23d8000640 1 -- 172.21.15.78:0/885124199 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d01f5590 con 0x7f23d0160e20 2024-05-21T14:46:05.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.575+0000 7f23d8000640 1 -- 172.21.15.78:0/885124199 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d0157f40 con 0x7f23d0160e20 2024-05-21T14:46:05.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.575+0000 7f23cd600640 1 -- 172.21.15.78:0/885124199 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f23c801b070 con 0x7f23d0160e20 2024-05-21T14:46:05.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.575+0000 7f23cd600640 1 --2- 172.21.15.78:0/885124199 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f23b00678c0 0x7f23b0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:05.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.575+0000 7f23cd600640 1 -- 172.21.15.78:0/885124199 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6168+0+0 (secure 0 0 0) 0x7f23c8086820 con 0x7f23d0160e20 2024-05-21T14:46:05.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.575+0000 7f23d5600640 1 --2- 172.21.15.78:0/885124199 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f23b00678c0 0x7f23b0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.579+0000 7f23d5600640 1 --2- 172.21.15.78:0/885124199 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f23b00678c0 0x7f23b0069dd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f23c40b2000 tx=0x7f23c40aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:05.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.579+0000 7f23cd600640 1 -- 172.21.15.78:0/885124199 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f23c8010040 con 0x7f23d0160e20 2024-05-21T14:46:05.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:05.771+0000 7f23d8000640 1 -- 172.21.15.78:0/885124199 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f23d006f810 con 0x7f23d0160e20 2024-05-21T14:46:06.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.367+0000 7f23cd600640 1 -- 172.21.15.78:0/885124199 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7f23c80570f0 con 0x7f23d0160e20 2024-05-21T14:46:06.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.367+0000 7f23d8000640 1 -- 172.21.15.78:0/885124199 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f23b00678c0 msgr2=0x7f23b0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:06.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.367+0000 7f23d8000640 1 --2- 172.21.15.78:0/885124199 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f23b00678c0 0x7f23b0069dd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f23c40b2000 tx=0x7f23c40aa070 comp rx=0 tx=0).stop 2024-05-21T14:46:06.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.367+0000 7f23d8000640 1 -- 172.21.15.78:0/885124199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23d0160e20 msgr2=0x7f23d00cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:06.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.367+0000 7f23d8000640 1 --2- 172.21.15.78:0/885124199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23d0160e20 0x7f23d00cbb90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f23c8009e60 tx=0x7f23c800c490 comp rx=0 tx=0).stop 2024-05-21T14:46:06.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.367+0000 7f23d8000640 1 -- 172.21.15.78:0/885124199 shutdown_connections 2024-05-21T14:46:06.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.367+0000 7f23d8000640 1 --2- 172.21.15.78:0/885124199 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f23b00678c0 0x7f23b0069dd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:06.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.367+0000 7f23d8000640 1 --2- 172.21.15.78:0/885124199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23d0160e20 0x7f23d00cbb90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:06.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.367+0000 7f23d8000640 1 --2- 172.21.15.78:0/885124199 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f23d01527a0 0x7f23d00cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:06.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.367+0000 7f23d8000640 1 --2- 172.21.15.78:0/885124199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23d00733d0 0x7f23d014a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:06.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.367+0000 7f23d8000640 1 -- 172.21.15.78:0/885124199 >> 172.21.15.78:0/885124199 conn(0x7f23d00cd1e0 msgr2=0x7f23d0147490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:06.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.371+0000 7f23d8000640 1 -- 172.21.15.78:0/885124199 shutdown_connections 2024-05-21T14:46:06.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.371+0000 7f23d8000640 1 -- 172.21.15.78:0/885124199 wait complete. 2024-05-21T14:46:06.401 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-21T14:46:06.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.543+0000 7f2574800640 1 Processor -- start 2024-05-21T14:46:06.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.543+0000 7f2574800640 1 -- start start 2024-05-21T14:46:06.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.547+0000 7f2574800640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f256c153520 0x7f256c0c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:06.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.547+0000 7f2574800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f256c0c6460 0x7f256c163df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:06.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.547+0000 7f2574800640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f256c15ce70 con 0x7f256c15ca60 2024-05-21T14:46:06.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.547+0000 7f2574800640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f256c153930 con 0x7f256c153520 2024-05-21T14:46:06.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.547+0000 7f2574800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f256c072140 con 0x7f256c0c6460 2024-05-21T14:46:06.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.547+0000 7f2571400640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f256c153520 0x7f256c0c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:06.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.547+0000 7f2571e00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f256c15ca60 0x7f256c073e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:54472/0 (socket says 172.21.15.78:54472) 2024-05-21T14:46:06.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.547+0000 7f2571e00640 1 -- 172.21.15.78:0/1773168111 learned_addr learned my addr 172.21.15.78:0/1773168111 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-05-21T14:46:06.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.547+0000 7f2572800640 1 --2- 172.21.15.78:0/1773168111 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f256c0c6460 0x7f256c163df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:06.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.547+0000 7f2571400640 1 -- 172.21.15.78:0/1773168111 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f256c0c6460 msgr2=0x7f256c163df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:46:06.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.547+0000 7f2571400640 1 --2- 172.21.15.78:0/1773168111 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f256c0c6460 0x7f256c163df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:06.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.547+0000 7f2571400640 1 -- 172.21.15.78:0/1773168111 >> v1:172.21.15.78:6789/0 conn(0x7f256c15ca60 legacy=0x7f256c073e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:06.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.547+0000 7f2571400640 1 -- 172.21.15.78:0/1773168111 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256c072400 con 0x7f256c153520 2024-05-21T14:46:06.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.547+0000 7f2570a00640 1 -- 172.21.15.78:0/1773168111 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 815116445 0 0) 0x7f2560001120 con 0x7f256c15ca60 2024-05-21T14:46:06.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.547+0000 7f2571400640 1 --2- 172.21.15.78:0/1773168111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256c153520 0x7f256c0c5f20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f255c0097c0 tx=0x7f255c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445aaa31a74dd385 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:06.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.551+0000 7f2570a00640 1 -- 172.21.15.78:0/1773168111 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0b5070 con 0x7f256c153520 2024-05-21T14:46:06.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.551+0000 7f2570a00640 1 -- 172.21.15.78:0/1773168111 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f255c0a8990 con 0x7f256c153520 2024-05-21T14:46:06.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.551+0000 7f2570a00640 1 -- 172.21.15.78:0/1773168111 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0a8d80 con 0x7f256c153520 2024-05-21T14:46:06.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.551+0000 7f2574800640 1 -- 172.21.15.78:0/1773168111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256c153520 msgr2=0x7f256c0c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:06.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.551+0000 7f2574800640 1 --2- 172.21.15.78:0/1773168111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256c153520 0x7f256c0c5f20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f255c0097c0 tx=0x7f255c01ec90 comp rx=0 tx=0).stop 2024-05-21T14:46:06.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.551+0000 7f2574800640 1 -- 172.21.15.78:0/1773168111 shutdown_connections 2024-05-21T14:46:06.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.551+0000 7f2574800640 1 --2- 172.21.15.78:0/1773168111 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f256c0c6460 0x7f256c163df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:06.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.551+0000 7f2574800640 1 --2- 172.21.15.78:0/1773168111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256c153520 0x7f256c0c5f20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:06.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.551+0000 7f2574800640 1 -- 172.21.15.78:0/1773168111 >> 172.21.15.78:0/1773168111 conn(0x7f256c0cd1d0 msgr2=0x7f256c0c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:06.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.551+0000 7f2574800640 1 -- 172.21.15.78:0/1773168111 shutdown_connections 2024-05-21T14:46:06.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.551+0000 7f2574800640 1 -- 172.21.15.78:0/1773168111 wait complete. 2024-05-21T14:46:06.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.551+0000 7f2574800640 1 Processor -- start 2024-05-21T14:46:06.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.551+0000 7f2574800640 1 -- start start 2024-05-21T14:46:06.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2574800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f256c0c6460 0x7f256c0c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:06.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2574800640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256c153520 0x7f256c155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:06.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2574800640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f256c15ca60 0x7f256c15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:06.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2574800640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f256c159aa0 con 0x7f256c153520 2024-05-21T14:46:06.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2574800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f256c1597c0 con 0x7f256c0c6460 2024-05-21T14:46:06.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2574800640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f256c074520 con 0x7f256c15ca60 2024-05-21T14:46:06.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2571400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256c153520 0x7f256c155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:06.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2571400640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256c153520 0x7f256c155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56282/0 (socket says 172.21.15.78:56282) 2024-05-21T14:46:06.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2571400640 1 -- 172.21.15.78:0/4237663994 learned_addr learned my addr 172.21.15.78:0/4237663994 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:46:06.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2572800640 1 --2- 172.21.15.78:0/4237663994 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f256c15ca60 0x7f256c15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:06.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2571e00640 1 --2- 172.21.15.78:0/4237663994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f256c0c6460 0x7f256c0c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:06.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2571400640 1 -- 172.21.15.78:0/4237663994 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f256c15ca60 msgr2=0x7f256c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:06.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2571400640 1 --2- 172.21.15.78:0/4237663994 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f256c15ca60 0x7f256c15d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:06.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2571400640 1 -- 172.21.15.78:0/4237663994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f256c0c6460 msgr2=0x7f256c0c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:06.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2571400640 1 --2- 172.21.15.78:0/4237663994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f256c0c6460 0x7f256c0c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:06.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2571400640 1 -- 172.21.15.78:0/4237663994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256c0c4e40 con 0x7f256c153520 2024-05-21T14:46:06.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2572800640 1 --2- 172.21.15.78:0/4237663994 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f256c15ca60 0x7f256c15d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:46:06.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2571e00640 1 --2- 172.21.15.78:0/4237663994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f256c0c6460 0x7f256c0c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:46:06.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2571400640 1 --2- 172.21.15.78:0/4237663994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256c153520 0x7f256c155c40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f255c0b3040 tx=0x7f255c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:06.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2566000640 1 -- 172.21.15.78:0/4237663994 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0c0070 con 0x7f256c153520 2024-05-21T14:46:06.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2566000640 1 -- 172.21.15.78:0/4237663994 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f255c004230 con 0x7f256c153520 2024-05-21T14:46:06.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2574800640 1 -- 172.21.15.78:0/4237663994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256c154720 con 0x7f256c153520 2024-05-21T14:46:06.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2566000640 1 -- 172.21.15.78:0/4237663994 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0b5040 con 0x7f256c153520 2024-05-21T14:46:06.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2574800640 1 -- 172.21.15.78:0/4237663994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f256c154ce0 con 0x7f256c153520 2024-05-21T14:46:06.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.555+0000 7f2574800640 1 -- 172.21.15.78:0/4237663994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f256c04f730 con 0x7f256c153520 2024-05-21T14:46:06.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.559+0000 7f2566000640 1 -- 172.21.15.78:0/4237663994 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f255c0c3070 con 0x7f256c153520 2024-05-21T14:46:06.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.559+0000 7f2566000640 1 --2- 172.21.15.78:0/4237663994 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f25500678c0 0x7f2550069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:06.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.559+0000 7f2566000640 1 -- 172.21.15.78:0/4237663994 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6168+0+0 (secure 0 0 0) 0x7f255c122ad0 con 0x7f256c153520 2024-05-21T14:46:06.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.559+0000 7f2571e00640 1 --2- 172.21.15.78:0/4237663994 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f25500678c0 0x7f2550069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:06.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.559+0000 7f2571e00640 1 --2- 172.21.15.78:0/4237663994 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f25500678c0 0x7f2550069dd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2560000f70 tx=0x7f2560007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:06.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.563+0000 7f2566000640 1 -- 172.21.15.78:0/4237663994 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f255c0187f0 con 0x7f256c153520 2024-05-21T14:46:06.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:06.727+0000 7f2574800640 1 -- 172.21.15.78:0/4237663994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f256c0c7d20 con 0x7f256c153520 2024-05-21T14:46:07.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.375+0000 7f2566000640 1 -- 172.21.15.78:0/4237663994 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) ==== 181+0+0 (secure 0 0 0) 0x7f255c122020 con 0x7f256c153520 2024-05-21T14:46:07.384 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2024-05-21T14:46:07.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.379+0000 7f2574800640 1 -- 172.21.15.78:0/4237663994 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f25500678c0 msgr2=0x7f2550069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:07.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.379+0000 7f2574800640 1 --2- 172.21.15.78:0/4237663994 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f25500678c0 0x7f2550069dd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2560000f70 tx=0x7f2560007cb0 comp rx=0 tx=0).stop 2024-05-21T14:46:07.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.379+0000 7f2574800640 1 -- 172.21.15.78:0/4237663994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256c153520 msgr2=0x7f256c155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:07.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.379+0000 7f2574800640 1 --2- 172.21.15.78:0/4237663994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256c153520 0x7f256c155c40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f255c0b3040 tx=0x7f255c01ba30 comp rx=0 tx=0).stop 2024-05-21T14:46:07.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.379+0000 7f2574800640 1 -- 172.21.15.78:0/4237663994 shutdown_connections 2024-05-21T14:46:07.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.379+0000 7f2574800640 1 --2- 172.21.15.78:0/4237663994 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f25500678c0 0x7f2550069dd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:07.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.379+0000 7f2574800640 1 --2- 172.21.15.78:0/4237663994 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f256c15ca60 0x7f256c15d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:07.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.379+0000 7f2574800640 1 --2- 172.21.15.78:0/4237663994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256c153520 0x7f256c155c40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:07.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.379+0000 7f2574800640 1 --2- 172.21.15.78:0/4237663994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f256c0c6460 0x7f256c0c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:07.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.379+0000 7f2574800640 1 -- 172.21.15.78:0/4237663994 >> 172.21.15.78:0/4237663994 conn(0x7f256c0cd1d0 msgr2=0x7f256c1514c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:07.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.379+0000 7f2574800640 1 -- 172.21.15.78:0/4237663994 shutdown_connections 2024-05-21T14:46:07.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.379+0000 7f2574800640 1 -- 172.21.15.78:0/4237663994 wait complete. 2024-05-21T14:46:07.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-21T14:46:07.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.551+0000 7f49d6c00640 1 Processor -- start 2024-05-21T14:46:07.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.551+0000 7f49d6c00640 1 -- start start 2024-05-21T14:46:07.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.551+0000 7f49d6c00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49d015ca60 0x7f49d0153520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:07.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.551+0000 7f49d6c00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49d0073e10 0x7f49d0074220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:07.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.551+0000 7f49d6c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49d00c5f20 0x7f49d00c6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:07.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.551+0000 7f49d6c00640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 -- 0x7f49d015ce70 con 0x7f49d015ca60 2024-05-21T14:46:07.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.551+0000 7f49d6c00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f49d0072140 con 0x7f49d0073e10 2024-05-21T14:46:07.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.551+0000 7f49d6c00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f49d0072400 con 0x7f49d00c5f20 2024-05-21T14:46:07.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.555+0000 7f49cfe00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49d015ca60 0x7f49d0153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:07.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.555+0000 7f49cfe00640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49d015ca60 0x7f49d0153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56292/0 (socket says 172.21.15.78:56292) 2024-05-21T14:46:07.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.555+0000 7f49cfe00640 1 -- 172.21.15.78:0/3442468863 learned_addr learned my addr 172.21.15.78:0/3442468863 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:46:07.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.555+0000 7f49d4c00640 1 --2- 172.21.15.78:0/3442468863 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49d00c5f20 0x7f49d00c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:07.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.555+0000 7f49c7e00640 1 --2- 172.21.15.78:0/3442468863 >> v2:172.21.15.84:3300/0 conn(0x7f49d0073e10 0x7f49d0074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:07.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.555+0000 7f49cfe00640 1 -- 172.21.15.78:0/3442468863 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49d00c5f20 msgr2=0x7f49d00c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:46:07.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.555+0000 7f49cfe00640 1 --2- 172.21.15.78:0/3442468863 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49d00c5f20 0x7f49d00c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:07.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.555+0000 7f49cfe00640 1 -- 172.21.15.78:0/3442468863 >> v2:172.21.15.84:3300/0 conn(0x7f49d0073e10 msgr2=0x7f49d0074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T14:46:07.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.555+0000 7f49cfe00640 1 --2- 172.21.15.78:0/3442468863 >> v2:172.21.15.84:3300/0 conn(0x7f49d0073e10 0x7f49d0074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:07.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.555+0000 7f49cfe00640 1 -- 172.21.15.78:0/3442468863 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d00726e0 con 0x7f49d015ca60 2024-05-21T14:46:07.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.555+0000 7f49cfe00640 1 --2- 172.21.15.78:0/3442468863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49d015ca60 0x7f49d0153520 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f49d006c800 tx=0x7f49c001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa820b44755f2265 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:07.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.555+0000 7f49cf400640 1 -- 172.21.15.78:0/3442468863 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c00b5070 con 0x7f49d015ca60 2024-05-21T14:46:07.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.555+0000 7f49cf400640 1 -- 172.21.15.78:0/3442468863 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f49c00a89d0 con 0x7f49d015ca60 2024-05-21T14:46:07.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.555+0000 7f49cf400640 1 -- 172.21.15.78:0/3442468863 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c00a8dc0 con 0x7f49d015ca60 2024-05-21T14:46:07.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.559+0000 7f49d6c00640 1 -- 172.21.15.78:0/3442468863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49d015ca60 msgr2=0x7f49d0153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:07.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.559+0000 7f49d6c00640 1 --2- 172.21.15.78:0/3442468863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49d015ca60 0x7f49d0153520 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f49d006c800 tx=0x7f49c001ed10 comp rx=0 tx=0).stop 2024-05-21T14:46:07.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.559+0000 7f49d6c00640 1 -- 172.21.15.78:0/3442468863 shutdown_connections 2024-05-21T14:46:07.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.559+0000 7f49d6c00640 1 --2- 172.21.15.78:0/3442468863 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49d00c5f20 0x7f49d00c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:07.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.559+0000 7f49d6c00640 1 --2- 172.21.15.78:0/3442468863 >> v2:172.21.15.84:3300/0 conn(0x7f49d0073e10 0x7f49d0074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:07.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.559+0000 7f49d6c00640 1 --2- 172.21.15.78:0/3442468863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49d015ca60 0x7f49d0153520 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:07.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.559+0000 7f49d6c00640 1 -- 172.21.15.78:0/3442468863 >> 172.21.15.78:0/3442468863 conn(0x7f49d00cd1d0 msgr2=0x7f49d00c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:07.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.559+0000 7f49d6c00640 1 -- 172.21.15.78:0/3442468863 shutdown_connections 2024-05-21T14:46:07.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.559+0000 7f49d6c00640 1 -- 172.21.15.78:0/3442468863 wait complete. 2024-05-21T14:46:07.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.559+0000 7f49d6c00640 1 Processor -- start 2024-05-21T14:46:07.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.559+0000 7f49d6c00640 1 -- start start 2024-05-21T14:46:07.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d6c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49d0073e10 0x7f49d00cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:07.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d6c00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49d00c5f20 0x7f49d00ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:07.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d6c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49d015ca60 0x7f49d0147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:07.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d6c00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f49d0073830 con 0x7f49d015ca60 2024-05-21T14:46:07.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d6c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f49d0159aa0 con 0x7f49d0073e10 2024-05-21T14:46:07.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d6c00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f49d0159470 con 0x7f49d00c5f20 2024-05-21T14:46:07.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d4c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49d015ca60 0x7f49d0147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:07.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d4c00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49d015ca60 0x7f49d0147610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56306/0 (socket says 172.21.15.78:56306) 2024-05-21T14:46:07.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d4c00640 1 -- 172.21.15.78:0/1904500791 learned_addr learned my addr 172.21.15.78:0/1904500791 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-05-21T14:46:07.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49cfe00640 1 --2- 172.21.15.78:0/1904500791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49d0073e10 0x7f49d00cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:07.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49c7e00640 1 --2- 172.21.15.78:0/1904500791 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49d00c5f20 0x7f49d00ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:07.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d4c00640 1 -- 172.21.15.78:0/1904500791 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49d00c5f20 msgr2=0x7f49d00ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:07.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d4c00640 1 --2- 172.21.15.78:0/1904500791 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49d00c5f20 0x7f49d00ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:07.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d4c00640 1 -- 172.21.15.78:0/1904500791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49d0073e10 msgr2=0x7f49d00cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:07.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d4c00640 1 --2- 172.21.15.78:0/1904500791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49d0073e10 0x7f49d00cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:07.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d4c00640 1 -- 172.21.15.78:0/1904500791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d015ba10 con 0x7f49d015ca60 2024-05-21T14:46:07.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49c7e00640 1 --2- 172.21.15.78:0/1904500791 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49d00c5f20 0x7f49d00ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T14:46:07.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d4c00640 1 --2- 172.21.15.78:0/1904500791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49d015ca60 0x7f49d0147610 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009fd0 tx=0x7f49c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:07.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49ccc00640 1 -- 172.21.15.78:0/1904500791 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8014420 con 0x7f49d015ca60 2024-05-21T14:46:07.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49ccc00640 1 -- 172.21.15.78:0/1904500791 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f49c8019070 con 0x7f49d015ca60 2024-05-21T14:46:07.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d6c00640 1 -- 172.21.15.78:0/1904500791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d015bcf0 con 0x7f49d015ca60 2024-05-21T14:46:07.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49ccc00640 1 -- 172.21.15.78:0/1904500791 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8014820 con 0x7f49d015ca60 2024-05-21T14:46:07.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d6c00640 1 -- 172.21.15.78:0/1904500791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d0147b50 con 0x7f49d015ca60 2024-05-21T14:46:07.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49d6c00640 1 -- 172.21.15.78:0/1904500791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d015bec0 con 0x7f49d015ca60 2024-05-21T14:46:07.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.563+0000 7f49ccc00640 1 -- 172.21.15.78:0/1904500791 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f49c80149c0 con 0x7f49d015ca60 2024-05-21T14:46:07.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.567+0000 7f49ccc00640 1 --2- 172.21.15.78:0/1904500791 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f49ac0678f0 0x7f49ac069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T14:46:07.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.567+0000 7f49ccc00640 1 -- 172.21.15.78:0/1904500791 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5730+0+0 (secure 0 0 0) 0x7f49c80864b0 con 0x7f49d015ca60 2024-05-21T14:46:07.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.567+0000 7f49cfe00640 1 --2- 172.21.15.78:0/1904500791 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f49ac0678f0 0x7f49ac069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T14:46:07.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.567+0000 7f49cfe00640 1 --2- 172.21.15.78:0/1904500791 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f49ac0678f0 0x7f49ac069e00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f49c00b2000 tx=0x7f49c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T14:46:07.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.571+0000 7f49ccc00640 1 -- 172.21.15.78:0/1904500791 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177847 (secure 0 0 0) 0x7f49c8056f30 con 0x7f49d015ca60 2024-05-21T14:46:07.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:07.739+0000 7f49d6c00640 1 -- 172.21.15.78:0/1904500791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f49d004f730 con 0x7f49d015ca60 2024-05-21T14:46:08.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:08.375+0000 7f49ccc00640 1 -- 172.21.15.78:0/1904500791 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) ==== 169+0+0 (secure 0 0 0) 0x7f49c8056830 con 0x7f49d015ca60 2024-05-21T14:46:08.386 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2024-05-21T14:46:08.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:08.379+0000 7f49d6c00640 1 -- 172.21.15.78:0/1904500791 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f49ac0678f0 msgr2=0x7f49ac069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:08.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:08.379+0000 7f49d6c00640 1 --2- 172.21.15.78:0/1904500791 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f49ac0678f0 0x7f49ac069e00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f49c00b2000 tx=0x7f49c0009040 comp rx=0 tx=0).stop 2024-05-21T14:46:08.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:08.379+0000 7f49d6c00640 1 -- 172.21.15.78:0/1904500791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49d015ca60 msgr2=0x7f49d0147610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T14:46:08.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:08.379+0000 7f49d6c00640 1 --2- 172.21.15.78:0/1904500791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49d015ca60 0x7f49d0147610 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009fd0 tx=0x7f49c800e4b0 comp rx=0 tx=0).stop 2024-05-21T14:46:08.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:08.379+0000 7f49d6c00640 1 -- 172.21.15.78:0/1904500791 shutdown_connections 2024-05-21T14:46:08.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:08.379+0000 7f49d6c00640 1 --2- 172.21.15.78:0/1904500791 >> [v2:172.21.15.84:6832/3203955676,v1:172.21.15.84:6833/3203955676] conn(0x7f49ac0678f0 0x7f49ac069e00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:08.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:08.379+0000 7f49d6c00640 1 --2- 172.21.15.78:0/1904500791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49d015ca60 0x7f49d0147610 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:08.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:08.379+0000 7f49d6c00640 1 --2- 172.21.15.78:0/1904500791 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f49d00c5f20 0x7f49d00ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:08.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:08.379+0000 7f49d6c00640 1 --2- 172.21.15.78:0/1904500791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49d0073e10 0x7f49d00cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T14:46:08.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:08.379+0000 7f49d6c00640 1 -- 172.21.15.78:0/1904500791 >> 172.21.15.78:0/1904500791 conn(0x7f49d00cd1d0 msgr2=0x7f49d0150370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T14:46:08.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:08.379+0000 7f49d6c00640 1 -- 172.21.15.78:0/1904500791 shutdown_connections 2024-05-21T14:46:08.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-05-21T14:46:08.379+0000 7f49d6c00640 1 -- 172.21.15.78:0/1904500791 wait complete. 2024-05-21T14:46:08.415 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-21T14:46:08.415 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-21T14:46:08.415 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:08.433 INFO:tasks.ceph.mds.a:Stopped 2024-05-21T14:46:08.434 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-21T14:46:08.434 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:08.491 INFO:tasks.ceph.mds.c:Stopped 2024-05-21T14:46:08.491 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-05-21T14:46:08.492 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:08.545 INFO:tasks.ceph.mds.e:Stopped 2024-05-21T14:46:08.545 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-21T14:46:08.545 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:08.565 INFO:tasks.ceph.mds.b:Stopped 2024-05-21T14:46:08.565 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-21T14:46:08.565 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:08.625 INFO:tasks.ceph.mds.d:Stopped 2024-05-21T14:46:08.625 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-05-21T14:46:08.625 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:08.687 INFO:tasks.ceph.mds.f:Stopped 2024-05-21T14:46:08.688 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-21T14:46:08.688 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-21T14:46:08.688 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:08.749 INFO:tasks.ceph.osd.0:Stopped 2024-05-21T14:46:08.750 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-21T14:46:08.750 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:08.822 INFO:tasks.ceph.osd.1:Stopped 2024-05-21T14:46:08.822 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-21T14:46:08.822 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:13.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-05-21T14:46:14.924 INFO:tasks.ceph.osd.2:Stopped 2024-05-21T14:46:14.924 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-21T14:46:14.924 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:14.991 INFO:tasks.ceph.osd.3:Stopped 2024-05-21T14:46:14.992 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-21T14:46:14.992 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:15.078 INFO:tasks.ceph.osd.4:Stopped 2024-05-21T14:46:15.078 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-21T14:46:15.079 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:15.158 INFO:tasks.ceph.osd.5:Stopped 2024-05-21T14:46:15.158 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-21T14:46:15.158 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:15.221 INFO:tasks.ceph.osd.6:Stopped 2024-05-21T14:46:15.222 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-21T14:46:15.222 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:15.321 INFO:tasks.ceph.osd.7:Stopped 2024-05-21T14:46:15.321 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-21T14:46:15.321 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-21T14:46:15.322 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:15.374 INFO:tasks.ceph.mgr.y:Stopped 2024-05-21T14:46:15.375 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-21T14:46:15.375 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:15.405 INFO:tasks.ceph.mgr.x:Stopped 2024-05-21T14:46:15.405 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-21T14:46:15.405 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-21T14:46:15.406 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:15.423 INFO:tasks.ceph.mon.a:Stopped 2024-05-21T14:46:15.423 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-21T14:46:15.423 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:15.467 INFO:tasks.ceph.mon.b:Stopped 2024-05-21T14:46:15.467 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-21T14:46:15.467 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T14:46:15.525 INFO:tasks.ceph.mon.c:Stopped 2024-05-21T14:46:15.526 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-21T14:46:15.526 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'Replacing daemon mds' | head -n 1 2024-05-21T14:46:15.570 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi078.front.sepia.ceph.com 2024-05-21T14:46:15.570 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-21T14:46:15.932 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi078.front.sepia.ceph.com 2024-05-21T14:46:15.932 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-21T14:46:16.113 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi078.front.sepia.ceph.com 2024-05-21T14:46:16.113 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-21T14:46:16.318 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi078.front.sepia.ceph.com 2024-05-21T14:46:16.318 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-21T14:46:16.503 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi084.front.sepia.ceph.com 2024-05-21T14:46:16.503 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-21T14:46:16.853 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi084.front.sepia.ceph.com 2024-05-21T14:46:16.853 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-21T14:46:17.055 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi084.front.sepia.ceph.com 2024-05-21T14:46:17.055 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-21T14:46:17.245 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi084.front.sepia.ceph.com 2024-05-21T14:46:17.246 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-21T14:46:17.423 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:46:17.427 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:46:17.437 INFO:tasks.ceph:Archiving mon data... 2024-05-21T14:46:17.438 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7718553/data/mon.a.tgz 2024-05-21T14:46:17.439 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-05-21T14:46:17.521 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.czF6qG3F2L 2024-05-21T14:46:17.522 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.czF6qG3F2L 2024-05-21T14:46:17.636 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.czF6qG3F2L 2024-05-21T14:46:17.711 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.czF6qG3F2L is 286KB 2024-05-21T14:46:17.772 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.czF6qG3F2L 2024-05-21T14:46:17.781 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7718553/data/mon.b.tgz 2024-05-21T14:46:17.781 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-05-21T14:46:17.786 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.0GX2LPtEZh 2024-05-21T14:46:17.787 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.0GX2LPtEZh 2024-05-21T14:46:17.920 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.0GX2LPtEZh 2024-05-21T14:46:17.983 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.0GX2LPtEZh is 386KB 2024-05-21T14:46:18.040 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.0GX2LPtEZh 2024-05-21T14:46:18.045 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7718553/data/mon.c.tgz 2024-05-21T14:46:18.045 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-05-21T14:46:18.090 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.lNWVc41ZoG 2024-05-21T14:46:18.091 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.lNWVc41ZoG 2024-05-21T14:46:18.210 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-05-21T14:46:18.222 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.lNWVc41ZoG 2024-05-21T14:46:18.291 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.lNWVc41ZoG is 386KB 2024-05-21T14:46:18.352 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.lNWVc41ZoG 2024-05-21T14:46:18.358 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-21T14:46:18.358 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-21T14:46:18.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-21T14:46:18.430 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-21T14:46:18.463 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-21T14:46:18.463 INFO:tasks.ceph:Archiving crash dumps... 2024-05-21T14:46:18.465 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7718553/remote/smithi078/crash 2024-05-21T14:46:18.466 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-21T14:46:18.498 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7718553/remote/smithi084/crash 2024-05-21T14:46:18.499 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-21T14:46:18.519 INFO:tasks.ceph:Shutting down logrotate 2024-05-21T14:46:18.519 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:46:18.545 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T14:46:18.601 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-21T14:46:18.621 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-21T14:46:18.654 INFO:tasks.ceph:Compressing logs... 2024-05-21T14:46:18.654 DEBUG:teuthology.orchestra.run.smithi078:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-21T14:46:18.665 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-21T14:46:18.701 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32477.log 2024-05-21T14:46:18.702 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34289.log 2024-05-21T14:46:18.702 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34133.log 2024-05-21T14:46:18.703 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34289.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32477.log.gz 2024-05-21T14:46:18.704 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-21T14:46:18.704 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34289.log.gz 2024-05-21T14:46:18.704 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34367.log 2024-05-21T14:46:18.704 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34133.log.gz 2024-05-21T14:46:18.705 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34737.log 2024-05-21T14:46:18.706 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32525.log 2024-05-21T14:46:18.706 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34367.log.gz 2024-05-21T14:46:18.706 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33209.log 2024-05-21T14:46:18.707 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34737.log.gz 2024-05-21T14:46:18.707 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32947.log 2024-05-21T14:46:18.708 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32525.log.gz 2024-05-21T14:46:18.708 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35429.log 2024-05-21T14:46:18.708 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33209.log.gz 2024-05-21T14:46:18.708 INFO:teuthology.orchestra.run.smithi078.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-21T14:46:18.709 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32947.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-21T14:46:18.709 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32947.log.gz 2024-05-21T14:46:18.710 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31913.log 2024-05-21T14:46:18.710 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35429.log.gz 2024-05-21T14:46:18.711 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32731.log 2024-05-21T14:46:18.712 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.31913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32130.log 2024-05-21T14:46:18.712 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31913.log.gz 2024-05-21T14:46:18.712 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34013.log 2024-05-21T14:46:18.713 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32731.log.gz 2024-05-21T14:46:18.713 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28690.log 2024-05-21T14:46:18.714 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33347.log 2024-05-21T14:46:18.714 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32130.log.gz 2024-05-21T14:46:18.714 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.34013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34013.log.gz 2024-05-21T14:46:18.716 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31968.log 2024-05-21T14:46:18.716 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32737.log 2024-05-21T14:46:18.716 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33347.log.gz 2024-05-21T14:46:18.717 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-21T14:46:18.718 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.28690.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-21T14:46:18.718 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.28690.log.gz 2024-05-21T14:46:18.718 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-21T14:46:18.718 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28546.log 2024-05-21T14:46:18.718 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28594.log 2024-05-21T14:46:18.718 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.28546.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-21T14:46:18.718 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28546.log.gz 2024-05-21T14:46:18.718 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.28594.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-05-21T14:46:18.718 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-21T14:46:18.718 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28594.log.gz 2024-05-21T14:46:18.718 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-21T14:46:18.718 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mds.f.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28570.log 2024-05-21T14:46:18.721 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-21T14:46:18.721 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.28570.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.28570.log.gz 2024-05-21T14:46:18.721 INFO:teuthology.orchestra.run.smithi084.stderr: 91.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-21T14:46:18.721 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-21T14:46:18.721 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28618.log 2024-05-21T14:46:18.724 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.31968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32425.log 2024-05-21T14:46:18.724 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31968.log.gz 2024-05-21T14:46:18.724 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35351.log 2024-05-21T14:46:18.724 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32737.log.gz 2024-05-21T14:46:18.724 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34685.log 2024-05-21T14:46:18.724 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32425.log.gz 2024-05-21T14:46:18.724 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34341.log 2024-05-21T14:46:18.724 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35351.log.gz 2024-05-21T14:46:18.724 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32526.log 2024-05-21T14:46:18.724 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34685.log.gz 2024-05-21T14:46:18.724 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31737.log 2024-05-21T14:46:18.724 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34341.log.gz 2024-05-21T14:46:18.724 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32321.log 2024-05-21T14:46:18.725 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32526.log.gz 2024-05-21T14:46:18.725 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.31737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33610.log 2024-05-21T14:46:18.725 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31737.log.gz 2024-05-21T14:46:18.725 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33261.log 2024-05-21T14:46:18.725 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32321.log.gz 2024-05-21T14:46:18.725 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32919.log 2024-05-21T14:46:18.725 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33610.log.gz 2024-05-21T14:46:18.728 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mds.d.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-21T14:46:18.728 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28666.log 2024-05-21T14:46:18.728 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.28618.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28618.log.gz 2024-05-21T14:46:18.728 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-21T14:46:18.728 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.28666.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28666.log.gz 2024-05-21T14:46:18.728 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-21T14:46:18.729 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34960.log 2024-05-21T14:46:18.729 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33261.log.gz 2024-05-21T14:46:18.729 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32919.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-21T14:46:18.729 INFO:teuthology.orchestra.run.smithi078.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32919.log.gz 2024-05-21T14:46:18.729 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33532.log 2024-05-21T14:46:18.729 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34960.log.gz 2024-05-21T14:46:18.730 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34497.log 2024-05-21T14:46:18.730 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33789.log 2024-05-21T14:46:18.730 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33532.log.gz 2024-05-21T14:46:18.730 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34497.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-21T14:46:18.730 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34497.log.gz 2024-05-21T14:46:18.730 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32736.log 2024-05-21T14:46:18.731 INFO:teuthology.orchestra.run.smithi078.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.33789.log.gz 2024-05-21T14:46:18.731 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32738.log 2024-05-21T14:46:18.732 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32941.log 2024-05-21T14:46:18.732 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32736.log: /var/log/ceph/ceph-client.admin.32738.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32736.log.gz 2024-05-21T14:46:18.733 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32738.log.gz 2024-05-21T14:46:18.733 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33235.log 2024-05-21T14:46:18.734 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.32941.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35403.log 2024-05-21T14:46:18.734 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-21T14:46:18.735 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32941.log.gz 2024-05-21T14:46:18.735 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34107.log 2024-05-21T14:46:18.735 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33235.log.gz 2024-05-21T14:46:18.736 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34445.log 2024-05-21T14:46:18.736 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35403.log.gz 2024-05-21T14:46:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34856.log 2024-05-21T14:46:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34445.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34107.log.gz 2024-05-21T14:46:18.738 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34185.log 2024-05-21T14:46:18.738 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34445.log.gz 2024-05-21T14:46:18.739 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31994.log 2024-05-21T14:46:18.739 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34856.log.gz 2024-05-21T14:46:18.740 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35481.log 2024-05-21T14:46:18.741 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34185.log.gz 2024-05-21T14:46:18.741 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.31994.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31994.log.gz 2024-05-21T14:46:18.741 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33373.log 2024-05-21T14:46:18.742 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.35481.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32943.log 2024-05-21T14:46:18.747 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mon.b.log: 92.0% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-05-21T14:46:18.747 INFO:teuthology.orchestra.run.smithi084.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-21T14:46:18.747 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28522.log 2024-05-21T14:46:18.748 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35481.log.gz 2024-05-21T14:46:18.748 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34159.log 2024-05-21T14:46:18.748 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33373.log.gz 2024-05-21T14:46:18.748 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34908.log 2024-05-21T14:46:18.748 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32943.log.gz 2024-05-21T14:46:18.748 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.34159.log: -- /var/log/ceph/ceph-client.admin.32102.log 2024-05-21T14:46:18.748 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5%/var/log/ceph/ceph-client.admin.34908.log: -- replaced with /var/log/ceph/ceph-client.admin.34159.log.gz 2024-05-21T14:46:18.748 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34471.log 2024-05-21T14:46:18.748 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34908.log.gz 2024-05-21T14:46:18.748 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35116.log 2024-05-21T14:46:18.748 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32102.log.gz 2024-05-21T14:46:18.750 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33157.log 2024-05-21T14:46:18.750 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34471.log: /var/log/ceph/ceph-client.admin.35116.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34471.log.gz 2024-05-21T14:46:18.750 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34711.log 2024-05-21T14:46:18.751 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35116.log.gz 2024-05-21T14:46:18.751 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.4.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-21T14:46:18.751 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28642.log 2024-05-21T14:46:18.751 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.28522.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28522.log.gz 2024-05-21T14:46:18.751 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.28642.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28642.log.gz 2024-05-21T14:46:18.752 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28053.log 2024-05-21T14:46:18.752 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33157.log.gz 2024-05-21T14:46:18.752 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32932.log 2024-05-21T14:46:18.752 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34711.log.gz 2024-05-21T14:46:18.753 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28053.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-21T14:46:18.753 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28053.log.gz 2024-05-21T14:46:18.754 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32946.log 2024-05-21T14:46:18.754 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32932.log.gz 2024-05-21T14:46:18.755 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35377.log 2024-05-21T14:46:18.756 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32945.log 2024-05-21T14:46:18.756 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32946.log.gz 2024-05-21T14:46:18.757 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34633.log 2024-05-21T14:46:18.757 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35377.log.gz 2024-05-21T14:46:18.758 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34237.log 2024-05-21T14:46:18.758 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32945.log.gz 2024-05-21T14:46:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35545.log 2024-05-21T14:46:18.759 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34633.log.gz 2024-05-21T14:46:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32072.log 2024-05-21T14:46:18.760 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34237.log.gz 2024-05-21T14:46:18.761 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32451.log 2024-05-21T14:46:18.761 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35545.log.gz 2024-05-21T14:46:18.762 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35573.log 2024-05-21T14:46:18.762 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32072.log.gz 2024-05-21T14:46:18.764 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34211.log 2024-05-21T14:46:18.764 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32451.log.gz 2024-05-21T14:46:18.764 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33451.log 2024-05-21T14:46:18.765 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35573.log.gz 2024-05-21T14:46:18.766 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32530.log 2024-05-21T14:46:18.766 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34211.log.gz 2024-05-21T14:46:18.767 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33451.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.23131.log 2024-05-21T14:46:18.767 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33451.log.gz 2024-05-21T14:46:18.767 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33558.log 2024-05-21T14:46:18.769 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32530.log.gz 2024-05-21T14:46:18.769 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.tmp-client.admin.23131.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.23131.log.gz 2024-05-21T14:46:18.769 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-21T14:46:18.770 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34804.log 2024-05-21T14:46:18.770 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33558.log.gz 2024-05-21T14:46:18.771 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33636.log 2024-05-21T14:46:18.772 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34055.log 2024-05-21T14:46:18.773 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34804.log.gz 2024-05-21T14:46:18.773 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33636.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.33636.log.gz 2024-05-21T14:46:18.774 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34055.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34055.log.gz 2024-05-21T14:46:18.775 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32938.log 2024-05-21T14:46:18.775 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35298.log 2024-05-21T14:46:18.777 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32347.log 2024-05-21T14:46:18.777 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32938.log.gz 2024-05-21T14:46:18.778 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32242.log 2024-05-21T14:46:18.778 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35298.log.gz 2024-05-21T14:46:18.779 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32521.log 2024-05-21T14:46:18.780 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32347.log.gz 2024-05-21T14:46:18.780 INFO:teuthology.orchestra.run.smithi084.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-21T14:46:18.781 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35246.log 2024-05-21T14:46:18.781 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32242.log.gz 2024-05-21T14:46:18.781 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28156.log 2024-05-21T14:46:18.782 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32521.log.gz 2024-05-21T14:46:18.783 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34419.log 2024-05-21T14:46:18.783 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35246.log.gz 2024-05-21T14:46:18.784 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.28156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32399.log 2024-05-21T14:46:18.784 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.28156.log.gz 2024-05-21T14:46:18.785 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33839.log 2024-05-21T14:46:18.785 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34419.log.gz 2024-05-21T14:46:18.786 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33505.log 2024-05-21T14:46:18.786 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32399.log.gz 2024-05-21T14:46:18.787 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33839.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-21T14:46:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33505.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.33839.log.gz 2024-05-21T14:46:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34659.log 2024-05-21T14:46:18.788 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33505.log.gz 2024-05-21T14:46:18.789 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33894.log 2024-05-21T14:46:18.791 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34659.log: 85.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-21T14:46:18.791 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34659.log.gz 2024-05-21T14:46:18.791 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35038.log 2024-05-21T14:46:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33894.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33894.log.gz 2024-05-21T14:46:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32373.log 2024-05-21T14:46:18.793 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32725.log 2024-05-21T14:46:18.794 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35038.log.gz 2024-05-21T14:46:18.795 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34263.log 2024-05-21T14:46:18.795 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32373.log.gz 2024-05-21T14:46:18.796 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35455.log 2024-05-21T14:46:18.796 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32725.log.gz 2024-05-21T14:46:18.797 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33689.log 2024-05-21T14:46:18.797 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34263.log.gz 2024-05-21T14:46:18.798 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31794.log 2024-05-21T14:46:18.798 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35455.log.gz 2024-05-21T14:46:18.799 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34778.log 2024-05-21T14:46:18.800 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.31794.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.33689.log.gz 2024-05-21T14:46:18.800 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33479.log 2024-05-21T14:46:18.801 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31794.log.gz 2024-05-21T14:46:18.802 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35090.log 2024-05-21T14:46:18.802 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34778.log.gz 2024-05-21T14:46:18.803 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31939.log 2024-05-21T14:46:18.803 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33479.log.gz 2024-05-21T14:46:18.804 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35194.log 2024-05-21T14:46:18.804 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35090.log.gz 2024-05-21T14:46:18.805 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.31939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34986.log 2024-05-21T14:46:18.805 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31939.log.gz 2024-05-21T14:46:18.806 INFO:teuthology.orchestra.run.smithi084.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-21T14:46:18.807 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34882.log 2024-05-21T14:46:18.807 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35194.log.gz 2024-05-21T14:46:18.807 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33183.log 2024-05-21T14:46:18.808 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34986.log.gz 2024-05-21T14:46:18.808 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34882.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34882.log.gz 2024-05-21T14:46:18.809 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33183.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33183.log.gz 2024-05-21T14:46:18.810 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32190.log 2024-05-21T14:46:18.811 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35064.log 2024-05-21T14:46:18.812 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34081.log 2024-05-21T14:46:18.812 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32190.log.gz 2024-05-21T14:46:18.813 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35064.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35064.log.gz 2024-05-21T14:46:18.814 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34081.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34081.log.gz 2024-05-21T14:46:18.815 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32529.log 2024-05-21T14:46:18.815 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-21T14:46:18.817 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32529.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-21T14:46:18.817 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32529.log.gz 2024-05-21T14:46:18.819 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.audit.log: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-21T14:46:18.823 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32020.log 2024-05-21T14:46:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35012.log 2024-05-21T14:46:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32020.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32020.log.gz 2024-05-21T14:46:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35012.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-21T14:46:18.826 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35012.log.gz 2024-05-21T14:46:18.827 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34830.log 2024-05-21T14:46:18.830 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.34830.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34830.log.gz 2024-05-21T14:46:18.830 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33321.log 2024-05-21T14:46:18.833 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33321.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33321.log.gz 2024-05-21T14:46:18.833 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33425.log 2024-05-21T14:46:18.836 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33425.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33425.log.gz 2024-05-21T14:46:18.836 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33131.log 2024-05-21T14:46:18.839 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33131.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33131.log.gz 2024-05-21T14:46:18.839 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32516.log 2024-05-21T14:46:18.839 INFO:teuthology.orchestra.run.smithi078.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-21T14:46:18.840 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32531.log 2024-05-21T14:46:18.842 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32516.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32516.log.gz 2024-05-21T14:46:18.842 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32531.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32531.log.gz 2024-05-21T14:46:18.843 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35142.log 2024-05-21T14:46:18.844 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32294.log 2024-05-21T14:46:18.846 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35142.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35142.log.gz 2024-05-21T14:46:18.846 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32294.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32294.log.gz 2024-05-21T14:46:18.847 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33399.log 2024-05-21T14:46:18.848 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35327.log 2024-05-21T14:46:18.849 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33399.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33399.log.gz 2024-05-21T14:46:18.850 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35327.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35327.log.gz 2024-05-21T14:46:18.850 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35220.log 2024-05-21T14:46:18.852 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35168.log 2024-05-21T14:46:18.853 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35220.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35220.log.gz 2024-05-21T14:46:18.854 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35168.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35168.log.gz 2024-05-21T14:46:18.854 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27937.log 2024-05-21T14:46:18.856 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32512.log 2024-05-21T14:46:18.857 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27937.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.27937.log.gz 2024-05-21T14:46:18.858 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32512.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32512.log.gz 2024-05-21T14:46:18.858 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34393.log 2024-05-21T14:46:18.860 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33739.log 2024-05-21T14:46:18.861 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34393.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34393.log.gz 2024-05-21T14:46:18.862 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33739.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.33739.log.gz 2024-05-21T14:46:18.864 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32046.log 2024-05-21T14:46:18.864 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32216.log 2024-05-21T14:46:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32046.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32046.log.gz 2024-05-21T14:46:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32216.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32216.log.gz 2024-05-21T14:46:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32164.log 2024-05-21T14:46:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33584.log 2024-05-21T14:46:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32164.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32164.log.gz 2024-05-21T14:46:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33584.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33584.log.gz 2024-05-21T14:46:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34934.log 2024-05-21T14:46:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32268.log 2024-05-21T14:46:18.873 INFO:teuthology.orchestra.run.smithi084.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-21T14:46:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34934.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34934.log.gz 2024-05-21T14:46:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32268.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32268.log.gz 2024-05-21T14:46:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33295.log 2024-05-21T14:46:18.876 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-05-21T14:46:18.877 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33295.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33295.log.gz 2024-05-21T14:46:18.879 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32723.log 2024-05-21T14:46:18.880 INFO:teuthology.orchestra.run.smithi078.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-05-21T14:46:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34315.log 2024-05-21T14:46:18.881 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31830.log 2024-05-21T14:46:18.881 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32723.log.gz 2024-05-21T14:46:18.883 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.34315.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34315.log.gz 2024-05-21T14:46:18.883 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32715.log 2024-05-21T14:46:18.885 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.31830.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31830.log.gz 2024-05-21T14:46:18.886 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32715.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32715.log.gz 2024-05-21T14:46:18.886 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32739.log 2024-05-21T14:46:18.887 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35272.log 2024-05-21T14:46:18.889 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32739.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32739.log.gz 2024-05-21T14:46:18.890 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.35272.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35272.log.gz 2024-05-21T14:46:18.907 INFO:teuthology.orchestra.run.smithi078.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-21T14:46:18.975 INFO:teuthology.orchestra.run.smithi078.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-21T14:46:19.277 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-21T14:46:19.291 INFO:teuthology.orchestra.run.smithi084.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-21T14:46:19.324 INFO:teuthology.orchestra.run.smithi078.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-21T14:46:19.328 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-21T14:46:19.367 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-21T14:46:19.368 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-05-21T14:46:19.369 INFO:teuthology.orchestra.run.smithi084.stderr:real 0m0.667s 2024-05-21T14:46:19.369 INFO:teuthology.orchestra.run.smithi084.stderr:user 0m2.649s 2024-05-21T14:46:19.369 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m0.119s 2024-05-21T14:46:19.430 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-21T14:46:19.434 INFO:teuthology.orchestra.run.smithi078.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-21T14:46:19.476 INFO:teuthology.orchestra.run.smithi078.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-21T14:46:19.478 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-05-21T14:46:19.478 INFO:teuthology.orchestra.run.smithi078.stderr:real 0m0.810s 2024-05-21T14:46:19.479 INFO:teuthology.orchestra.run.smithi078.stderr:user 0m2.971s 2024-05-21T14:46:19.479 INFO:teuthology.orchestra.run.smithi078.stderr:sys 0m0.491s 2024-05-21T14:46:19.479 INFO:tasks.ceph:Archiving logs... 2024-05-21T14:46:19.480 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7718553/remote/smithi078/log 2024-05-21T14:46:19.481 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-21T14:46:19.982 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7718553/remote/smithi084/log 2024-05-21T14:46:19.983 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-21T14:46:20.336 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-21T14:46:20.345 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-21T14:46:20.345 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-21T14:46:20.348 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-21T14:46:20.429 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-21T14:46:20.438 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-21T14:46:20.438 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-21T14:46:20.441 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-21T14:46:20.452 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2024-05-21T14:46:20.453 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2024-05-21T14:46:20.453 INFO:teuthology.orchestra.run.smithi078.stdout:+hv01.front.sepi 67.205.162.81 3 u 50 64 177 0.093 -3.171 0.400 2024-05-21T14:46:20.453 INFO:teuthology.orchestra.run.smithi078.stdout:*hv02.front.sepi 63.231.80.2 3 u 54 64 177 0.079 +2.924 0.720 2024-05-21T14:46:20.453 INFO:teuthology.orchestra.run.smithi078.stdout:+hv03.front.sepi 74.6.168.72 3 u 53 64 177 0.087 -0.028 0.756 2024-05-21T14:46:20.453 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T14:46:20.454 INFO:teuthology.orchestra.run.smithi084.stdout: remote refid st t when poll reach delay offset jitter 2024-05-21T14:46:20.454 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================== 2024-05-21T14:46:20.455 INFO:teuthology.orchestra.run.smithi084.stdout:+hv01.front.sepi 67.205.162.81 3 u 44 64 177 0.065 -3.599 1.021 2024-05-21T14:46:20.455 INFO:teuthology.orchestra.run.smithi084.stdout:+hv02.front.sepi 63.231.80.2 3 u 40 64 177 0.087 +1.419 1.283 2024-05-21T14:46:20.455 INFO:teuthology.orchestra.run.smithi084.stdout:*hv03.front.sepi 74.6.168.72 3 u 46 64 177 0.100 -0.562 0.707 2024-05-21T14:46:20.455 INFO:teuthology.orchestra.run.smithi084.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T14:46:20.455 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-21T14:46:20.463 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-21T14:46:20.464 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-21T14:46:20.496 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-21T14:46:20.529 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-21T14:46:20.563 INFO:teuthology.task.internal:Duration was 902.077544 seconds 2024-05-21T14:46:20.563 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-21T14:46:20.596 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-21T14:46:20.596 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-21T14:46:20.600 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-21T14:46:20.699 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-21T14:46:20.700 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2024-05-21T14:46:20.700 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-21T14:46:20.719 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2024-05-21T14:46:20.719 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-21T14:46:20.728 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-21T14:46:20.728 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-21T14:46:20.769 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-21T14:46:20.802 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-21T14:46:20.802 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-21T14:46:20.849 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-21T14:46:20.923 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-21T14:46:20.933 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-21T14:46:20.933 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-21T14:46:20.953 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-21T14:46:20.966 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-21T14:46:20.975 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-21T14:46:20.997 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-21T14:46:21.011 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2024-05-21T14:46:21.020 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2024-05-21T14:46:21.037 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-21T14:46:21.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T14:46:21.077 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-21T14:46:21.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T14:46:21.082 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-21T14:46:21.092 INFO:teuthology.task.internal:Transferring archived files... 2024-05-21T14:46:21.093 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7718553/remote/smithi078 2024-05-21T14:46:21.093 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-21T14:46:21.143 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7718553/remote/smithi084 2024-05-21T14:46:21.143 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-21T14:46:21.164 INFO:teuthology.task.internal:Removing archive directory... 2024-05-21T14:46:21.164 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-21T14:46:21.189 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-21T14:46:21.211 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-21T14:46:21.221 INFO:teuthology.task.internal:Not uploading archives. 2024-05-21T14:46:21.221 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-21T14:46:21.238 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-21T14:46:21.239 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-21T14:46:21.241 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-21T14:46:21.247 INFO:teuthology.orchestra.run.smithi078.stdout: 655427 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 21 14:46 /home/ubuntu/cephtest 2024-05-21T14:46:21.262 INFO:teuthology.orchestra.run.smithi084.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 21 14:46 /home/ubuntu/cephtest 2024-05-21T14:46:21.264 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-21T14:46:21.274 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-21T14:46:21.342 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 4fed890e8ce3966dbe380e9eb4b0a796eddb841c description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} duration: 902.0775442123413 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-21T14:46:21.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-21T14:46:21.417 INFO:teuthology.run:pass